SYSTEM all green source lights.co.uk queue 12,491 pages p99 latency 185ms dataflirt.com · scraper/lights-co.uk
RUN * 14 active pipelines * lights.co.uk live

Lights.co.uk data,
structured at scale.

We extract lighting fixtures, technical specifications, energy ratings, pricing signals, and stock availability from lights.co.uk. Delivered as clean JSON, CSV, or Parquet to S3, BigQuery, or Snowflake.

Products extracted
42.5K /run
Price updates
18.2K /day
Specs mapped
640K /run
Active pipelines
14
Uptime
99.98%
Data Dictionary

Every field we extract from lights.co.uk

Structured, schema-consistent data across all major object types — delivered clean, typed, and ready to query.

Complete list of extractable fields for Product Listings objects from lights.co.uk. All fields typed and schema-versioned.

skutitlebrandcategorysub_categorypricelist_priceenergy_classip_ratingmaterialcolourdimensionsin_stockdelivery_time
product_listings
● 200 OK
"sku": "1002345",
"title": "Philips Hue White Ambiance LED Ceiling Light",
"brand": "Philips",
"price": 129.9,
"energy_class": "F",
"ip_rating": "IP20",
"in_stock": true
# skutitlebrandcategorysub_categoryprice
1
2
3

Complete list of extractable fields for Technical Specs objects from lights.co.uk. All fields typed and schema-versioned.

skusocket_typebulb_includedwattageluminous_fluxcolour_temperaturedimmablesmart_home_systemoperating_voltageprotection_class
technical_specs
● 200 OK
"sku": "1002345",
"socket_type": "Integrated LED",
"bulb_included": true,
"wattage": "22.5W",
"luminous_flux": "2400 lm",
"colour_temperature": "2200K - 6500K",
"dimmable": true
# skusocket_typebulb_includedwattageluminous_fluxcolour_temperature
1
2
3

Complete list of extractable fields for Pricing & Offers objects from lights.co.uk. All fields typed and schema-versioned.

skucurrent_priceoriginal_pricediscount_pctvoucher_eligiblebulk_discount_availablevat_includedprice_timestampcurrency
pricing_& offers
● 200 OK
"sku": "1002345",
"current_price": 129.9,
"original_price": 149.9,
"discount_pct": 13,
"voucher_eligible": false,
"vat_included": true,
"price_timestamp": "2026-05-12T09:14:00Z"
# skucurrent_priceoriginal_pricediscount_pctvoucher_eligiblebulk_discount_available
1
2
3

Complete list of extractable fields for Stock & Delivery objects from lights.co.uk. All fields typed and schema-versioned.

skustock_statusdispatch_timedelivery_costfree_delivery_eligiblereturn_policysupplier_stocklast_checked
stock_& delivery
● 200 OK
"sku": "1002345",
"stock_status": "In Stock",
"dispatch_time": "24 hours",
"delivery_cost": 0.0,
"free_delivery_eligible": true,
"return_policy": "30 days",
"last_checked": "2026-05-12T09:14:33Z"
# skustock_statusdispatch_timedelivery_costfree_delivery_eligiblereturn_policy
1
2
3

Complete list of extractable fields for Reviews objects from lights.co.uk. All fields typed and schema-versioned.

review_idskuratingauthordatetitlebodyhelpful_votesverified_purchase
reviews
● 200 OK
"review_id": "REV-98234",
"sku": "1002345",
"rating": 5,
"author": "James T.",
"date": "2026-04-18",
"title": "Excellent smart light",
"verified_purchase": true
# review_idskuratingauthordatetitle
1
2
3

Capabilities

Complete lighting catalogue extraction

Our lights.co.uk scraper handles complex technical specifications, nested category structures, and dynamic stock indicators with full JavaScript rendering.

Product Extraction

Title, brand, SKU, descriptions, and high-resolution image URLs scraped across all lighting categories.

Technical Specs

Extract granular details including IP ratings, socket types, luminous flux, and smart home compatibility.

Energy Labels

Capture EU/UK energy efficiency classes and compliance data directly from product metadata.

Price Tracking

Monitor current prices, RRPs, discount percentages, and promotional voucher eligibility.

Stock Monitoring

Track inventory status, dispatch times, and delivery costs across the entire catalogue.

Review Mining

Extract customer ratings, review text, and verified purchase flags for product sentiment analysis.

Category Traversal

Navigate nested category trees to maintain accurate product taxonomy and sub-category mapping.

Image Extraction

Capture primary and gallery image URLs, including technical drawings and dimension schematics.

Scheduled Runs

Configure daily or weekly pipelines to detect catalogue additions and price changes automatically.

// engagement pipeline

From target list to structured data

Brief in. Clean data out.

Define Scope
d 0

Provide categories, brands, or specific SKUs. We map the required technical specifications and pricing fields.

Pipeline Build
d 2–4

We configure Scrapy and Playwright to navigate lights.co.uk, handling dynamic rendering and rate limits.

Validation & QA
d 4–6

Schema validation ensures technical fields like lumens and IP ratings are parsed correctly before launch.

Delivery
ongoing

Clean, normalised datasets pushed to your warehouse or object storage on your specified schedule.

Under the hood

Handling lights.co.uk extraction complexity

E-commerce sites deploy dynamic rendering and anti-bot measures. Here is how we maintain reliable extraction.

pipeline-monitor · lights.co.uk · live ● active
// fingerprinting
Identity rotation
TLS fingerprintrandomised
User-agentrotated
IP poolresidential
Challenges blocked0
// pagination
Page coverage
48,291 pages queued running
// observability
Pipeline health
99.9%
uptime
142ms
p99 lat
0.3%
null rate
2
alerts
Dynamic rendering
Playwright for JavaScript hydration

Critical pricing updates and stock availability often load dynamically via JavaScript. We use full Playwright browser sessions to ensure all client-side rendered data is captured accurately.

Anti-bot layer
Residential proxy rotation

To prevent IP bans during full catalogue crawls, we route requests through UK-based residential proxies, managing session cookies and mimicking standard browsing behaviour.

Data structuring
Technical specification normalisation

Lighting specs vary wildly. We parse unstructured HTML tables into clean JSON key-value pairs, ensuring fields like 'colour temperature' and 'luminous flux' are consistently formatted.

Variant handling
Mapping complex product families

Fixtures available in multiple sizes or finishes are mapped correctly, linking child SKUs to parent models with their specific pricing and stock levels.

Change detection
Delta exports for pricing

Instead of processing the entire catalogue daily, our pipeline identifies changed fields and delivers delta files, optimising your ingestion costs.

Applications

Who uses lighting retail data

Teams across industries use lights.co.uk data to build competitive products and smarter operations.

01
Price Intelligence

Retailers monitor lights.co.uk pricing and discount strategies to adjust their own pricing models dynamically.

02
Competitor Analysis

Brands track which competing products are featured, discounted, or out of stock across key categories.

03
Assortment Planning

Merchandisers analyse catalogue gaps by tracking new product additions and category depth.

04
Product Information Management

Distributors enrich their own PIM systems with accurate technical specifications and energy ratings.

05
Energy Compliance Tracking

Consultancies monitor the shift in energy efficiency classes across the market to track regulatory compliance.

06
Market Research

Analysts track review volumes and ratings to identify trending smart home lighting systems.

Why DataFlirt

"Lighting retail requires precise technical specifications. Extracting IP ratings, lumens, and energy classes is just as critical as capturing the price."

Standard HTTP clients fail on lights.co.uk because critical technical data and stock levels load dynamically via JavaScript. DataFlirt uses full browser rendering and residential proxies to ensure every specification, energy label, and pricing tier is captured accurately.

Technical Spec

lights.co.uk scraper technical specifications

Everything supported by our lights.co.uk scraper — rendered SPA elements, auth walls, rate-limit evasion and beyond.

JavaScript rendering
Full Playwright sessions required for dynamic pricing and stock data
Supported
Residential proxies
UK-based ISP proxies rotated to bypass rate limiting
Supported
Spec normalisation
HTML tables parsed into structured JSON key-value pairs
Supported
Variant mapping
Parent-child relationships for different sizes and finishes
Supported
Change detection
Delta exports emitting only modified records
Supported
Webhook delivery
HTTP POST for real-time stock and price alerts
Supported
Trade/B2B exclusive pricing
Requires authenticated professional account access
Partial
User account order history
Private user data behind login walls
Partial
Infrastructure

Infrastructure powering the extraction

Open-source tooling on proven cloud infra — no vendor lock-in, full observability.

ScrapyPlaywrightPython 3.12RedisPostgreSQLApache AirflowAWS LambdaS3CloudWatch2CaptchaCapSolverResidential ProxiesDockerKubernetesGrafanaPrometheusFastAPI
Scrapy + Playwright Stack

Scrapy handles crawl orchestration and deduplication. Playwright handles JavaScript rendering and interaction flows for dynamic product pages.

Residential Proxy Infrastructure

We maintain pools of UK residential proxies. Rotation happens per-request to prevent bot detection and IP bans.

Cloud-Native Orchestration

Pipelines run on AWS Lambda and ECS. Airflow handles scheduling, while all state is stored in managed PostgreSQL.

Output & Delivery

Your data, your destination

Data delivered to where your team already works — no new tooling required.

JSON
Newline-delimited or nested arrays
CSV
Flat file with typed columns
XLS
Excel format for business analysts
Parquet
Columnar format for data warehouses
AWS S3
Direct bucket delivery
Webhook
HTTP POST per record
API
REST endpoints for data retrieval
PostgreSQL
Direct database upserts
S3
Direct bucket delivery — compatible with any data lake
// faq

Common questions.

About lights.co.uk scraping, legality, and pipeline operations.

Ask us directly →
Is scraping lights.co.uk legal?

Scraping publicly available product and pricing information is generally permissible. DataFlirt targets only public, non-authenticated data. We do not extract personal data or circumvent authentication walls.

How do you handle dynamic content loading?

We use Playwright to execute JavaScript, ensuring all client-side rendered elements, such as dynamic stock indicators and variant pricing, are fully loaded before extraction.

How fresh is the pricing data?

Pipelines can be configured for daily or sub-daily runs depending on your requirements, ensuring you receive up-to-date pricing and stock signals.

How are complex technical specifications formatted?

We parse unstructured HTML specification tables into clean, normalised JSON key-value pairs, ensuring consistent schema across different product categories.

What is the minimum engagement size?

We typically start with a defined list of SKUs or specific categories. Contact us with your target volume for a precise technical scoping.

Can I request a sample dataset?

Yes. We provide a sample run of up to 500 SKUs during the scoping phase to validate schema fit and data completeness before contract execution.

$ dataflirt scope --new-project --source=lights.co.uk ready

Tell us what
to extract.
We do the rest.

20-minute scoping call. Pilot dataset within the week. Production within two. From daily price monitoring to full technical specification extraction. Tell us your requirements.

hello@dataflirt.com · Bengaluru · IST · typical reply < 4h
Related Scrapers

More in lighting

Services

Data Extraction for Every Industry

View All Services →