SYSTEM all green source click-licht.de queue 14,892 pages p99 latency 184ms dataflirt.com · scraper/click-licht-de
RUN · 37 active pipelines · click-licht.de live

Lighting specs,
at warehouse scale.

We extract technical lighting specifications, pricing signals, brand catalogues, and stock levels from click-licht.de. Delivered as clean JSON, CSV, or Parquet to S3, BigQuery, or Snowflake on your cadence.

Products extracted
84,312 /day
Price updates
112,405 /24h
Spec records
1.2M /run
Active pipelines
37
Uptime
99.98%
Data Dictionary

Every field we extract from click-licht.de

Structured, schema-consistent data across all major object types — delivered clean, typed, and ready to query.

Complete list of extractable fields for Product Listings objects from click-licht.de. All fields typed and schema-versioned.

skutitlebrandcategorypricelist_priceenergy_classstock_statusdelivery_timeimage_urls
product_listings
● 200 OK
"sku": "CL-49281-W",
"title": "Philips Hue White Ambiance LED",
"brand": "Philips",
"price": 29.99,
"energy_class": "F",
"stock_status": "in_stock",
"delivery_time": "1-3 days"
# skutitlebrandcategorypricelist_price
1
2
3

Complete list of extractable fields for Technical Specs objects from click-licht.de. All fields typed and schema-versioned.

skulumenskelvinip_ratingdimmablematerialsmart_homewarrantysocket_typewattage
technical_specs
● 200 OK
"sku": "CL-49281-W",
"lumens": 806,
"kelvin": "2200-6500K",
"ip_rating": "IP20",
"dimmable": true,
"smart_home": "Zigbee",
"socket_type": "E27",
"wattage": 8.5
# skulumenskelvinip_ratingdimmablematerial
1
2
3

Complete list of extractable fields for Pricing & Inventory objects from click-licht.de. All fields typed and schema-versioned.

skubase_pricediscounted_pricediscount_pctstock_countavailability_statuscurrencyscraped_atshipping_cost
pricing_& inventory
● 200 OK
"sku": "CL-49281-W",
"base_price": 34.99,
"discounted_price": 29.99,
"discount_pct": 14,
"availability_status": "available",
"currency": "EUR",
"scraped_at": "2026-05-12T09:14:00Z"
# skubase_pricediscounted_pricediscount_pctstock_countavailability_status
1
2
3

Complete list of extractable fields for Categories & Navigation objects from click-licht.de. All fields typed and schema-versioned.

category_pathprimary_categorysub_categoryurlproduct_countbreadcrumbsfilter_attributessort_order
categories_& navigation
● 200 OK
"primary_category": "Smart Home",
"sub_category": "Smart Bulbs",
"product_count": 412,
"url": "https://www.click-licht.de/smart-home/leuchtmittel",
"breadcrumbs": "['Home', 'Smart Home', 'Smart Bulbs']",
"sort_order": "popularity"
# category_pathprimary_categorysub_categoryurlproduct_countbreadcrumbs
1
2
3

Complete list of extractable fields for Reviews & Ratings objects from click-licht.de. All fields typed and schema-versioned.

review_idskuratingauthordatetextverifiedhelpful_voteslanguage
reviews_& ratings
● 200 OK
"review_id": "REV-99281",
"sku": "CL-49281-W",
"rating": 5,
"author": "Markus T.",
"date": "2026-04-18",
"text": "Top Qualität und schnelle Lieferung.",
"verified": true,
"helpful_votes": 3
# review_idskuratingauthordatetext
1
2
3

Capabilities

Everything you need from Click-Licht.De

Our extraction pipeline parses complex technical tables, variant switchers, and dynamic pricing widgets across the entire Click-Licht.De catalogue.

Technical Spec Parsing

Extract lumens, colour temperature, IP ratings, socket types, and wattage from nested HTML specification tables.

Price & Discount Tracking

Capture base prices, current discounts, and promotional flags across all lighting categories in real time.

Stock & Delivery Times

Monitor availability statuses and estimated delivery windows to track inventory depth and supply chain shifts.

Brand Catalogue Mapping

Extract complete assortments for brands like Philips, Osram, and Paulmann, including brand specific promotional badges.

Variant Grouping

Map parent fixtures to child variants based on colour, size, or material, ensuring clean relational data.

Smart Home Compatibility

Identify supported protocols including Zigbee, Z-Wave, WiFi, Bluetooth, Apple HomeKit, and Philips Hue compatibility.

Energy Label Extraction

Capture EU energy efficiency classes and consumption metrics directly from product listings.

Review Aggregation

Pull customer ratings, review text, and verified purchase flags to monitor product quality and feedback.

Scheduled Execution

Run extractions daily, weekly, or hourly to maintain an up to date view of the German lighting market.

// engagement pipeline

From URL list to warehouse record

Brief in. Clean data out.

Define Scope
d 0

Provide categories, brand URLs, or specific SKUs. We design the extraction schema together.

Pipeline Build
d 2–4

We configure Scrapy crawlers, proxy rotation, and session management for click-licht.de.

Validation & QA
d 4–6

Schema validation, null-rate checks, and technical spec normalisation before full launch.

Delivery
ongoing

JSON / CSV / Parquet pushed to your S3 bucket or warehouse on agreed cadence.

Under the hood

How our pipeline handles eCommerce complexities

Extracting structured data from modern eCommerce platforms requires handling dynamic widgets and anti-bot systems.

pipeline-monitor · click-licht.de · live ● active
// fingerprinting
Identity rotation
TLS fingerprintrandomised
User-agentrotated
IP poolresidential
Challenges blocked0
// pagination
Page coverage
48,291 pages queued running
// observability
Pipeline health
99.9%
uptime
142ms
p99 lat
0.3%
null rate
2
alerts
Localised proxies
German residential IP rotation

We use German residential proxies to ensure accurate local pricing, availability, and language rendering, avoiding geolocation blocks or currency redirects.

Dynamic rendering
Playwright for variant switching

Lighting fixtures often have dozens of variants. We use Playwright to execute JavaScript and trigger variant switches, capturing accurate prices and specs for every SKU.

Table parsing
Technical spec normalisation

Specification tables vary wildly between bulbs and fixtures. Our parsers normalise keys like 'Lichtstrom' to 'lumens' and 'Schutzart' to 'ip_rating' for consistent downstream querying.

Change detection
Delta exports for pricing

We maintain state across runs, pushing only records where price, stock, or delivery times have changed, reducing your processing overhead.

Monitoring
Schema drift detection

If click-licht.de updates their product page layout, our monitoring stack detects null-rate spikes and alerts our engineering team to update selectors immediately.

Applications

Who uses Click-Licht.De data

Teams across industries use click-licht.de data to build competitive products and smarter operations.

01
Price Intelligence

Retailers track click-licht.de pricing and discount strategies to optimise their own margins and promotional calendars.

02
Competitor Benchmarking

Brands monitor their visibility, pricing adherence, and assortment overlap against competing manufacturers.

03
Assortment Planning

Merchandisers analyse technical spec trends, such as the shift towards specific smart home protocols or higher efficiency classes.

04
Market Research

Analysts track review velocity and stock availability to identify top performing lighting categories in the German market.

05
Energy Compliance

Auditors scrape energy efficiency class data to ensure market compliance and track the phase-out of older lighting technologies.

06
AI Training Data

Machine learning teams use structured technical specifications and product descriptions to train domain specific recommendation engines.

Why DataFlirt

"Lighting eCommerce requires precise technical extraction. Missing a lumen count or IP rating renders the dataset useless for serious assortment planning."

Most teams underestimate the complexity of parsing nested HTML tables for technical specifications across thousands of lighting variants. DataFlirt manages the residential proxies, JavaScript rendering, and schema normalisation so your engineers can focus on pricing strategy and catalogue expansion.

Technical Spec

Click-Licht.De scraper technical capabilities

Everything supported by our click-licht.de scraper — rendered SPA elements, auth walls, rate-limit evasion and beyond.

JavaScript rendering
Full Playwright execution for dynamic pricing and variant switches
Supported
Residential proxy rotation
DE-based residential IPs to ensure accurate local data
Supported
Variant mapping
Parent to child SKU relationships for colour and size options
Supported
Technical spec normalisation
German to English key mapping for technical lighting metrics
Supported
Change detection (diffs)
Hash-based diffing to emit only changed records
Supported
Review extraction
Full review text and ratings from product pages
Supported
B2B wholesale pricing
Requires authenticated trade account credentials
Partial
Customer order history
Private user data behind login walls
Partial
Infrastructure

Infrastructure powering the pipeline

Open-source tooling on proven cloud infra — no vendor lock-in, full observability.

ScrapyPlaywrightPython 3.12RedisPostgreSQLApache AirflowAWS LambdaS3CloudWatch2CaptchaCapSolverResidential ProxiesDockerKubernetesGrafanaPrometheus
Scrapy + Playwright Stack

Scrapy handles crawl orchestration and deduplication. Playwright handles JavaScript rendering and variant interaction flows.

Proxy Infrastructure

We maintain pools of residential proxies in Germany to ensure accurate local pricing and avoid rate limits.

Cloud-Native Orchestration

Pipelines run on AWS Lambda and ECS. Airflow handles scheduling, dependency management, and SLA alerting.

Output & Delivery

Your data, your destination

Data delivered to where your team already works — no new tooling required.

JSON
Newline-delimited or nested arrays
CSV
Flat file with typed columns
XLS
Excel compatible format for analysts
Parquet
Columnar format for data warehouses
AWS S3
Direct bucket delivery
Webhook
HTTP POST per record for real time updates
API
REST endpoint for on demand queries
BigQuery
Streamed directly into your dataset
S3
Direct bucket delivery — compatible with any data lake
// faq

Common questions.

About click-licht.de scraping, legality, and pipeline operations.

Ask us directly →
Is scraping click-licht.de legal?

Scraping publicly available information from click-licht.de is generally permissible. DataFlirt extracts only public product, pricing, and technical data. We do not extract personal data or circumvent authentication walls.

How do you handle variant pricing?

We use Playwright to interact with variant selectors on the product page, capturing the specific price, stock status, and technical specs for every individual SKU within a product family.

Can you normalise German technical specifications?

Yes. Our parsers map German specification keys (e.g., 'Fassung', 'Lichtfarbe') to standardised English keys (e.g., 'socket_type', 'kelvin') to ensure consistent schema delivery.

How frequent are the updates?

We configure pipeline cadence based on your requirements. Pricing and stock data can be extracted daily or hourly, while full catalogue refreshes typically run weekly.

Do you extract energy efficiency labels?

We extract the stated energy efficiency class (e.g., A to G) directly from the product metadata. We do not parse data from linked PDF documents.

What is the delivery format?

Data is delivered in your preferred format, including JSON, CSV, or Parquet, pushed directly to your S3 bucket, Google Cloud Storage, or Snowflake instance.

$ dataflirt scope --new-project --source=click-licht.de ready

Tell us what
to extract.
We do the rest.

20-minute scoping call. Pilot dataset within the week. Production within two. Whether you need a one-off catalogue dump or continuous price monitoring across the Click-Licht.De assortment — we build and operate the pipeline. Tell us what you need.

hello@dataflirt.com · Bengaluru · IST · typical reply < 4h
Related Scrapers

More in lighting

Services

Data Extraction for Every Industry

View All Services →