SYSTEM all green source elightbulbs.com queue 12,409 pages p99 latency 187ms dataflirt.com · scraper/elightbulbs-com
RUN · 14 active pipelines · elightbulbs.com live

Lighting specifications,
extracted at scale.

We extract product listings, technical specifications, bulk pricing tiers, and stock depth from elightbulbs.com. Delivered as clean JSON, CSV, or Parquet to S3, BigQuery, or Snowflake on your cadence.

Products extracted
84.2K /run
Spec updates
215K /week
Price tiers
342K /24h
Active pipelines
14
Uptime
99.98%
Data Dictionary

Every field we extract from elightbulbs.com

Structured, schema-consistent data across all major object types — delivered clean, typed, and ready to query.

Complete list of extractable fields for Product Specs objects from elightbulbs.com. All fields typed and schema-versioned.

skutitlebrandbase_typebulb_shapewattagelumenscolour_tempcrilifespan_hoursvoltagedimmablefinish
product_specs
● 200 OK
"sku": "PHL-45892",
"brand": "Philips",
"base_type": "E26 Medium",
"bulb_shape": "A19",
"wattage": 9.5,
"lumens": 800,
"colour_temp": 2700,
"cri": 90
# skutitlebrandbase_typebulb_shapewattage
1
2
3

Complete list of extractable fields for Pricing & Stock objects from elightbulbs.com. All fields typed and schema-versioned.

skubase_pricecase_qtycase_pricediscount_pctstock_statuslead_timemin_order_qtyships_fromcurrency
pricing_& stock
● 200 OK
"sku": "PHL-45892",
"base_price": 4.99,
"case_qty": 24,
"case_price": 105.36,
"discount_pct": 12,
"stock_status": "In Stock",
"min_order_qty": 1,
"currency": "USD"
# skubase_pricecase_qtycase_pricediscount_pctstock_status
1
2
3

Complete list of extractable fields for Taxonomy objects from elightbulbs.com. All fields typed and schema-versioned.

skuprimary_categorysub_categoryapplicationtechnologyenergy_stardlc_qualifiedrohs_compliantbreadcrumbs
taxonomy
● 200 OK
"sku": "PHL-45892",
"primary_category": "LED Bulbs",
"sub_category": "A-Shape LED",
"technology": "LED",
"energy_star": true,
"rohs_compliant": true,
"application": "General Purpose"
# skuprimary_categorysub_categoryapplicationtechnologyenergy_star
1
2
3

Complete list of extractable fields for Ballasts objects from elightbulbs.com. All fields typed and schema-versioned.

skutypestart_methodnum_lampsinput_voltagepower_factorballast_factordimensionsweight
ballasts
● 200 OK
"sku": "ADV-IOP2P32N",
"type": "Electronic Fluorescent",
"start_method": "Instant Start",
"num_lamps": 2,
"input_voltage": "120-277V",
"power_factor": 0.98,
"ballast_factor": 0.88
# skutypestart_methodnum_lampsinput_voltagepower_factor
1
2
3

Complete list of extractable fields for Cross-Reference objects from elightbulbs.com. All fields typed and schema-versioned.

skumanufacturer_part_numupcequivalent_wattagereplacement_foransi_codeunspsc_codeean
cross-reference
● 200 OK
"sku": "PHL-45892",
"manufacturer_part_num": "45892-7",
"upc": "046677458921",
"equivalent_wattage": 60,
"replacement_for": "Incandescent 60W A19",
"ansi_code": "A19",
"unspsc_code": "39101628"
# skumanufacturer_part_numupcequivalent_wattagereplacement_foransi_code
1
2
3

Capabilities

Lighting data, structured for your catalogue

Our elightbulbs.com scraper extracts highly dimensional specification data, normalising inconsistent tables into clean schemas while capturing bulk pricing and stock depth.

Bulb Specification Extraction

Extract wattage, lumens, base type, CRI, colour temperature, and lifespan hours directly from product specification tables.

Bulk Pricing Tiers

Capture base price, case quantities, pallet pricing, and volume discount percentages for B2B procurement modelling.

Cross-Reference Mapping

Extract ANSI codes, OEM part numbers, and equivalent wattage to map replacements across different manufacturers.

Stock & Lead Time Tracking

Monitor inventory levels, drop-ship status, and estimated lead times across the entire product catalogue.

Taxonomy & Categorisation

Map products to specific applications, lighting technologies, and compliance standards like Energy Star and DLC.

Ballast & Fixture Data

Extract specific parameters for ballasts and fixtures, including start methods, input voltage, and lamp compatibility.

Asset Extraction

Capture URLs for PDF spec sheets, photometric data files, and high-resolution product images.

Scheduled Change Detection

Run daily diffs to track pricing adjustments and stock outs without processing the entire catalogue.

Multi-Brand Coverage

Normalise specifications across Philips, Osram, GE, Sylvania, and hundreds of specialty lighting brands.

// engagement pipeline

From SKU list to warehouse record

Brief in. Clean data out.

Define Scope
d 0

Provide categories, search terms, or manufacturer part numbers. We design the extraction schema together.

Pipeline Build
d 2–4

We configure Scrapy crawlers, handle pagination, and write normalisation logic for specification tables.

Validation & QA
d 4–6

Schema validation, null-rate checks, and unit conversion verification before full launch.

Delivery
ongoing

JSON / CSV / Parquet pushed to your S3 bucket, BigQuery dataset, or Snowflake stage on agreed cadence.

Under the hood

Handling parametric complexity

Lighting data is notoriously difficult to parse. Here is how our pipeline handles the inconsistencies of B2B e-commerce.

pipeline-monitor · elightbulbs.com · live ● active
// fingerprinting
Identity rotation
TLS fingerprintrandomised
User-agentrotated
IP poolresidential
Challenges blocked0
// pagination
Page coverage
48,291 pages queued running
// observability
Pipeline health
99.9%
uptime
142ms
p99 lat
0.3%
null rate
2
alerts
Spec table normalisation
Parsing inconsistent HTML tables into typed fields

Elightbulbs uses varying table structures depending on the product type (bulb vs ballast). Our parsers use heuristic mapping to identify keys like 'Color Temperature' or 'Kelvin' and normalise them into a single typed field.

Parametric navigation
Crawling complex filter permutations

To ensure total catalogue coverage, we traverse the site's parametric search filters rather than relying solely on sitemaps, capturing orphaned SKUs and category-specific metadata.

Pricing tier extraction
Capturing volume discounts

B2B pricing involves multiple tiers based on case or pallet quantities. We extract the full pricing matrix for each SKU, allowing you to model bulk procurement costs accurately.

Change detection
Only emit diffs for price and stock

For daily monitoring, we hash the pricing and availability fields. Subsequent runs only push data when a price changes or an item goes out of stock, reducing database load.

Monitoring & alerting
Detecting schema drift

If elightbulbs.com redesigns their product pages, our telemetry detects the drop in field coverage and alerts our engineering team to patch the selectors immediately.

Applications

Who uses elightbulbs.com data

Teams across industries use elightbulbs.com data to build competitive products and smarter operations.

01
Competitor Price Monitoring

Lighting distributors monitor base prices and case discounts to optimise their own pricing strategies.

02
Catalogue Enrichment

B2B suppliers extract structured specifications to populate their PIM systems and improve onsite search.

03
Energy Audit Modelling

Energy consultants extract wattage and lumen data to calculate ROI for LED retrofit projects.

04
Cross-Reference Database Build

Procurement teams map OEM part numbers to generic equivalents to reduce supply chain costs.

05
Supply Chain Procurement

Contractors monitor stock availability and lead times for large-scale commercial lighting installations.

06
Market Research

Manufacturers track category saturation and the transition from fluorescent technologies to LED.

Why DataFlirt

"Lighting specifications are highly dimensional. Without structured data on base types, lumens, and colour temperatures, catalogue mapping is impossible."

Extracting lighting data requires more than simple HTML parsing. Technical specifications are buried in inconsistent tables, pricing depends on case quantities, and cross-referencing OEM part numbers demands precise normalisation. DataFlirt handles the complexity of parametric extraction and schema enforcement, delivering clean, warehouse-ready records so your team can focus on catalogue enrichment.

Technical Spec

Elightbulbs scraper — technical capabilities

Everything supported by our elightbulbs.com scraper — rendered SPA elements, auth walls, rate-limit evasion and beyond.

Spec table parsing
Normalises inconsistent specification tables into structured JSON schemas
Supported
Bulk pricing tiers
Extracts base price, case price, and volume discount percentages
Supported
PDF spec sheet extraction
Captures URLs for manufacturer specification sheets and photometric data
Supported
Change detection (diffs)
Hash-based diff: only emit records with changed fields since last run
Supported
Category pagination
Traverses deep parametric category trees to ensure full coverage
Supported
Cross-reference mapping
Extracts ANSI codes and equivalent replacement data
Supported
Residential proxy rotation
ISP-grade residential IPs to prevent rate limiting during deep crawls
Supported
B2B account-specific pricing
Custom negotiated rates require authenticated login sessions
Partial
Checkout/shipping fee estimation
Requires maintaining a cart session and entering zip codes
Partial
Infrastructure

Infrastructure powering the extraction

Open-source tooling on proven cloud infra — no vendor lock-in, full observability.

ScrapyPlaywrightPython 3.12RedisPostgreSQLApache AirflowAWS LambdaS3CloudWatch2CaptchaCapSolverResidential ProxiesDockerKubernetesGrafanaPrometheus
Scrapy + Playwright Stack

Scrapy handles high-throughput crawl orchestration and deduplication. Playwright handles dynamic content loading and complex navigation flows.

Proxy & Anti-Bot Infrastructure

We maintain pools of US residential ISP proxies to distribute request load, preventing IP bans during full catalogue sweeps.

Cloud-Native Orchestration

Pipelines run on AWS ECS. Airflow handles scheduling, dependency management, and SLA alerting. State is stored in managed Postgres.

Output & Delivery

Your data, your destination

Data delivered to where your team already works — no new tooling required.

JSON
Newline-delimited or nested — schema versioned per run
CSV
Flat file with typed columns — Excel/Sheets compatible
XLS
Excel format for direct business analyst use
Parquet
Columnar format for BigQuery, Snowflake, Athena
AWS S3
Direct bucket delivery — compatible with any data lake
Webhook
HTTP POST per record for real-time downstream processing
API
REST endpoint to query latest extracted records
PostgreSQL
Upsert into your existing schema with conflict resolution
BigQuery
Streamed directly into your dataset with schema auto-detect
Snowflake
Stage + COPY INTO workflow — incremental or full-replace
S3
Direct bucket delivery — compatible with any data lake
// faq

Common questions.

About elightbulbs.com scraping, legality, and pipeline operations.

Ask us directly →
Is scraping elightbulbs.com legal?

Scraping publicly available product specifications, pricing, and stock data is generally permissible. DataFlirt extracts only public, non-authenticated catalogue data. We do not circumvent authentication walls or extract proprietary customer information.

Can you normalise the specification data?

Yes. We map varying field names (e.g., 'Color Temp', 'Kelvin', 'CCT') into a single normalised schema, ensuring consistency across different brands and product categories.

How do you handle bulk pricing tiers?

We extract the entire pricing matrix for each SKU, delivering base price, case quantities, and calculated volume discounts as structured arrays.

Can you extract PDF spec sheets?

Yes. We capture the direct URLs for manufacturer PDF specification sheets, photometric data files, and installation guides.

How fresh is the stock data?

Pipelines can be configured to run daily or hourly. For high-frequency monitoring, we use change detection to only update records where stock status or pricing has shifted.

Do you track equivalent replacements?

Yes. We extract cross-reference data, including ANSI codes, equivalent wattages, and replacement text strings to help you build mapping databases.

$ dataflirt scope --new-project --source=elightbulbs.com ready

Tell us what
to extract.
We do the rest.

20-minute scoping call. Pilot dataset within the week. Production within two. Whether you need a one-off catalogue dump or continuous price monitoring across thousands of SKUs — we scope, build, and operate the pipeline. Tell us what you need.

hello@dataflirt.com · Bengaluru · IST · typical reply < 4h
Related Scrapers

More in lighting

Services

Data Extraction for Every Industry

View All Services →