We extract product specifications, variant matrices, designer attributions, and stock status from Circalighting. Delivered as clean JSON, CSV, or Parquet to S3, BigQuery, or Snowflake.
Structured, schema-consistent data across all major object types — delivered clean, typed, and ready to query.
Complete list of extractable fields for Product Metadata objects from circalighting.com. All fields typed and schema-versioned.
"sku": "TOB5002", "product_name": "Bryant Sconce", "designer_name": "Thomas O'Brien", "category": "Wall Lighting", "base_price": 429.0, "currency": "USD", "overall_height": "14.25 in", "fixture_width": "5.5 in"
| # | sku | product_name | designer_name | category | sub_category | base_price |
|---|---|---|---|---|---|---|
| 1 | ||||||
| 2 | ||||||
| 3 |
Complete list of extractable fields for Technical Specifications objects from circalighting.com. All fields typed and schema-versioned.
"sku": "TOB5002", "socket_type": "E26 Keyless", "wattage": "60 A", "bulb_type": "Standard Incandescent", "ul_rating": "Dry", "weight_lbs": 3.5, "dimmable": true, "voltage": "120V"
| # | sku | socket_type | wattage | bulb_type | bulb_included | ul_rating |
|---|---|---|---|---|---|---|
| 1 | ||||||
| 2 | ||||||
| 3 |
Complete list of extractable fields for Finishes & Variations objects from circalighting.com. All fields typed and schema-versioned.
"parent_sku": "TOB5002", "variant_sku": "TOB5002AN-NP", "finish_name": "Antique Nickel", "shade_material": "Natural Paper", "price": 429.0, "in_stock": true, "lead_time_weeks": 2
| # | parent_sku | variant_sku | finish_name | finish_family | shade_material | shade_colour |
|---|---|---|---|---|---|---|
| 1 | ||||||
| 2 | ||||||
| 3 |
Complete list of extractable fields for Assets & Documentation objects from circalighting.com. All fields typed and schema-versioned.
"sku": "TOB5002", "primary_image_url": "https://cdn.circalighting.com/images/TOB5002.jpg", "tear_sheet_pdf_url": "https://cdn.circalighting.com/docs/TOB5002_spec.pdf", "assembly_instructions_pdf_url": "https://cdn.circalighting.com/docs/TOB5002_install.pdf", "gallery_urls": "['https://cdn.circalighting.com/images/TOB5002_alt1.jpg', 'https://cdn.circalighting.com/images/TOB5002_alt2.jpg']", "cad_file_url": "None"
| # | sku | primary_image_url | gallery_urls | tear_sheet_pdf_url | assembly_instructions_pdf_url | cad_file_url |
|---|---|---|---|---|---|---|
| 1 | ||||||
| 2 | ||||||
| 3 |
Complete list of extractable fields for Inventory & Shipping objects from circalighting.com. All fields typed and schema-versioned.
"sku": "TOB5002AN-NP", "stock_status": "In Stock", "estimated_ship_date": "2026-05-14", "quick_ship_eligible": true, "shipping_tier": "Standard Ground", "return_eligible": true, "freight_required": false
| # | sku | stock_status | estimated_ship_date | quick_ship_eligible | shipping_tier | box_dimensions |
|---|---|---|---|---|---|---|
| 1 | ||||||
| 2 | ||||||
| 3 |
Our Circalighting pipeline captures complex variant matrices, technical specifications, and designer attributions. We handle the frontend rendering requirements so you receive normalised tabular data.
Extract accurate designer names (e.g., Kelly Wearstler, Thomas O'Brien) and associate them with respective collections and SKUs.
Map parent SKUs to all child variations, capturing specific finish names, shade materials, and associated price deltas.
Parse unstructured dimension strings into structured fields for overall height, canopy width, and fixture depth.
Capture critical technical data including socket types, maximum wattage, UL/IP ratings, and dimming compatibility.
Monitor inventory status, estimated ship dates, and backorder timelines across the entire product catalogue.
Collect URLs for PDF tear sheets, assembly instructions, and CAD files associated with each fixture.
Extract primary product photography and variant-specific imagery, mapped directly to the corresponding child SKU.
Track base retail pricing and variant-specific pricing adjustments. Timestamped per run for historical tracking.
Run continuous pipelines at daily or weekly cadences. We emit diffs to highlight new products, discontinued items, and price changes.
Brief in. Clean data out.
Provide categories, designer names, or full catalogue requirements. We design the extraction schema together.
We configure Scrapy / Playwright crawlers, handle proxy rotation, and map the complex variant DOM structures.
Schema validation, null-rate checks on technical fields, and variant mapping verification before full launch.
JSON / CSV / Parquet pushed to your S3 bucket, BigQuery dataset, or Snowflake stage on agreed cadence.
Lighting catalogues feature deeply nested variants and technical data. Here is how our infrastructure processes the Circalighting DOM.
Lighting fixtures often have multiple axes of variation (metal finish, shade material, size). We traverse the JavaScript-rendered variant selectors to generate a flattened, queryable table where every specific combination has its own row and price.
Tear sheets and assembly PDFs are frequently hosted on external CDNs or loaded dynamically. We capture the absolute URLs for all technical documentation and associate them directly with the parent SKU.
Dimensions and electrical specs are often presented in single HTML blocks. We use regex and structured parsing to split these into distinct database columns (e.g., separating '14.25 in' into numerical value and unit).
Inventory and lead times are loaded via API calls after the initial page request. We use Playwright to wait for network idle states, ensuring we capture the actual stock status rather than placeholder text.
We maintain a hash index of the catalogue. When Circalighting discontinues a finish or updates a price, our pipeline emits only the changed records, keeping your downstream database synchronised without full re-ingestion.
Aggregators and design software platforms ingest technical specs and 3D assets to populate their internal rendering libraries.
Lighting manufacturers track retail pricing across designer collections to benchmark their own premium product lines.
Architectural firms monitor stock availability and lead times to ensure specified fixtures will meet project deadlines.
Retailers and distributors map Circalighting SKUs against their own databases to fill gaps in technical specifications and imagery.
Analysts track the introduction and discontinuation of specific finishes (e.g., unlacquered brass vs polished nickel) to forecast hardware trends.
Firms monitor changes in estimated ship dates across categories to gauge manufacturing backlogs and supply chain health.
"Designer lighting data is highly dimensional. Capturing the finish matrix and technical specifications accurately requires a pipeline built for structural complexity."
Extracting data from high-end catalogue sites requires more than simple HTTP GET requests. Variant pricing, dynamic inventory, and nested technical specifications demand full browser rendering and careful schema normalisation. DataFlirt handles the extraction and structuring, delivering clean data directly to your warehouse.
Everything supported by our circalighting.com scraper — rendered SPA elements, auth walls, rate-limit evasion and beyond.
Open-source tooling on proven cloud infra — no vendor lock-in, full observability.
Scrapy manages category traversal and deduplication. Playwright handles the execution of variant selection scripts to expose correct pricing and SKUs.
We route requests through US residential proxy pools to maintain high success rates and avoid IP bans during full catalogue sweeps.
Pipelines run on AWS ECS. Apache Airflow schedules daily or weekly diff runs, ensuring your warehouse always has the latest stock data.
Data delivered to where your team already works — no new tooling required.
About circalighting.com scraping, legality, and pipeline operations.
Ask us directly →Yes. Our pipeline traverses the entire category tree and designer index, ensuring comprehensive coverage of all active collections on the site.
We use Playwright to iterate through the variant selection UI, capturing the specific SKU, price, and image associated with each unique combination of finish and shade material.
By default, we extract and deliver the absolute URLs for all PDF assets (tear sheets, assembly instructions). If you require the physical files, we can configure an S3 sync job for an additional compute cost.
No. We extract publicly available retail pricing. Trade pricing requires authenticated access via a designer account, which falls outside our public-data extraction policy.
For targeted SKU lists (e.g., 1,000 specific fixtures), we can run hourly pipelines. For the entire catalogue, we recommend daily or weekly runs to balance compute costs with data freshness.
Our managed service includes schema maintenance. If Circalighting (or Visual Comfort) updates their DOM structure, our alerting stack detects the null-rate spike, and our engineers update the selectors to restore the pipeline.
20-minute scoping call. Pilot dataset within the week. Production within two. Whether you need a one-time export of technical specifications or a continuous feed of stock availability, we build and manage the pipeline. Tell us your requirements.
