SYSTEM all green source waclighting.com queue 12,408 pages p99 latency 185ms dataflirt.com · scraper/waclighting-com
RUN · 14 active pipelines · waclighting.com live

WAC Lighting data,
extracted at scale.

We extract architectural lighting specs, IES files, SKU configurations, photometric data, and compliance metrics from WAC Lighting. Delivered as clean JSON, CSV, or Parquet to S3, BigQuery, or Snowflake on your cadence.

Products extracted
14.2K /run
IES files mapped
9.8K /run
Spec sheets parsed
18.5K /24h
Active pipelines
14
Uptime
99.94%
Data Dictionary

Every field we extract from waclighting.com

Structured, schema-consistent data across all major object types — delivered clean, typed, and ready to query.

Complete list of extractable fields for Product Metadata objects from waclighting.com. All fields typed and schema-versioned.

base_skuproduct_namecategorysub_categorycollection_namedescriptionfeatures_listprimary_image_urlproduct_url
product_metadata
● 200 OK
"base_sku": "R3CRPT",
"product_name": "Aether 3.5in Round Trimless",
"category": "Recessed",
"sub_category": "Downlights",
"collection_name": "Aether",
"description": "Trimless downlight designed for seamless architectural integration.",
"product_url": "https://www.waclighting.com/product/aether-3-5in-round-trimless/"
# base_skuproduct_namecategorysub_categorycollection_namedescription
1
2
3

Complete list of extractable fields for Technical Specs objects from waclighting.com. All fields typed and schema-versioned.

skuwattagelumenscricctbeam_angleinput_voltagelifespan_hoursdimming_protocol
technical_specs
● 200 OK
"sku": "R3CRPT-15-927-WT",
"wattage": 15.5,
"lumens": 1250,
"cri": 90,
"cct": "2700K",
"beam_angle": "45 degrees",
"input_voltage": "120-277V",
"dimming_protocol": "ELV, TRIAC, 0-10V"
# skuwattagelumenscricctbeam_angle
1
2
3

Complete list of extractable fields for Downloads & Assets objects from waclighting.com. All fields typed and schema-versioned.

skuies_file_urlspec_sheet_urlinstall_guide_urlbim_object_urlenergy_guide_urlhigh_res_imagesphotometric_report_url
downloads_& assets
● 200 OK
"sku": "R3CRPT-15-927-WT",
"ies_file_url": "https://www.waclighting.com/wp-content/uploads/ies/R3CRPT-15-927.ies",
"spec_sheet_url": "https://www.waclighting.com/wp-content/uploads/specs/R3CRPT.pdf",
"install_guide_url": "https://www.waclighting.com/wp-content/uploads/install/R3CRPT_install.pdf",
"bim_object_url": "https://www.waclighting.com/wp-content/uploads/bim/R3CRPT.rfa",
"high_res_images": "['https://www.waclighting.com/images/R3CRPT_1.jpg', 'https://www.waclighting.com/images/R3CRPT_2.jpg']"
# skuies_file_urlspec_sheet_urlinstall_guide_urlbim_object_urlenergy_guide_url
1
2
3

Complete list of extractable fields for Variants & Configurations objects from waclighting.com. All fields typed and schema-versioned.

base_skuvariant_skufinish_codefinish_namecolor_tempbeam_spreadlist_priceupc_code
variants_& configurations
● 200 OK
"base_sku": "R3CRPT",
"variant_sku": "R3CRPT-15-927-WT",
"finish_code": "WT",
"finish_name": "White",
"color_temp": "2700K",
"beam_spread": "Flood",
"list_price": 245.0,
"upc_code": "790576834192"
# base_skuvariant_skufinish_codefinish_namecolor_tempbeam_spread
1
2
3

Complete list of extractable fields for Accessories & Compatibility objects from waclighting.com. All fields typed and schema-versioned.

skucompatible_trackscompatible_transformerslenseslouversextension_wandsreplacement_partsaccessory_skus
accessories_& compatibility
● 200 OK
"sku": "R3CRPT-15-927-WT",
"compatible_transformers": "['EN-1260-RB2', 'EN-2460-RB2']",
"lenses": "['LENS-11-AMB', 'LENS-11-BLU']",
"louvers": "['LENS-11-HCL']",
"replacement_parts": "['R3CRPT-TRIM-WT']",
"accessory_skus": "['R3CRPT-ACC-1']"
# skucompatible_trackscompatible_transformerslenseslouversextension_wands
1
2
3

Capabilities

Complete architectural lighting data extraction

Our WAC Lighting scraper handles complex product configurators, dynamic SKU generation, and technical document extraction — structuring photometric data for lighting designers and distributors.

Configurator SKU Generation

Automated iteration through drop-downs (CCT, finish, beam angle) to generate and scrape all valid child SKUs from a base product family.

Photometric Data Mapping

Extract lumens, CBCP, CRI, wattage, and efficacy metrics directly from specification tables and map them to the correct variant.

IES & BIM File Extraction

Capture direct download URLs for IES photometric files, Revit BIM objects, and CAD blocks associated with each lighting fixture.

Spec Sheet & Install Guides

Extract links for PDF specification sheets, installation instructions, and energy guides for compliance documentation.

Finish & CCT Normalisation

Standardise colour temperatures (e.g., 2700K, 3000K, Warm Dim) and finish codes (WT, BK, BN) into queryable database columns.

Dimming & Electrical Specs

Capture input voltage (120V, 277V, Universal), dimming protocols (ELV, TRIAC, 0-10V), and compatible transformer SKUs.

Category Hierarchy

Maintain the full breadcrumb trail from top-level categories (Recessed, Track, Outdoor) down to specific product collections.

Continuous Synchronisation

Run scheduled pipelines to detect new product launches, discontinued SKUs, and updated specification sheets automatically.

Accessory Mapping

Link base fixtures to compatible lenses, glare control louvers, extension wands, and mounting hardware.

// engagement pipeline

From product family to warehouse record

Brief in. Clean data out.

Define Scope
d 0

Provide WAC Lighting categories, specific collections, or search terms. We design the extraction schema together.

Pipeline Build
d 2–4

We configure Scrapy / Playwright crawlers to navigate WAC's product configurators and extract technical assets.

Validation & QA
d 4–6

Schema validation, null-rate checks on photometric data, and SKU permutation testing before full launch.

Delivery
ongoing

JSON / CSV / Parquet pushed to your S3 bucket, BigQuery dataset, or Snowflake stage on agreed cadence.

Under the hood

How our WAC Lighting pipeline handles the hard parts

Architectural lighting sites rely on dynamic configurators and embedded assets. Here is how we build reliable pipelines for complex technical catalogues.

pipeline-monitor · waclighting.com · live ● active
// fingerprinting
Identity rotation
TLS fingerprintrandomised
User-agentrotated
IP poolresidential
Challenges blocked0
// pagination
Page coverage
48,291 pages queued running
// observability
Pipeline health
99.9%
uptime
142ms
p99 lat
0.3%
null rate
2
alerts
Dynamic configurators
Exhaustive SKU permutation

WAC Lighting uses dynamic product pages where users select colour temperature, finish, and beam angle to generate a specific SKU. Our Playwright scripts programmatically iterate through all valid combinations, ensuring no variant is missed in the final dataset.

Asset linking
Resolving IES and PDF URLs

Technical assets are often loaded via JavaScript or hidden behind download buttons. We intercept network requests and parse the DOM to extract direct, permanent URLs for IES files, spec sheets, and BIM objects.

Schema stability
Resilient selectors for technical tables

Specification tables change format depending on the product category (e.g., track lighting vs smart fans). We use intelligent table-parsing logic that maps data based on header text rather than brittle CSS row indexes.

Change detection
Only re-scrape what has changed

For large lighting catalogues, we maintain a hash index of last-seen values per field. Subsequent runs only push diffs, reducing compute cost and ensuring downstream systems only process actual specification updates.

Monitoring
Null-rate anomaly detection

If a site update causes the 'lumens' or 'IES file' field to suddenly return null across multiple SKUs, our observability stack triggers an alert and pauses the pipeline before bad data reaches your warehouse.

Applications

Who uses WAC Lighting data

Teams across industries use waclighting.com data to build competitive products and smarter operations.

01
Lighting Design Software

Software providers import IES files, BIM objects, and photometric data to enable accurate lighting simulations for architects.

02
Distributor eCommerce

Lighting distributors sync WAC catalogues to their own storefronts, ensuring accurate SKUs, descriptions, and high-resolution imagery.

03
Estimating & Bidding

Electrical contractors integrate specification data into estimating software to verify compliance and generate accurate material lists.

04
Competitor Analysis

Lighting manufacturers compare their own product specifications (efficacy, CRI, price points) against WAC Lighting's offerings.

05
Energy Compliance Audits

Consultants aggregate wattage, efficacy, and Title 24 compliance data to automate energy code calculations for commercial projects.

06
PIM Synchronisation

Master data management teams keep their internal Product Information Management (PIM) systems aligned with the manufacturer's latest specifications.

Why DataFlirt

"Architectural lighting requires precise photometric data and technical specifications. WAC Lighting provides this, but it requires a dedicated pipeline to query at scale."

Extracting lighting data involves more than text scraping. It requires parsing complex configurators, mapping IES files to specific SKUs, and standardising photometric metrics across thousands of variants. DataFlirt handles this infrastructure so your team can focus on distribution.

Technical Spec

WAC Lighting scraper — technical capabilities

Everything supported by our waclighting.com scraper — rendered SPA elements, auth walls, rate-limit evasion and beyond.

Dynamic SKU generation
Playwright sessions iterate through configurator drop-downs to map all variants
Supported
IES file download links
Direct URLs to photometric data files for lighting design software
Supported
PDF spec sheet parsing
Capture direct links to installation guides and technical specification sheets
Supported
BIM/Revit object links
Extract URLs for 3D architectural models (.rfa files)
Supported
Residential proxy rotation
ISP-grade residential IPs to prevent rate-limiting during deep crawls
Supported
Change detection (diffs)
Hash-based diff: only emit records with changed fields since last run
Supported
Webhook delivery
HTTP POST per record or batch for real-time downstream processing
Supported
Distributor portal pricing
Net pricing and multipliers require authenticated B2B dealer login
Partial
Real-time inventory levels
Live stock counts across warehouses require authenticated portal access
Partial
Infrastructure

Infrastructure powering the WAC Lighting pipeline

Open-source tooling on proven cloud infra — no vendor lock-in, full observability.

ScrapyPlaywrightPython 3.12RedisPostgreSQLApache AirflowAWS LambdaS3CloudWatch2CaptchaCapSolverResidential ProxiesDockerKubernetesGrafanaPrometheus
Scrapy + Playwright Stack

Scrapy handles crawl orchestration and deduplication. Playwright handles JavaScript rendering and interaction flows for product configurators.

Asset Pipeline Infrastructure

We map and validate URLs for thousands of IES files and PDFs, ensuring downstream systems can retrieve technical documents reliably.

Cloud-Native Orchestration

Pipelines run on AWS Lambda (burst) and ECS (sustained). Airflow handles scheduling, dependency management, and SLA alerting.

Output & Delivery

Your data, your destination

Data delivered to where your team already works — no new tooling required.

JSON
Newline-delimited or nested — schema versioned per run
CSV
Flat file with typed columns — Excel/Sheets compatible
XLS
Spreadsheet format for direct business user consumption
Parquet
Columnar format for BigQuery, Snowflake, Athena
AWS S3
Direct bucket delivery — compatible with any data lake
Webhook
HTTP POST per record for real-time downstream processing
API
REST endpoint to query extracted lighting data on demand
BigQuery
Streamed directly into your dataset with schema auto-detect
Snowflake
Stage + COPY INTO workflow — incremental or full-replace
Postgres
Upsert into your existing schema with conflict resolution
S3
Direct bucket delivery — compatible with any data lake
// faq

Common questions.

About waclighting.com scraping, legality, and pipeline operations.

Ask us directly →
Is scraping WAC Lighting legal?

Scraping publicly available information from waclighting.com is generally permissible. DataFlirt targets only public, non-authenticated product specifications, IES files, and pricing data. We do not circumvent authentication walls to access distributor-only portals. Clients should review WAC Lighting's ToS and consult legal counsel for specific use cases.

How do you handle the dynamic product configurators?

We use Playwright browser automation to programmatically select every valid combination of finish, colour temperature, and beam angle. This ensures we capture the unique SKU, specific photometric data, and exact price for every variant.

Can you extract IES files and BIM objects?

Yes. We capture the direct download URLs for all associated technical assets, including IES photometric files, Revit (.rfa) BIM objects, and PDF specification sheets, linking them directly to the corresponding SKU.

How frequently can the catalogue be updated?

For a site of WAC Lighting's size, we typically recommend a weekly or bi-weekly full catalogue refresh. Delta runs (change detection) can be configured to run more frequently to catch new product launches or specification updates.

Do you normalise technical specifications?

Yes. We standardise fields like wattage, lumens, CRI, and CCT into numeric or consistent string formats, stripping out extraneous text so the data is immediately queryable in your database.

What is the pricing model for this pipeline?

Pricing is based on extraction frequency and the complexity of the asset mapping required. We offer fixed monthly retainers for managed pipelines, which include infrastructure costs, proxy rotation, and ongoing schema maintenance.

Can I request a sample dataset?

Yes. We provide a sample run of up to 500 SKUs across different product categories (e.g., Track, Recessed, Outdoor) so you can validate the schema, photometric data accuracy, and asset links before committing.

$ dataflirt scope --new-project --source=waclighting.com ready

Tell us what
to extract.
We do the rest.

20-minute scoping call. Pilot dataset within the week. Production within two. Whether you need a one-off catalogue extraction or a continuous sync for your distribution platform — we scope, build, and operate the pipeline. Tell us what you need.

hello@dataflirt.com · Bengaluru · IST · typical reply < 4h
Related Scrapers

More in lighting

Services

Data Extraction for Every Industry

View All Services →