SYSTEM all green source signify.com queue 18,492 pages p99 latency 215ms dataflirt.com · scraper/signify-com
RUN * 31 active pipelines * signify.com live

Signify data,
normalised for engineering.

We extract technical lighting specifications, photometric data, Philips Hue catalogues, and B2B project portfolios from Signify. Delivered as clean JSON, CSV, or Parquet to S3, BigQuery, or Snowflake.

Products extracted
142K /run
Spec sheets parsed
89K /week
Distributor records
12.4K /run
Active pipelines
31
Uptime
99.98%
Data Dictionary

Every field we extract from signify.com

Structured, schema-consistent data across all major object types — delivered clean, typed, and ready to query.

Complete list of extractable fields for Consumer Lighting objects from signify.com. All fields typed and schema-versioned.

product_idbrandproduct_namecategorypricecurrencyavailabilitywattagelumen_outputcolour_temperaturesmart_home_compatibilityean_code
consumer_lighting
● 200 OK
"product_id": "929002216601",
"brand": "Philips Hue",
"product_name": "White and colour ambiance Play light bar",
"category": "Smart lighting",
"wattage": "6.6W",
"lumen_output": "530",
"colour_temperature": "2000-6500K",
"ean_code": "8718699706131"
# product_idbrandproduct_namecategorypricecurrency
1
2
3

Complete list of extractable fields for Professional Luminaires objects from signify.com. All fields typed and schema-versioned.

skufamily_nameapplication_arealight_source_colordriver_includedoptic_typeluminaire_light_beam_spreadcontrol_interfaceprotection_classce_markwarranty_periodinput_voltage
professional_luminaires
● 200 OK
"sku": "910505101234",
"family_name": "CoreLine Panel",
"application_area": "Office",
"light_source_color": "840 neutral white",
"driver_included": true,
"ce_mark": true,
"warranty_period": "5 years",
"input_voltage": "220-240V"
# skufamily_nameapplication_arealight_source_colordriver_includedoptic_type
1
2
3

Complete list of extractable fields for Technical Specs objects from signify.com. All fields typed and schema-versioned.

product_codeinitial_luminous_fluxluminous_flux_toleranceinitial_led_luminaire_efficacyinitial_chromaticitymedian_useful_life_l70b50median_useful_life_l80b50median_useful_life_l90b50ambient_temperature_rangedimmablehousing_materialoverall_length
technical_specs
● 200 OK
"product_code": "8718696073408",
"initial_luminous_flux": "3400 lm",
"luminous_flux_tolerance": "+/-10%",
"initial_led_luminaire_efficacy": "100 lm/W",
"median_useful_life_l70b50": "50000 h",
"ambient_temperature_range": "-10 to +40 °C",
"dimmable": false,
"housing_material": "Steel"
# product_codeinitial_luminous_fluxluminous_flux_toleranceinitial_led_luminaire_efficacyinitial_chromaticitymedian_useful_life_l70b50
1
2
3

Complete list of extractable fields for Distributor Network objects from signify.com. All fields typed and schema-versioned.

partner_idcompany_namepartner_typeaddress_line_1citypostal_codecountrylatitudelongitudephone_numberwebsitecertifications
distributor_network
● 200 OK
"partner_id": "PTN-8472",
"company_name": "Luminaires Direct",
"partner_type": "Certified System Integrator",
"city": "London",
"country": "UK",
"latitude": 51.5074,
"longitude": -0.1278,
"certifications": "['Interact Pro']"
# partner_idcompany_namepartner_typeaddress_line_1citypostal_code
1
2
3

Complete list of extractable fields for Project Portfolios objects from signify.com. All fields typed and schema-versioned.

project_idtitleclient_nameindustrylocationcompletion_yearproducts_usedenergy_savings_pctchallenge_descriptionsolution_descriptionresults_descriptionimage_urls
project_portfolios
● 200 OK
"project_id": "PRJ-9921",
"title": "Smart City Lighting Upgrade",
"industry": "Public Spaces",
"location": "Amsterdam",
"completion_year": "2024",
"products_used": "['CityTouch', 'Luma']",
"energy_savings_pct": 65,
"image_urls": "['https://signify.com/assets/prj9921-1.jpg']"
# project_idtitleclient_nameindustrylocationcompletion_year
1
2
3

Capabilities

Complete lighting catalogue extraction

Our Signify pipeline handles the entire catalogue: consumer Philips Hue products, professional Interact systems, and dense technical specification tables.

Full Catalogue Coverage

Extract data across Philips, Interact, Color Kinetics, and all other Signify sub-brands from a single pipeline.

Deep Technical Specs

Capture lumen output, wattage, chromaticity, beam spread, and housing materials structured into queryable fields.

Regional Variations

Normalise product catalogues across different country locales, capturing regional SKUs and EAN codes.

B2B & Professional Data

Extract professional luminaire specifications, driver compatibility, and DALI control interface details.

Distributor Mapping

Scrape partner locators to build a global database of certified system integrators and distributors.

Energy Ratings

Track energy efficiency classes, median useful life metrics, and power consumption data for compliance reporting.

Product Family Grouping

Map individual SKUs back to their parent product families and system architectures.

Smart Home Specs

Extract IoT compatibility details for Philips Hue and WiZ products, including Zigbee and Matter support.

Delta Exports

Receive only updated products and modified specifications on subsequent runs to reduce processing overhead.

// engagement pipeline

From product family to warehouse record

Brief in. Clean data out.

Define Scope
d 0

Provide target regions, product categories, or specific brand silos. We design the extraction schema together.

Pipeline Build
d 2–4

We configure Scrapy / Playwright crawlers, handle regional redirects, and map the complex specification tables.

Validation & QA
d 4–6

Schema validation, null-rate checks, and unit normalisation (e.g., standardising lumen formats) before full launch.

Delivery
ongoing

JSON / CSV / Parquet pushed to your S3 bucket, BigQuery dataset, or Snowflake stage on agreed cadence.

Under the hood

How our Signify pipeline handles the hard parts

Signify's web properties use complex configurators and heavily nested specification tables. Here is how we extract clean data.

pipeline-monitor · signify.com · live ● active
// fingerprinting
Identity rotation
TLS fingerprintrandomised
User-agentrotated
IP poolresidential
Challenges blocked0
// pagination
Page coverage
48,291 pages queued running
// observability
Pipeline health
99.9%
uptime
142ms
p99 lat
0.3%
null rate
2
alerts
Dynamic configurators
Playwright for product variants

Professional lighting products often use JavaScript-based configurators to select optics, drivers, and mounting options. We use Playwright to iterate through these combinations and extract the underlying SKU for every valid configuration.

Table normalisation
Flattening nested specifications

Technical data is presented in deeply nested HTML tables that vary by product category. Our extraction logic normalises these tables into a consistent key-value structure, regardless of the underlying DOM hierarchy.

Locale redirection
Strict session management

Signify aggressively redirects traffic based on IP geolocation. We use region-specific residential proxies and strict cookie management to ensure we extract the correct localised catalogue without being bounced to a global splash page.

Infinite scrolling
API interception for project data

Case studies and distributor maps rely on infinite scrolling and dynamic map bounding boxes. We intercept the underlying XHR requests to extract the raw JSON payloads directly, ensuring 100% coverage without UI rendering issues.

Change detection
Only re-scrape what changes

For large product catalogues, we maintain a hash index of last-seen values per field. Subsequent runs only push diffs, reducing compute cost and downstream processing load.

Applications

Who uses Signify data

Teams across industries use signify.com data to build competitive products and smarter operations.

01
Competitor Benchmarking

Lighting manufacturers track Signify's product specifications, efficacy metrics, and warranty terms to benchmark their own portfolios.

02
Energy Compliance Tracking

Sustainability consultants extract lumen-per-watt ratios and energy classes to build compliance databases for large-scale retrofits.

03
Distributor Mapping

B2B sales teams scrape partner locators to identify certified system integrators and expand their own distribution networks.

04
Smart Home Integration Data

IoT platforms extract protocol compatibility (Zigbee, Matter) from the Philips Hue catalogue to maintain integration databases.

05
Procurement & Bidding

Construction firms aggregate technical specifications across product families to automate bill-of-materials generation for tenders.

06
Market Research

Analysts track the shift from conventional lighting to LED and IoT systems by monitoring catalogue composition over time.

Why DataFlirt

"Signify holds the most comprehensive technical lighting dataset globally, but extracting photometric data and regional SKUs requires dedicated infrastructure."

Extracting data from Signify involves navigating complex product configurators, regional catalogue variations, and deeply nested technical specification tables. DataFlirt manages this complexity so your engineering team receives clean, normalised data ready for immediate querying.

Technical Spec

Signify scraper technical capabilities

Everything supported by our signify.com scraper — rendered SPA elements, auth walls, rate-limit evasion and beyond.

JavaScript rendering
Full Playwright sessions required for product configurators and dynamic tables
Supported
Regional catalogues
Extraction across all country-specific subdomains via localised proxies
Supported
Specification flattening
Nested HTML tables converted into flat, queryable JSON objects
Supported
XHR interception
Direct API extraction for distributor maps and project galleries
Supported
SKU variant mapping
Parent product families mapped to individual configurable SKUs
Supported
Change detection (diffs)
Hash-based diff: only emit records with changed fields since last run
Supported
Partner Portal Pricing
Wholesale pricing requires authenticated distributor login credentials
Partial
MySignify Account Data
Gated project management and warranty registration data
Partial
Infrastructure

Infrastructure powering the Signify pipeline

Open-source tooling on proven cloud infra — no vendor lock-in, full observability.

ScrapyPlaywrightPython 3.12RedisPostgreSQLApache AirflowAWS LambdaS3CloudWatch2CaptchaCapSolverResidential ProxiesDockerKubernetesGrafanaPrometheus
Scrapy + Playwright Stack

Scrapy handles crawl orchestration and deduplication. Playwright handles JavaScript rendering for product configurators. Combined via scrapy-playwright middleware.

Residential Proxy Infrastructure

We maintain pools of residential ISP proxies across global regions to bypass aggressive locale-based redirection and access specific country catalogues.

Cloud-Native Orchestration

Pipelines run on AWS Lambda and ECS. Airflow handles scheduling, dependency management, and SLA alerting. All state stored in managed Postgres.

Output & Delivery

Your data, your destination

Data delivered to where your team already works — no new tooling required.

JSON
Newline-delimited or nested objects
CSV
Flat file with typed columns
XLS
Excel format for procurement teams
Parquet
Columnar format for data warehouses
AWS S3
Direct bucket delivery
Webhook
HTTP POST per record
API
REST endpoint for on-demand querying
BigQuery
Streamed directly into your dataset
Snowflake
Stage and COPY INTO workflow
S3
Direct bucket delivery — compatible with any data lake
// faq

Common questions.

About signify.com scraping, legality, and pipeline operations.

Ask us directly →
Is scraping Signify legal?

Scraping publicly available product catalogues, technical specifications, and distributor lists is generally permissible. DataFlirt targets only public, non-authenticated data. We do not extract personal data or circumvent the MySignify authentication walls.

How do you handle region-specific catalogues?

We use region-specific residential proxies and strict session management to ensure we extract the exact catalogue for your target market, preventing Signify's servers from redirecting the crawler to a default global page.

Can you extract data from the product configurators?

Yes. Professional luminaires often require selecting options (driver, optic, mounting) before a specific SKU is generated. We use Playwright to iterate through these combinations and capture the resulting technical data.

How do you structure the technical specifications?

Signify uses varied table structures depending on the product family. We build custom normalisation logic that maps these disparate tables into a consistent, flat JSON schema, standardising keys like 'Lumen output' and 'Wattage'.

How frequently can the pipeline run?

For lighting catalogues, weekly or monthly cadences are typical. If you require faster updates for specific product lines, we can configure daily delta runs.

Can I request a sample dataset?

Yes. We provide a sample run of a specific product family or category as part of the pre-engagement scoping process so you can validate the schema and normalisation logic.

$ dataflirt scope --new-project --source=signify.com ready

Tell us what
to extract.
We do the rest.

20-minute scoping call. Pilot dataset within the week. Production within two. Whether you need a complete global catalogue extraction or targeted technical specification tracking, we scope, build, and operate the pipeline. Tell us what you need.

hello@dataflirt.com · Bengaluru · IST · typical reply < 4h
Related Scrapers

More in lighting

Services

Data Extraction for Every Industry

View All Services →