SYSTEM all green source bega.com queue 1,842 pages p99 latency 218ms dataflirt.com · scraper/bega-com
RUN - 14 active pipelines - bega.com live

Bega technical data,
at warehouse scale.

We extract luminaire specifications, photometric data, BIM objects, and LED performance metrics from Bega. Delivered as clean JSON, CSV, or Parquet to S3, BigQuery, or Snowflake on your cadence.

Luminaires extracted
14.2K /run
Photometric files
38.5K /run
CAD/BIM models
22.1K /run
Active pipelines
14
Uptime
99.98%
Data Dictionary

Every field we extract from bega.com

Structured, schema-consistent data across all major object types — delivered clean, typed, and ready to query.

Complete list of extractable fields for Luminaire Specifications objects from bega.com. All fields typed and schema-versioned.

article_numberproduct_familyapplication_areaprotection_classip_ratingik_ratingmaterialcolourdimensionsweight
luminaire_specifications
● 200 OK
"article_number": "24301K3",
"product_family": "Wall luminaires",
"application_area": "Exterior",
"protection_class": "I",
"ip_rating": "IP 64",
"ik_rating": "IK 06",
"material": "Cast aluminium",
"colour": "Graphite",
"weight": "1.8 kg"
# article_numberproduct_familyapplication_areaprotection_classip_ratingik_rating
1
2
3

Complete list of extractable fields for LED Performance objects from bega.com. All fields typed and schema-versioned.

article_numberled_modulecolour_temperaturecrimodule_luminous_fluxluminaire_luminous_fluxluminaire_efficiencyconnected_wattageambient_temperatureservice_life
led_performance
● 200 OK
"article_number": "24301K3",
"led_module": "LED-0800/830",
"colour_temperature": "3000 K",
"cri": "> 80",
"module_luminous_flux": "1200 lm",
"luminaire_luminous_flux": "850 lm",
"luminaire_efficiency": "85 lm/W",
"connected_wattage": "10 W"
# article_numberled_modulecolour_temperaturecrimodule_luminous_fluxluminaire_luminous_flux
1
2
3

Complete list of extractable fields for Photometric & CAD Downloads objects from bega.com. All fields typed and schema-versioned.

article_numberies_urlldt_urlrfa_urldwg_urlpdf_spec_urlinstallation_manual_urlzip_archive_url
photometric_& cad downloads
● 200 OK
"article_number": "24301K3",
"ies_url": "https://www.bega.com/download/ies/24301K3.ies",
"ldt_url": "https://www.bega.com/download/ldt/24301K3.ldt",
"rfa_url": "https://www.bega.com/download/bim/24301K3.rfa",
"dwg_url": "https://www.bega.com/download/cad/24301K3.dwg",
"pdf_spec_url": "https://www.bega.com/download/pdf/24301K3_en.pdf",
"installation_manual_url": "https://www.bega.com/download/manual/24301K3_inst.pdf"
# article_numberies_urlldt_urlrfa_urldwg_urlpdf_spec_url
1
2
3

Complete list of extractable fields for Optical & Light Distribution objects from bega.com. All fields typed and schema-versioned.

article_numberlight_distributionhalf_beam_anglebug_ratingupward_light_ratioglare_evaluationlighting_technologyoptic_material
optical_& light distribution
● 200 OK
"article_number": "24301K3",
"light_distribution": "Asymmetrical",
"half_beam_angle": "45 degrees",
"bug_rating": "B1-U0-G0",
"upward_light_ratio": "0.0 %",
"glare_evaluation": "UGR < 19",
"optic_material": "Safety glass"
# article_numberlight_distributionhalf_beam_anglebug_ratingupward_light_ratioglare_evaluation
1
2
3

Complete list of extractable fields for Accessories & Spare Parts objects from bega.com. All fields typed and schema-versioned.

article_numberaccessory_typeaccessory_article_numberaccessory_descriptionspare_part_numberspare_part_nameled_replacement_modulepower_supply_unit
accessories_& spare parts
● 200 OK
"article_number": "24301K3",
"accessory_article_number": "70 714",
"accessory_description": "Earth spike",
"spare_part_number": "DEV-0270/350",
"spare_part_name": "LED power supply unit",
"led_replacement_module": "LED-0800/830",
"power_supply_unit": "On/Off"
# article_numberaccessory_typeaccessory_article_numberaccessory_descriptionspare_part_numberspare_part_name
1
2
3

Capabilities

Extract technical lighting data with precision

Our Bega scraper parses deep technical tables, extracts LED performance metrics, maps spare parts, and orchestrates the download of photometric and CAD files directly to your storage.

Full Catalogue Extraction

Extract every luminaire, accessory, and spare part across interior, exterior, and urban lighting categories.

Technical Spec Parsing

Parse IP ratings, IK ratings, protection classes, dimensions, weights, and material compositions into structured fields.

LED Metrics

Capture connected wattage, luminous flux, luminaire efficiency, colour temperature (CCT), and CRI for all variants.

File Asset Archiving

Automated downloading and renaming of IES, LDT, BIM (Revit), and CAD files, pushed directly to your S3 bucket.

Spare Parts Mapping

Extract parent-child relationships between luminaires and their compatible replacement LED modules and power supplies.

Optical Distribution Data

Capture beam angles, BUG ratings, upward light ratios, and glare evaluation metrics for precise lighting design inputs.

Multi-Language Support

Extract localised specifications and data sheets from EN, DE, FR, and other regional Bega catalogues.

Change Detection

Monitor new product launches, discontinued items, and technical specification updates with hash-based diffing.

PDF Parsing

Extract legacy tabular data and installation diagrams directly from Bega specification PDFs when HTML data is incomplete.

// engagement pipeline

From product family to warehouse record

Brief in. Clean data out.

Define Scope
d 0

Provide product families, application areas, or specific article numbers. We design the extraction schema together.

Pipeline Build
d 2–4

We configure crawlers, file download orchestrators, and technical table parsers tailored to Bega's DOM structure.

Validation & QA
d 4–6

Schema validation, unit normalisation, file integrity checks, and null-rate monitoring before full launch.

Delivery
ongoing

JSON / CSV / Parquet pushed to your S3 bucket, BigQuery dataset, or Snowflake stage on agreed cadence.

Under the hood

How our Bega pipeline handles technical complexity

Extracting architectural lighting data requires parsing complex nested tables and orchestrating thousands of file downloads. Here is how we manage it.

pipeline-monitor · bega.com · live ● active
// fingerprinting
Identity rotation
TLS fingerprintrandomised
User-agentrotated
IP poolresidential
Challenges blocked0
// pagination
Page coverage
48,291 pages queued running
// observability
Pipeline health
99.9%
uptime
142ms
p99 lat
0.3%
null rate
2
alerts
Asset orchestration
Automated IES and BIM file downloads

Bega hosts thousands of photometric and CAD files. Our pipeline intercepts download links, streams files directly to your S3 bucket, and maps the S3 URIs back to the structured JSON record for each luminaire.

Technical taxonomy
Parsing complex nested specifications

Lighting specifications are deeply nested. We flatten multi-level HTML tables containing LED module variants, colour temperatures, and control gear options into a clean, relational schema.

PDF extraction
Pulling data from legacy spec sheets

For older luminaires where Bega only provides PDF specification sheets, we deploy PDFPlumber to extract tabular technical data and normalise it to match the HTML-extracted schema.

Change detection
Monitoring specification updates

Lighting technologies evolve rapidly. We maintain a hash index of last-seen values for LED efficiency and luminous flux. Subsequent runs only push diffs, ensuring your database reflects the latest generation of LED modules.

Multi-region handling
Normalising voltage and certification data

Bega offers different specifications for the US (120/277V, UL listed) versus European (230V, CE) markets. We scrape region-specific sites and normalise the output into a unified global schema.

Applications

Who uses Bega technical data - and how

Teams across industries use bega.com data to build competitive products and smarter operations.

01
Lighting Design Software Integration

Software providers ingest Bega's photometric files (IES/LDT) and metadata to populate proprietary lighting design and simulation tools.

02
Competitor Benchmarking

Lighting manufacturers compare their product efficacy (lm/W), IP ratings, and pricing tiers against Bega's industry-standard catalogue.

03
BIM Database Enrichment

Architecture and engineering firms automatically sync Bega's Revit (RFA) families and CAD models into their internal BIM libraries.

04
Distributor Catalogue Sync

Wholesale distributors automate the ingestion of Bega product data, images, and technical sheets into their own eCommerce platforms.

05
Replacement Part Sourcing

Facilities management companies map legacy Bega luminaires to current LED replacement modules and power supply units for maintenance planning.

06
Market Analysis

Analysts track shifts in standard colour temperatures, CRI improvements, and efficiency trends across premium architectural lighting.

Why DataFlirt

"Bega's catalogue is the gold standard for architectural lighting, but extracting structured photometric and BIM data requires a purpose-built pipeline."

Most teams struggle with Bega's complex file assets and nested technical tables. DataFlirt handles the heavy lifting: parsing LED metrics, downloading IES files, mapping spare parts, and normalising output into clean relational formats so your engineers can focus on product integration.

Technical Spec

Bega scraper - technical capabilities

Everything supported by our bega.com scraper — rendered SPA elements, auth walls, rate-limit evasion and beyond.

JavaScript rendering
Playwright sessions for dynamic product configurators and variant selection
Supported
Photometric file downloads
Automated download and S3 sync of IES and LDT files
Supported
CAD/BIM archive extraction
Automated download of Revit (RFA) and AutoCAD (DWG) files
Supported
PDF spec sheet parsing
Extraction of tabular data from legacy PDF specification sheets
Supported
LED performance time-series
Track changes in luminaire efficiency and luminous flux over time
Supported
Multi-language extraction
Support for EN, DE, FR, and other regional Bega sites
Supported
Spare part mapping
Parent-child relationships for control gear and LED modules
Supported
Change detection (diffs)
Hash-based diff: only emit records with changed technical specs
Supported
Dealer portal pricing
Gated B2B wholesale pricing requires authenticated dealer credentials
Partial
Partner extranet inventory
Live stock levels and lead times behind the partner login wall
Partial
Infrastructure

Infrastructure powering the Bega pipeline

Open-source tooling on proven cloud infra — no vendor lock-in, full observability.

ScrapyPlaywrightPython 3.12RedisPostgreSQLApache AirflowAWS LambdaS3CloudWatch2CaptchaCapSolverResidential ProxiesDockerKubernetesGrafanaPrometheusPDFPlumberBeautifulSoup
Scrapy + Playwright Stack

Scrapy handles crawl orchestration and deduplication. Playwright handles JavaScript rendering for dynamic product variant tables and file download triggers.

Automated Asset Pipeline

Dedicated workers intercept photometric and CAD file downloads, stream them to AWS S3, and map the object URIs back to the structured database record.

Cloud-Native Orchestration

Pipelines run on AWS ECS. Airflow handles scheduling, dependency management, and SLA alerting. All state stored in managed Postgres.

Output & Delivery

Your data, your destination

Data delivered to where your team already works — no new tooling required.

JSON
Newline-delimited or nested - schema versioned per run
CSV
Flat file with typed columns - Excel/Sheets compatible
XLS
Formatted Excel exports for procurement teams
Parquet
Columnar format for BigQuery, Snowflake, Athena
AWS S3
Direct bucket delivery for data and downloaded IES/BIM files
Webhook
HTTP POST per record for real-time downstream processing
API
REST endpoint to query specific article numbers
Snowflake
Stage + COPY INTO workflow - incremental or full-replace
S3
Direct bucket delivery — compatible with any data lake
// faq

Common questions.

About bega.com scraping, legality, and pipeline operations.

Ask us directly →
Is scraping Bega legal?

Scraping publicly available technical specifications and product data from Bega is generally permissible under applicable law. DataFlirt targets only public, non-authenticated luminaire data and photometric files. We do not extract personal data or circumvent authentication walls.

Can you download photometric (IES/LDT) files?

Yes. Our pipeline automatically triggers the download of IES and LDT files for each luminaire variant, streams them to your S3 bucket, and includes the URI in the structured data payload.

How do you handle product variants and LED modules?

We extract data at the variant level. A single luminaire family may have dozens of variants based on colour temperature, control gear, and beam angle. Each variant is extracted as a discrete record with its specific technical values.

Do you extract data from Bega PDF spec sheets?

Yes. For older products where HTML tables are incomplete, we use PDF parsing libraries to extract tabular data directly from the official PDF specification sheets.

How often is the catalogue updated?

We can schedule pipelines to run weekly or monthly to capture new product launches, discontinued items, and updates to LED efficiency metrics.

Can I get data in DIALux/Relux compatible formats?

We provide the raw IES/LDT files and structured metadata required to populate lighting design software databases. You can map our JSON/CSV output directly into your proprietary ingest formats.

What is the minimum viable engagement?

Our smallest packages start at a defined list of product families with monthly delivery. For full-catalogue extraction including all asset downloads, we price based on compute volume and storage requirements.

$ dataflirt scope --new-project --source=bega.com ready

Tell us what
to extract.
We do the rest.

20-minute scoping call. Pilot dataset within the week. Production within two. Whether you need a one-off technical export or continuous monitoring of Bega's luminaire catalogue, we scope, build, and operate the pipeline. Tell us what you need.

hello@dataflirt.com · Bengaluru · IST · typical reply < 4h
Related Scrapers

More in lighting

Services

Data Extraction for Every Industry

View All Services →