SYSTEM all green source harting.com queue 12,941 pages p99 latency 314ms dataflirt.com · scraper/harting-com
RUN · 14 active pipelines · harting.com live

Harting component data,
at engineering scale.

We extract deep technical specifications, mating configurations, part numbers, and compliance data from the Harting eCatalogue. Delivered as clean JSON, CSV, or Parquet to S3 or PostgreSQL on your cadence.

Parts extracted
184K /run
Tech specs
2.1M /day
Mating pairs
45K /run
Active pipelines
14
Uptime
99.98%
Data Dictionary

Every field we extract from harting.com

Structured, schema-consistent data across all major object types — delivered clean, typed, and ready to query.

Complete list of extractable fields for Product Core objects from harting.com. All fields typed and schema-versioned.

part_numberseriesdescriptioncategorysub_categoryimage_urldatasheet_urlcad_urlstatus
product_core
● 200 OK
"part_number": "09330162601",
"series": "Han E",
"description": "Han 16E-M-c",
"category": "Industrial Connectors",
"sub_category": "Inserts",
"status": "Active",
"image_url": "https://b2b.harting.com/files/images/09330162601.jpg"
# part_numberseriesdescriptioncategorysub_categoryimage_url
1
2
3

Complete list of extractable fields for Technical Specs objects from harting.com. All fields typed and schema-versioned.

part_numbergendertermination_methodwire_gauge_awgrated_currentrated_voltageip_ratingoperating_tempcontact_material
technical_specs
● 200 OK
"part_number": "09330162601",
"gender": "Male",
"termination_method": "Crimp termination",
"wire_gauge_awg": "20-12",
"rated_current": "16 A",
"rated_voltage": "500 V",
"ip_rating": "IP65",
"operating_temp": "-40 ... +125 °C"
# part_numbergendertermination_methodwire_gauge_awgrated_currentrated_voltage
1
2
3

Complete list of extractable fields for Mating & Accessories objects from harting.com. All fields typed and schema-versioned.

part_numbermating_part_numbermating_typeaccessory_partaccessory_typecrimp_tool_reqhood_housing_compinsert_comp
mating_& accessories
● 200 OK
"part_number": "09330162601",
"mating_part_number": "09330162701",
"mating_type": "Female insert",
"crimp_tool_req": "09990000110",
"hood_housing_comp": "Size 16 B",
"insert_comp": "Han E"
# part_numbermating_part_numbermating_typeaccessory_partaccessory_typecrimp_tool_req
1
2
3

Complete list of extractable fields for Compliance objects from harting.com. All fields typed and schema-versioned.

part_numberrohs_statusreach_statusul_certificationcsa_certificationflammability_classhousing_materialweight_g
compliance
● 200 OK
"part_number": "09330162601",
"rohs_status": "Compliant",
"reach_status": "Substance of Very High Concern (SVHC) free",
"ul_certification": "E318390",
"flammability_class": "UL 94 V-0",
"weight_g": 62.5,
"housing_material": "Polycarbonate (PC)"
# part_numberrohs_statusreach_statusul_certificationcsa_certificationflammability_class
1
2
3

Complete list of extractable fields for Logistics objects from harting.com. All fields typed and schema-versioned.

part_numberean_codecustoms_tariff_numbercountry_of_originpackaging_unitnet_weightgross_weightmin_order_qty
logistics
● 200 OK
"part_number": "09330162601",
"ean_code": "2000006849492",
"customs_tariff_number": "85366990",
"country_of_origin": "DE",
"packaging_unit": 1,
"net_weight": 62.5,
"min_order_qty": 1
# part_numberean_codecustoms_tariff_numbercountry_of_originpackaging_unitnet_weight
1
2
3

Capabilities

Deep electrical component extraction

Harting's eCatalogue is highly structured but deeply nested. We extract full technical specifications, mating component logic, and CAD metadata across their entire industrial connector portfolio.

Han Connector Extraction

Extract inserts, contacts, hoods, housings, and accessories with full hierarchical relationships preserved.

Technical Specification Tables

Parse electrical, mechanical, and material specifications into clean key-value pairs per part number.

Mating Logic Resolution

Traverse relational links to build complete mating profiles: male/female pairings and compatible hoods.

CAD & Datasheet Mapping

Extract direct URLs for PDF datasheets, 3D STEP files, and 2D DXF models associated with each part.

Compliance Tracking

Capture RoHS, REACH, UL, and CSA certification status directly from the product detail pages.

Configurator Data

Extract structured output parameters from the Han Configurator to build internal product selection tools.

Regional Normalisation

Handle locale-specific part numbers and availability across different Harting regional domains.

Cross-Reference Mapping

Extract alternative parts and predecessor/successor part numbers for EOL components.

Scheduled Updates

Track new additions and obsolete parts with daily or weekly differential pipelines.

// engagement pipeline

From part numbers to PLM database

Brief in. Clean data out.

Define Scope
d 0

Provide target series (e.g., Han E, Han Modular) or specific part number lists. We map the extraction schema.

Pipeline Build
d 2–4

We configure Scrapy / Playwright crawlers to navigate the eCatalogue and render dynamic specification tables.

Validation & QA
d 4–6

Schema validation ensures electrical ratings, mating logic, and wire gauges meet your strict data types.

Delivery
ongoing

JSON / CSV / Parquet pushed to your S3 bucket or PostgreSQL database on agreed cadence.

Under the hood

How we handle Harting's eCatalogue complexity

Industrial component data requires precise extraction logic. Here is how we ensure data integrity across complex product hierarchies.

pipeline-monitor · harting.com · live ● active
// fingerprinting
Identity rotation
TLS fingerprintrandomised
User-agentrotated
IP poolresidential
Challenges blocked0
// pagination
Page coverage
48,291 pages queued running
// observability
Pipeline health
99.9%
uptime
142ms
p99 lat
0.3%
null rate
2
alerts
JavaScript rendering
Handling dynamic configurators

Harting relies on JavaScript for product configurators and dynamic CAD model loading. We use Playwright to execute SPA logic, ensuring we capture data that headless HTTP clients miss.

Table normalisation
Structuring nested technical specs

Technical specifications vary wildly between connector series and Ethernet switches. Our parsers normalise varying table structures into consistent key-value schemas.

Relational traversal
Extracting complete mating profiles

A connector insert is useless without its compatible hood and contacts. Our crawlers traverse 'mating part' and 'accessory' links to build fully relational component graphs.

Document extraction
Resolving asset URLs

We intercept XHR requests to extract direct download URLs for PDF datasheets and CAD files, bypassing front-end download managers.

Change detection
Only re-scrape what's changed

We maintain a hash index of last-seen values for the entire catalogue. Subsequent runs only push diffs, alerting you to updated compliance specs or EOL statuses.

Applications

Who uses Harting component data

Teams across industries use harting.com data to build competitive products and smarter operations.

01
Digital Twin & PLM Integration

Engineering teams ingest structured specs and CAD metadata directly into Siemens Teamcenter or PTC Windchill.

02
Distributor Catalogue Sync

Authorised distributors maintain up-to-date product listings, images, and technical attributes on their own storefronts.

03
MRO Procurement Optimization

Procurement teams map internal part numbers to Harting specifications to find alternative suppliers or consolidate spend.

04
Competitor Cross-Referencing

Manufacturers build cross-reference databases mapping Harting connectors to equivalent parts from TE Connectivity or Phoenix Contact.

05
Engineering CAD Libraries

Automation teams bulk-extract 3D STEP file URLs to build internal component libraries for EPLAN or AutoCAD Electrical.

06
Supply Chain Compliance

Compliance officers track RoHS and REACH certification updates across their entire bill of materials.

Why DataFlirt

"Industrial component data is notoriously fragmented. Extracting clean mating logic and specs from Harting saves engineering teams thousands of hours in manual PLM entry."

Most procurement teams underestimate the complexity of electrical component scraping. Harting's eCatalogue relies on heavy JavaScript for its configurators, nested tables for technical specifications, and dynamic endpoints for CAD downloads. DataFlirt manages this infrastructure so your engineers can focus on product design, not web scraping.

Technical Spec

Harting scraper — technical capabilities

Everything supported by our harting.com scraper — rendered SPA elements, auth walls, rate-limit evasion and beyond.

JavaScript rendering
Playwright sessions for dynamic configurators and asset endpoints
Supported
Mating part traversal
Recursive scraping of compatible inserts, hoods, and accessories
Supported
Spec table normalisation
Key-value extraction from varying technical specification tabs
Supported
CAD file metadata
Extracting direct URLs for 3D STEP and 2D DXF models
Supported
PDF datasheet links
Direct URL extraction for technical data sheets
Supported
Change detection (diffs)
Hash-based diff: only emit records with changed fields since last run
Supported
Multi-region locales
Extracting data from specific country domains (e.g., DE, US, UK)
Supported
Gated CAD model download
Downloading actual CAD files requires authenticated Harting account
Partial
MyHARTING custom pricing
B2B specific pricing requires authenticated login credentials
Partial
Infrastructure

Infrastructure powering the Harting pipeline

Open-source tooling on proven cloud infra — no vendor lock-in, full observability.

ScrapyPlaywrightPython 3.12RedisPostgreSQLApache AirflowAWS LambdaS3CloudWatch2CaptchaCapSolverResidential ProxiesDockerKubernetesGrafanaPrometheus
Scrapy + Playwright Stack

Scrapy handles crawl orchestration and deduplication. Playwright handles JavaScript rendering for the eCatalogue and configurator elements.

Configurator State Extraction

We intercept API responses and DOM state changes to extract structured parameters from Harting's interactive product selection tools.

Cloud-Native Orchestration

Pipelines run on AWS Lambda and ECS. Airflow handles scheduling, dependency management, and SLA alerting. State stored in Postgres.

Output & Delivery

Your data, your destination

Data delivered to where your team already works — no new tooling required.

JSON
Newline-delimited or nested — schema versioned per run
CSV
Flat file with typed columns — Excel/Sheets compatible
Parquet
Columnar format for BigQuery, Snowflake, Athena
S3
Direct bucket delivery — compatible with any data lake
Webhook
HTTP POST per record for real-time downstream processing
XLS
Excel format for direct procurement team usage
API
REST API access to query extracted component data
PostgreSQL
Upsert into your existing schema with conflict resolution
// faq

Common questions.

About harting.com scraping, legality, and pipeline operations.

Ask us directly →
Is scraping the Harting eCatalogue legal?

Scraping publicly available product specifications and catalogue data is generally permissible. DataFlirt extracts only public, non-authenticated technical data. We do not bypass login walls to extract proprietary B2B pricing. Clients should consult legal counsel for specific usage.

Can you extract data from the Han Configurator?

Yes. We use Playwright to interact with the configurator, extracting the resulting part numbers, mating logic, and technical parameters generated by the tool.

Do you download the actual CAD files or just URLs?

We extract the direct download URLs for CAD files and PDF datasheets. Downloading the actual proprietary CAD files often requires a MyHARTING account, which falls under authenticated scraping.

How do you handle mating part relationships?

Our crawlers are designed to traverse relational links. When scraping a male insert, we automatically extract the linked female inserts, compatible hoods, and required crimp tools, delivering them as a nested JSON array or relational CSV.

Can you map Harting parts to our internal taxonomy?

Yes. We can apply custom transformation logic during the pipeline delivery phase to map Harting categories (e.g., 'Han E') to your internal PLM taxonomy.

How frequently can we sync the catalogue?

Most clients require weekly or monthly syncs for industrial component catalogues to catch new product introductions and EOL status changes. We support custom cadences.

Do you support extracting RoHS/REACH certificates?

Yes. We extract the compliance status (RoHS, REACH, SVHC) directly from the product detail pages and include it in the structured output.

$ dataflirt scope --new-project --source=harting.com ready

Tell us what
to extract.
We do the rest.

20-minute scoping call. Pilot dataset within the week. Production within two. Whether you need a one-off catalogue dump or a continuous sync for your PLM system — we scope, build, and operate the pipeline. Tell us what you need.

hello@dataflirt.com · Bengaluru · IST · typical reply < 4h
Related Scrapers

More in industrial and mro

Services

Data Extraction for Every Industry

View All Services →