SYSTEM all green source abb.com queue 12,844 pages p99 latency 215ms dataflirt.com · scraper/abb-com
RUN · 37 active pipelines · abb.com live

ABB catalogue data,
at warehouse scale.

We extract industrial product specs, MRO part numbers, CAD metadata, and lifecycle statuses from ABB. Delivered as clean JSON, CSV, or Parquet to S3, BigQuery, or Snowflake on your cadence.

Products extracted
842K /run
Documents indexed
1.2M /24h
Spec attributes
4.7M /run
Active pipelines
37
Uptime
99.94%
Data Dictionary

Every field we extract from abb.com

Structured, schema-consistent data across all major object types — delivered clean, typed, and ready to query.

Complete list of extractable fields for Product Specifications objects from abb.com. All fields typed and schema-versioned.

part_numberproduct_idtitlecategorysub_categorylifecycle_statuseannet_weightdimensionsdescriptionproduct_net_depthproduct_net_heightproduct_net_width
product_specifications
● 200 OK
"part_number": "1SDA066776R1",
"product_id": "XT2N 160",
"title": "XT2N 160 TMD 16-300 3p F F",
"category": "Low Voltage Products and Systems",
"sub_category": "Circuit Breakers",
"lifecycle_status": "Active",
"ean": "8015644006869",
"net_weight": "1.1 kg"
# part_numberproduct_idtitlecategorysub_categorylifecycle_status
1
2
3

Complete list of extractable fields for Technical Documentation objects from abb.com. All fields typed and schema-versioned.

part_numberdoc_titledoc_typelanguagerevisionpublication_datefile_sizedownload_urldoc_id
technical_documentation
● 200 OK
"part_number": "1SDA066776R1",
"doc_title": "Tmax XT Technical Catalogue",
"doc_type": "Catalogue",
"language": "English",
"revision": "C",
"publication_date": "2025-11-14",
"file_size": "14.2 MB",
"download_url": "https://search.abb.com/library/Download..."
# part_numberdoc_titledoc_typelanguagerevisionpublication_date
1
2
3

Complete list of extractable fields for Ordering Information objects from abb.com. All fields typed and schema-versioned.

part_numberorder_codeminimum_order_qtyselling_unitcustoms_tariff_numbercountry_of_origineaninvoice_descriptionpackage_level_1_units
ordering_information
● 200 OK
"part_number": "1SDA066776R1",
"order_code": "1SDA066776R1",
"minimum_order_qty": 1,
"selling_unit": "piece",
"customs_tariff_number": "85362090",
"country_of_origin": "Italy (IT)",
"ean": "8015644006869"
# part_numberorder_codeminimum_order_qtyselling_unitcustoms_tariff_numbercountry_of_origin
1
2
3

Complete list of extractable fields for Environmental Data objects from abb.com. All fields typed and schema-versioned.

part_numberrohs_statusrohs_dateweee_categoryreach_declarationscip_idcarbon_footprintenvironmental_doc_urlcircular_value
environmental_data
● 200 OK
"part_number": "1SDA066776R1",
"rohs_status": "Following EU Directive 2011/65/EU",
"rohs_date": "2025-01-01",
"weee_category": "5. Small Equipment (No External Dimension More Than 50 cm)",
"reach_declaration": "Available",
"scip_id": "8a7b6c5d-4e3f-2g1h-0i9j",
"carbon_footprint": "12.4 kg CO2e"
# part_numberrohs_statusrohs_dateweee_categoryreach_declarationscip_id
1
2
3

Complete list of extractable fields for Distributor Locations objects from abb.com. All fields typed and schema-versioned.

partner_namepartner_typeaddresscitycountryphonewebsitelatitudelongitudeservices_offered
distributor_locations
● 200 OK
"partner_name": "Industrial Automation Supply Co.",
"partner_type": "Authorized Distributor",
"address": "142 Manufacturing Blvd",
"city": "Chicago",
"country": "United States",
"phone": "+1-555-0198",
"website": "https://iasupply.example.com",
"latitude": 41.8781,
"longitude": -87.6298
# partner_namepartner_typeaddresscitycountryphone
1
2
3

Capabilities

Complete ABB catalogue extraction — structured and normalised

Our ABB scraper navigates complex product configurators, nested category trees, and regional catalogues to deliver clean MRO datasets.

Deep Specification Extraction

Extract highly variable technical attributes across robotics, motors, drives, and low-voltage categories into normalised schemas.

Lifecycle Status Tracking

Monitor transition phases from Active to Classic, Limited, or Obsolete to inform procurement and engineering decisions.

Technical Document Indexing

Capture direct URLs and metadata for CAD files, installation manuals, declarations of conformity, and environmental profiles.

Ordering Code Mapping

Map long ABB product IDs to standard EANs, customs tariff numbers, and minimum order quantities for supply chain systems.

Regional Catalogue Support

Extract product availability and compliance data specific to local markets via geographically targeted proxies.

Distributor & Partner Mapping

Scrape global channel partner networks to map authorised distributors, system integrators, and service providers.

Configurator Navigation

Automate interactions with ABB's JavaScript-heavy product selection tools to extract valid component combinations.

Environmental & RoHS Data

Extract compliance declarations, WEEE categories, and SCIP database identifiers for sustainability reporting.

Scheduled Diffing

Run continuous pipelines that detect changes in lifecycle statuses or document revisions, pushing only updated records.

// engagement pipeline

From part numbers to warehouse record

Brief in. Clean data out.

Define Scope
d 0

Provide target categories, part number lists, or regional requirements. We design the extraction schema.

Pipeline Build
d 2–4

We configure Playwright crawlers to navigate ABB configurators, handle pagination, and normalise spec tables.

Validation & QA
d 4–6

Schema validation, null-rate checks, and cross-reference verification before full production launch.

Delivery
ongoing

JSON / CSV / Parquet pushed to your S3 bucket, BigQuery dataset, or Snowflake stage on agreed cadence.

Under the hood

Navigating ABB's complex industrial architecture

Extracting MRO data requires handling deep JS configurators and massive spec tables. Here is how we maintain pipeline stability.

pipeline-monitor · abb.com · live ● active
// fingerprinting
Identity rotation
TLS fingerprintrandomised
User-agentrotated
IP poolresidential
Challenges blocked0
// pagination
Page coverage
48,291 pages queued running
// observability
Pipeline health
99.9%
uptime
142ms
p99 lat
0.3%
null rate
2
alerts
JavaScript execution
Full browser automation for configurators

Many ABB product variants are only accessible via dynamic configurators. We deploy Playwright to execute JavaScript, select dropdowns, and render the final specification tables accurately.

Schema normalisation
Standardising variable spec tables

A motor has entirely different attributes than a circuit breaker. We map thousands of unique attribute keys into a clean, predictable JSON schema, handling unit conversions and formatting variations.

Document portal extraction
Resolving dynamic download links

ABB's technical library relies on complex search APIs and temporary tokens. Our pipeline interacts directly with these endpoints to extract permanent document URLs and accurate metadata.

Regional routing
Geotargeted proxy allocation

Product availability and compliance data vary by region. We route requests through specific proxy nodes to capture the exact catalogue visible to users in Germany, the US, or India.

Change detection
Tracking lifecycle shifts

For MRO monitoring, we maintain a state file of all part numbers. The pipeline only flags records when a product shifts from 'Active' to 'Classic' or 'Obsolete', reducing data noise.

Applications

Who uses ABB catalogue data — and how

Teams across industries use abb.com data to build competitive products and smarter operations.

01
MRO Procurement

Procurement teams ingest part numbers and lifecycle statuses into ERP systems to identify obsolete components before they fail.

02
Digital Twin Modelling

Engineering firms extract dimensional data, net weights, and CAD links to populate digital twin environments and BIM software.

03
Competitor Cross-Referencing

Industrial manufacturers map ABB specifications against their own catalogues to build automated cross-reference tools.

04
Supply Chain Planning

Distributors monitor ordering codes, EANs, and customs tariff numbers to automate inventory ingestion and customs documentation.

05
Sustainability Reporting

Compliance teams extract RoHS, REACH, and carbon footprint data to meet environmental reporting requirements.

06
Distributor Network Analysis

Market analysts scrape the global partner portal to map ABB's distribution footprint and identify regional service coverage gaps.

Why DataFlirt

"ABB's digital catalogue contains millions of engineering specifications, but accessing that data programmatically requires navigating deep configurators and fragmented document portals."

Industrial data extraction requires more than simple HTTP requests. We deploy full browser automation to interact with ABB's product configurators, normalise highly variable specification tables, and index technical documentation accurately. DataFlirt handles the extraction infrastructure so your engineers can focus on integrating the data.

Technical Spec

ABB scraper — technical capabilities

Everything supported by our abb.com scraper — rendered SPA elements, auth walls, rate-limit evasion and beyond.

JavaScript rendering
Full Playwright sessions for dynamic product tables and configurators
Supported
PDF metadata extraction
Capture document type, language, revision, and direct download URLs
Supported
Cross-reference mapping
Extract alternative part numbers and successor product recommendations
Supported
Lifecycle tracking
Monitor transitions between Active, Classic, Limited, and Obsolete phases
Supported
Regional catalogues
Extract country-specific availability using targeted proxy nodes
Supported
Change detection (diffs)
Only emit records with changed technical specs or lifecycle statuses
Supported
Webhook delivery
HTTP POST per record — useful for updating internal PIM systems
Supported
Distributor mapping
Extract full partner details including address, coordinates, and services
Supported
MyABB portal pricing
Customer-specific pricing requires authenticated sessions
Partial
Partner inventory levels
Real-time stock counts gated behind distributor login walls
Partial
Infrastructure

Infrastructure powering the ABB pipeline

Open-source tooling on proven cloud infra — no vendor lock-in, full observability.

ScrapyPlaywrightPython 3.12RedisPostgreSQLApache AirflowAWS LambdaS3CloudWatch2CaptchaCapSolverResidential ProxiesDockerKubernetesGrafanaPrometheus
Scrapy + Playwright Stack

Scrapy handles crawl orchestration and normalisation. Playwright executes JavaScript to navigate product configurators and render hidden specification tables.

Proxy Infrastructure

We maintain pools of datacenter and residential proxies. Rotation happens per-request to ensure stable access to regional catalogues without rate limits.

Cloud-Native Orchestration

Pipelines run on AWS Lambda and ECS. Airflow handles scheduling, dependency management, and SLA alerting. All state stored in managed Postgres.

Output & Delivery

Your data, your destination

Data delivered to where your team already works — no new tooling required.

JSON
Nested structures ideal for complex technical specifications
CSV
Flat file with typed columns for simple part number lists
XLS
Excel format for procurement and engineering teams
Parquet
Columnar format for BigQuery, Snowflake, Athena
AWS S3
Direct bucket delivery for data lake integration
Webhook
HTTP POST per record for PIM system updates
API
Queryable REST endpoints for extracted catalogue data
PostgreSQL
Upsert into your existing schema with conflict resolution
Snowflake
Stage + COPY INTO workflow for enterprise warehouses
BigQuery
Streamed directly into your dataset with schema auto-detect
S3
Direct bucket delivery — compatible with any data lake
// faq

Common questions.

About abb.com scraping, legality, and pipeline operations.

Ask us directly →
Is scraping ABB legal?

Scraping publicly available product specifications and documentation from ABB is generally permissible under applicable law. DataFlirt targets only public, non-authenticated catalogue data. We do not extract personal data, circumvent authentication walls like MyABB, or violate GDPR. Clients should consult legal counsel for specific use cases.

How do you handle ABB's dynamic product configurators?

We use Playwright to simulate browser sessions, executing JavaScript to interact with dropdowns, sliders, and selection toggles. This allows us to extract the final rendered specification tables for specific part configurations.

Can you extract data for specific regional markets?

Yes. ABB's catalogue varies by country. We route our crawlers through geotargeted proxy nodes to extract exact product availability, compliance data, and ordering codes for your target regions.

Do you extract PDF manuals and CAD files?

We extract the metadata (title, language, revision, publication date) and the direct download URLs for all technical documentation. We do not host the files, but we provide the structured links for your systems to download.

How frequently can you deliver data?

For full catalogue extractions, we typically run weekly or monthly pipelines. For targeted lists of critical MRO parts, we can run daily checks to detect lifecycle status changes.

Can I request a sample dataset before committing?

Absolutely. We provide a sample run of up to 1,000 part numbers or a specific product category as part of the pre-engagement scoping process to validate schema fit and data quality.

What is the minimum viable engagement?

Our smallest packages start at a defined list of 10,000 part numbers or specific category trees. For full global catalogue extraction, we price based on volume, configurator complexity, and delivery frequency.

$ dataflirt scope --new-project --source=abb.com ready

Tell us what
to extract.
We do the rest.

20-minute scoping call. Pilot dataset within the week. Production within two. Whether you need a one-off catalogue dump or continuous lifecycle monitoring across 500K part numbers — we scope, build, and operate the pipeline. Tell us what you need.

hello@dataflirt.com · Bengaluru · IST · typical reply < 4h
Related Scrapers

More in industrial and mro

Services

Data Extraction for Every Industry

View All Services →