SYSTEM all green source ifm.com queue 12,491 pages p99 latency 210ms dataflirt.com · scraper/ifm-com
RUN · 31 active pipelines · ifm.com live

Ifm sensor data,
at warehouse scale.

We extract industrial automation catalogues, technical specifications, IO-Link profiles, and compliance certificates from ifm. Delivered as clean JSON, CSV, or Parquet to your infrastructure.

Products extracted
84K /run
Spec fields
1.2M /run
CAD links
62K /total
Active pipelines
31
Uptime
99.94%
Data Dictionary

Every field we extract from ifm.com

Structured, schema-consistent data across all major object types — delivered clean, typed, and ready to query.

Complete list of extractable fields for Product Specifications objects from ifm.com. All fields typed and schema-versioned.

article_numberproduct_namecategorysub_categorymeasuring_rangeoperating_voltageoutput_functionconnection_typeprotection_ratingweighthousing_materialsambient_temperature
product_specifications
● 200 OK
"article_number": "O5D100",
"product_name": "Photoelectric distance sensor",
"measuring_range": "0.03...2 m",
"operating_voltage": "10...30 DC V",
"output_function": "OUT1: normally open / normally closed; OUT2: normally open / normally closed / analogue",
"connection_type": "M12 connector",
"protection_rating": "IP 65; IP 67",
"weight": "0.285 kg"
# article_numberproduct_namecategorysub_categorymeasuring_rangeoperating_voltage
1
2
3

Complete list of extractable fields for Documentation & CAD objects from ifm.com. All fields typed and schema-versioned.

article_numberdata_sheet_urloperating_instructions_urlcad_3d_step_urlcad_2d_pdf_urlce_declaration_urlrohs_statuseplan_macro_urlul_certificate_url
documentation_& cad
● 200 OK
"article_number": "O5D100",
"data_sheet_url": "https://www.ifm.com/download/files/O5D100_DS_EN",
"operating_instructions_url": "https://www.ifm.com/download/files/O5D100_OI_EN",
"cad_3d_step_url": "https://www.ifm.com/download/cad/step/O5D100",
"rohs_status": "Compliant",
"eplan_macro_url": "https://www.ifm.com/download/eplan/O5D100_edz",
"ce_declaration_url": "https://www.ifm.com/download/files/CE_O5D100"
# article_numberdata_sheet_urloperating_instructions_urlcad_3d_step_urlcad_2d_pdf_urlce_declaration_url
1
2
3

Complete list of extractable fields for Pricing & Availability objects from ifm.com. All fields typed and schema-versioned.

article_numberlist_pricecurrencyregion_codestock_statuslead_time_daysmoqpackaging_unitprice_timestamp
pricing_& availability
● 200 OK
"article_number": "O5D100",
"list_price": 345.5,
"currency": "EUR",
"region_code": "DE",
"stock_status": "In stock",
"lead_time_days": 2,
"moq": 1,
"packaging_unit": "1 piece",
"price_timestamp": "2026-05-12T10:15:00Z"
# article_numberlist_pricecurrencyregion_codestock_statuslead_time_days
1
2
3

Complete list of extractable fields for IO-Link Data objects from ifm.com. All fields typed and schema-versioned.

article_numbervendor_iddevice_idbit_lengthprocess_data_inprocess_data_outmin_cycle_timeiodd_file_urlsio_mode_supported
io-link_data
● 200 OK
"article_number": "O5D100",
"vendor_id": "310",
"device_id": "875",
"bit_length": "32",
"process_data_in": "Distance, Switching signal",
"min_cycle_time": "6.6 ms",
"sio_mode_supported": true,
"iodd_file_url": "https://www.ifm.com/download/iodd/O5D100"
# article_numbervendor_iddevice_idbit_lengthprocess_data_inprocess_data_out
1
2
3

Complete list of extractable fields for Accessories & Topology objects from ifm.com. All fields typed and schema-versioned.

article_numberaccessory_articlesmounting_kitsconnection_cablesreplacement_forreplaced_bycross_reference_competitorcompatible_masters
accessories_& topology
● 200 OK
"article_number": "O5D100",
"accessory_articles": "['E21228', 'E20870']",
"connection_cables": "['EVC001', 'EVC004']",
"mounting_kits": "['E21228']",
"replacement_for": "O5D105",
"replaced_by": "None",
"compatible_masters": "['AL1100', 'AL1300']"
# article_numberaccessory_articlesmounting_kitsconnection_cablesreplacement_forreplaced_by
1
2
3

Capabilities

Extract the complete ifm engineering catalogue

Our ifm pipeline handles the technical complexity of industrial component data: dynamic specification tables, regional pricing logic, IO-Link parameter extraction, and nested accessory graphs.

Technical Specification Normalisation

Extract electrical design, measuring ranges, outputs, and environmental parameters. We normalise units and key-value pairs across different sensor categories.

Regional Pricing & Stock

Capture list prices, currency, and availability for specific global regions by managing session cookies and location headers.

IO-Link Parameter Extraction

Extract vendor IDs, device IDs, process data bit lengths, and cycle times directly from the product pages or associated IODD metadata.

CAD & Documentation Links

Index direct download URLs for STEP files, 2D PDFs, operating instructions, and CE declarations for every article number.

Accessory Graph Mapping

Map connection cables, mounting kits, and IO-Link masters to their compatible sensors, building a complete relational topology.

Lifecycle & Replacement Tracking

Identify phased-out components and extract the direct replacement article numbers to maintain accurate procurement databases.

Structured Wiring Diagrams

Extract pinout configurations and wiring colour codes associated with M8/M12 connectors and specific sensor outputs.

Application Context

Scrape the recommended application domains (e.g. food and beverage, machine tool, mobile machines) for specific component lines.

Change Detection Pipeline

Monitor specific article numbers for specification updates, firmware revisions, or price changes, delivering only the diffs.

// engagement pipeline

From sensor category to structured telemetry

Brief in. Clean data out.

Define Scope
d 0

Provide specific article numbers, product families (e.g. pressure sensors), or regional domains. We design the extraction schema.

Pipeline Build
d 2–4

We configure Scrapy/Playwright crawlers to navigate ifm's dynamic tables, manage regional cookies, and parse technical metadata.

Validation & QA
d 4–6

Schema validation, unit normalisation checks, and accessory graph verification before full execution.

Delivery
ongoing

Structured technical data pushed to your S3 bucket, Postgres database, or via Webhook on your defined schedule.

Under the hood

Navigating industrial data complexity

Extracting engineering data requires handling inconsistent table structures and regional session states. Here is how our infrastructure manages the ifm catalogue.

pipeline-monitor · ifm.com · live ● active
// fingerprinting
Identity rotation
TLS fingerprintrandomised
User-agentrotated
IP poolresidential
Challenges blocked0
// pagination
Page coverage
48,291 pages queued running
// observability
Pipeline health
99.9%
uptime
142ms
p99 lat
0.3%
null rate
2
alerts
Dynamic spec tables
Handling inconsistent technical attributes

A pressure sensor has entirely different specifications than an inductive proximity switch. Our parsers dynamically map ifm's technical tables into structured JSON key-value pairs, regardless of the product category.

Regional context
Cookie and header injection for local pricing

ifm routes users and displays pricing based on geography. We inject specific regional cookies and headers into our Playwright sessions to extract accurate local list prices and stock availability.

Accessory networks
Traversing relational product links

Industrial components rely on specific cables and mounts. Our crawlers traverse the 'Accessories' and 'Compatible Products' tabs, building an adjacency list of article numbers to map the full system topology.

Documentation indexing
Extracting direct file endpoints

Instead of downloading heavy CAD files or PDFs during the crawl, we extract the direct, authenticated URLs for STEP files, IODD zips, and data sheets, delivering them as clean string fields for downstream processing.

Anti-bot resilience
Proxy rotation and rate limiting

While B2B catalogues are less aggressive than retail sites, scraping 80,000 components rapidly triggers rate limits. We distribute requests across rotated IP pools and enforce concurrency limits to ensure zero 429 HTTP errors.

Applications

Who uses ifm component data

Teams across industries use ifm.com data to build competitive products and smarter operations.

01
MRO Procurement Optimisation

Procurement teams ingest list prices and stock availability into ERP systems to optimise purchasing and monitor lead times for critical spares.

02
Distributor Catalogue Enrichment

Industrial distributors sync ifm technical specifications, images, and documentation links directly into their own PIM systems.

03
Digital Twin Integration

Engineering firms extract CAD links and dimensional data to populate 3D modelling software and digital twin environments.

04
Competitor Cross-Referencing

Sensor manufacturers scrape technical parameters to build automated cross-reference tools against ifm's product lines.

05
IO-Link System Configuration

Automation engineers extract IO-Link process data lengths and cycle times to pre-configure PLC networks and fieldbus modules.

06
Lifecycle Management

Maintenance teams monitor product pages for 'phase-out' warnings and automatically log the replacement article numbers in their CMMS.

Why DataFlirt

"Ifm's catalogue contains the baseline parameters for millions of automated systems worldwide — but extracting structured IO-Link profiles requires a purpose-built pipeline."

Extracting MRO and industrial sensor data requires navigating complex technical tables, regional pricing contexts, and nested accessory graphs. DataFlirt manages the proxy rotation, session state, and schema normalisation so your engineers receive clean, queryable telemetry.

Technical Spec

ifm scraper — technical capabilities

Everything supported by our ifm.com scraper — rendered SPA elements, auth walls, rate-limit evasion and beyond.

JavaScript rendering
Playwright sessions to render dynamic specification tables and accessory tabs
Supported
Regional pricing extraction
Location injection for country-specific list prices and stock levels
Supported
Technical spec normalisation
Dynamic key-value extraction for all sensor and networking categories
Supported
CAD file link extraction
Capture direct URLs for STEP, IGES, and PDF dimensional drawings
Supported
IODD metadata links
Extract IO-Link device description file URLs and basic parameters
Supported
Accessory graph mapping
Relational mapping of cables, mounts, and IO-Link masters to sensors
Supported
Competitor cross-reference
Extract ifm's published cross-reference data for competitor parts
Supported
B2B customer-specific discount tiers
Requires authenticated session with specific customer credentials
Partial
Checkout & cart automation
Transactional data and automated purchasing flows are not supported
Partial
Infrastructure

Infrastructure powering the ifm pipeline

Open-source tooling on proven cloud infra — no vendor lock-in, full observability.

ScrapyPlaywrightPython 3.12RedisPostgreSQLApache AirflowAWS LambdaS3CloudWatch2CaptchaCapSolverResidential ProxiesDockerKubernetesGrafanaPrometheus
Scrapy + Playwright Stack

Scrapy manages the crawl frontier across ifm's category tree, while Playwright handles the dynamic rendering of technical tables and regional cookie states.

PostgreSQL Normalisation

Raw technical attributes are ingested into PostgreSQL, where complex JSONB queries normalise inconsistent unit formatting across thousands of sensor types.

Airflow Orchestration

Apache Airflow schedules the pipelines, manages regional context switching, and handles the delivery of structured files to client data lakes.

Output & Delivery

Your data, your destination

Data delivered to where your team already works — no new tooling required.

JSON
Nested structures ideal for accessory graphs and IO-Link data
CSV
Flat files for ERP ingestion and pricing updates
XLS
Excel format for procurement and engineering review
Parquet
Columnar format for data warehouse integration
AWS S3
Direct delivery to your cloud storage buckets
Webhook
HTTP POST for real-time lifecycle or price changes
API
REST endpoints to query specific article numbers on demand
PostgreSQL
Direct database inserts for PIM system synchronisation
S3
Direct bucket delivery — compatible with any data lake
// faq

Common questions.

About ifm.com scraping, legality, and pipeline operations.

Ask us directly →
Can you extract data for specific regional domains?

Yes. We configure pipelines to target specific ifm regional domains (e.g., ifm.com/de, ifm.com/us) or inject appropriate location cookies to ensure the pricing and stock availability match your required geography.

Do you download the actual CAD and IODD files?

Our standard pipeline extracts the direct download URLs for CAD files, PDFs, and IODD archives. If you require the physical files, we can configure an S3 sync job to download and store the assets in your environment.

How do you handle the different specification tables for different products?

ifm uses dynamic tables based on product type. Our parsers dynamically extract the key-value pairs from the DOM and map them into a flexible JSON structure, ensuring no technical parameter is dropped regardless of the sensor category.

Is scraping ifm.com legal?

Scraping publicly available catalogue data, technical specifications, and list pricing is generally permissible. DataFlirt targets only public, non-authenticated engineering data. We do not circumvent B2B login walls to extract proprietary customer discounts.

Can you track when a product is phased out?

Yes. We can monitor specific article numbers on a daily or weekly cadence. If the product status changes to phased out, we capture the change and extract the recommended replacement article number.

How frequently can we update pricing and stock?

For defined lists of critical article numbers, we can run daily or hourly extraction pipelines. For the entire global catalogue, we typically recommend a weekly or monthly refresh cycle to balance compute costs.

$ dataflirt scope --new-project --source=ifm.com ready

Tell us what
to extract.
We do the rest.

20-minute scoping call. Pilot dataset within the week. Production within two. Whether you need a complete catalogue export for your PIM system or continuous monitoring of MRO pricing — we scope, build, and operate the pipeline. Tell us what you need.

hello@dataflirt.com · Bengaluru · IST · typical reply < 4h
Related Scrapers

More in industrial and mro

Services

Data Extraction for Every Industry

View All Services →