SYSTEM all green source partsouq.com queue 14,892 VINs p99 latency 312ms dataflirt.com · scraper/partsouq-com
RUN * 64 active pipelines * partsouq.com live

Automotive OEM data,
at warehouse scale.

We extract OEM part catalogues, VIN decoding results, exploded diagrams, and cross-reference fitment data from Partsouq. Delivered as clean JSON, CSV, or Parquet to S3, BigQuery, or Snowflake.

Parts extracted
1.2M /day
VINs decoded
85.4K /24h
Diagrams mapped
412K /run
Active pipelines
64
Uptime
99.94%
Data Dictionary

Every field we extract from partsouq.com

Structured, schema-consistent data across all major object types — delivered clean, typed, and ready to query.

Complete list of extractable fields for VIN Decoding objects from partsouq.com. All fields typed and schema-versioned.

vinmakemodelyearregionenginetransmissionframe_codeproduction_datecatalog_code
vin_decoding
● 200 OK
"vin": "JTDKT23491...",
"make": "Toyota",
"model": "Camry",
"year": "2018",
"region": "GCC",
"engine": "2ARFE",
"transmission": "ATM",
"frame_code": "ASV50"
# vinmakemodelyearregionengine
1
2
3

Complete list of extractable fields for EPC Diagrams objects from partsouq.com. All fields typed and schema-versioned.

diagram_idcategorysub_categoryimage_urlpart_calloutsmakemodelyearcatalog_code
epc_diagrams
● 200 OK
"diagram_id": "FIG-1104",
"category": "Engine",
"sub_category": "Cylinder Head",
"image_url": "https://partsouq.com/assets/...",
"make": "Toyota",
"model": "Camry",
"catalog_code": "671420"
# diagram_idcategorysub_categoryimage_urlpart_calloutsmake
1
2
3

Complete list of extractable fields for Part Listings objects from partsouq.com. All fields typed and schema-versioned.

part_numberdescriptionmakeprice_usdstock_statusweight_kgsupersedessuperseded_byavailability_days
part_listings
● 200 OK
"part_number": "11101-39745",
"description": "HEAD SUB-ASSY, CYLINDER",
"make": "Toyota",
"price_usd": 845.2,
"stock_status": "In Stock",
"weight_kg": 14.5
# part_numberdescriptionmakeprice_usdstock_statusweight_kg
1
2
3

Complete list of extractable fields for Vehicle Fitment objects from partsouq.com. All fields typed and schema-versioned.

part_numbercompatible_makescompatible_modelsyear_startyear_endengine_typesregion_specschassis_codesnotes
vehicle_fitment
● 200 OK
"part_number": "11101-39745",
"compatible_makes": "['Toyota', 'Lexus']",
"compatible_models": "['Camry', 'ES250']",
"year_start": 2012,
"year_end": 2018,
"engine_types": "['2ARFE']"
# part_numbercompatible_makescompatible_modelsyear_startyear_endengine_types
1
2
3

Complete list of extractable fields for Category Hierarchy objects from partsouq.com. All fields typed and schema-versioned.

makeregionmodelcatalog_codegroup_namesub_groupdiagram_countpart_countupdated_at
category_hierarchy
● 200 OK
"make": "Nissan",
"region": "Middle East",
"model": "Patrol",
"catalog_code": "Y62",
"group_name": "Body",
"sub_group": "Front Bumper",
"diagram_count": 4
# makeregionmodelcatalog_codegroup_namesub_group
1
2
3

Capabilities

Complete automotive catalogue extraction

Our Partsouq scraper handles the complex hierarchy of automotive fitment data: VIN decoding, nested assemblies, coordinate-mapped diagrams, and supersession chains.

Full EPC Extraction

Extract entire Electronic Parts Catalogues by Make, Model, and Region down to the individual bolt.

Bulk VIN Decoding

Submit lists of VINs to extract exact production dates, frame codes, engine types, and compatible part lists.

Supersession Tracking

Capture part replacement chains, noting exactly which old part numbers are superseded by new ones.

Diagram Coordinate Mapping

Extract image URLs alongside the HTML coordinate maps that link specific pixels to part numbers.

Global Pricing & Stock

Capture real-time USD pricing, stock availability, and estimated delivery days for individual components.

Multi-Region Catalogues

Extract region-specific fitment data across GCC, US, Europe, and Japan market specifications.

Cross-Reference Mapping

Map OEM part numbers across shared platforms and badge-engineered models.

Rate Limit Evasion

Bypass strict VIN search limits and session expirations using distributed IP pools.

Scheduled Diffs

Run continuous pipelines to detect price changes or stock depletion without re-scraping the entire catalogue.

// engagement pipeline

From VIN list to warehouse record

Brief in. Clean data out.

Define Scope
d 0

Provide VIN lists, target makes, or specific part numbers. We design the relational schema together.

Pipeline Build
d 2–4

We configure distributed crawlers, session management, and diagram parsing logic for Partsouq.

Validation & QA
d 4–6

Schema validation, null-rate checks, and fitment logic verification before full launch.

Delivery
ongoing

JSON / CSV / Parquet pushed to your S3 bucket, BigQuery dataset, or Snowflake stage on agreed cadence.

Under the hood

How our Partsouq pipeline handles the hard parts

Automotive catalogues are deeply nested and heavily rate-limited. Here is how we maintain data integrity.

pipeline-monitor · partsouq.com · live ● active
// fingerprinting
Identity rotation
TLS fingerprintrandomised
User-agentrotated
IP poolresidential
Challenges blocked0
// pagination
Page coverage
48,291 pages queued running
// observability
Pipeline health
99.9%
uptime
142ms
p99 lat
0.3%
null rate
2
alerts
Rate limiting
VIN Search Throttling

Partsouq strictly limits the number of VIN searches per IP. We distribute search queries across a pool of residential proxies, ensuring continuous throughput without triggering blocks or CAPTCHAs.

Data parsing
Diagram Coordinate Parsing

Part diagrams rely on complex HTML image maps to link visual callouts to part numbers. Our parsers extract these coordinate sets, allowing you to recreate interactive diagrams in your own applications.

Navigation
Complex Hierarchies

Automotive data requires recursive spidering through Make > Model > Year > Region > Group > Subgroup. We maintain strict state tracking to ensure no sub-category is dropped during extraction.

Session state
Session Management

Catalogue navigation often relies on session cookies to maintain the selected vehicle context. We manage cookie jars per concurrent worker to prevent cross-contamination of fitment data.

Formatting
Data Normalisation

OEM part numbers often appear with or without hyphens depending on the view. We normalise all part numbers to standard formats while retaining the raw string for exact matching.

Applications

Who uses Partsouq data - and how

Teams across industries use partsouq.com data to build competitive products and smarter operations.

01
Aftermarket Cross-Referencing

Aftermarket manufacturers map their products to OEM part numbers and fitment data to ensure accurate compatibility.

02
Automotive Repair Estimating

SaaS platforms ingest pricing and superseded part chains to generate accurate repair estimates for mechanics.

03
Drop-Shipping & Inventory Planning

Parts distributors monitor stock availability and pricing to optimise their own inventory procurement.

04
Insurance Claim Auditing

Insurers decode VINs to verify exact vehicle specifications and cross-check OEM part prices on repair invoices.

05
ML Fitment Training

Data science teams train machine learning models on massive sets of vehicle fitment relationships to predict part compatibility.

06
Competitor Price Monitoring

Wholesale exporters track global OEM pricing fluctuations to adjust their own B2B margins.

Why DataFlirt

"Partsouq holds one of the most comprehensive public Electronic Parts Catalogues globally, but extracting relational fitment data requires a highly resilient pipeline."

Automotive data relies on strict hierarchies. A single missing fitment link invalidates the dataset. DataFlirt handles the recursive catalogue spidering, VIN search throttling, and diagram coordinate mapping so your engineers can focus on product development, not scraper maintenance.

Technical Spec

Partsouq scraper - technical capabilities

Everything supported by our partsouq.com scraper — rendered SPA elements, auth walls, rate-limit evasion and beyond.

VIN decoding
Bulk extraction of vehicle specifications from raw VIN lists
Supported
Diagram coordinate mapping
Extraction of HTML image maps linking pixels to part numbers
Supported
Supersession chains
Tracking of old part numbers replaced by new revisions
Supported
Residential proxy rotation
ISP-grade residential IPs to bypass VIN search limits
Supported
Change detection (diffs)
Hash-based diff: only emit records with changed prices or stock
Supported
Multi-region catalogues
Extraction across GCC, US, Europe, and Japan specifications
Supported
Standardised part formats
Normalisation of part numbers with or without hyphens
Supported
Webhook delivery
HTTP POST per record or batch for real-time applications
Supported
B2B wholesale account pricing
Requires authenticated wholesale account credentials
Partial
User order history
Private data restricted to specific user accounts
Partial
Infrastructure

Infrastructure powering the Partsouq pipeline

Open-source tooling on proven cloud infra — no vendor lock-in, full observability.

ScrapyPlaywrightPython 3.12RedisPostgreSQLApache AirflowAWS LambdaS3CloudWatch2CaptchaCapSolverResidential ProxiesDockerKubernetesGrafanaPrometheus
Scrapy + Playwright Stack

Scrapy handles recursive catalogue navigation and deduplication. Playwright manages complex session state and renders dynamic diagram components.

Distributed VIN Queues

Redis-backed priority queues manage bulk VIN decoding requests, ensuring rate limits are respected without stalling the broader pipeline.

Cloud-Native Orchestration

Pipelines run on AWS Lambda (burst) and ECS (sustained). Airflow handles scheduling, dependency management, and SLA alerting.

Output & Delivery

Your data, your destination

Data delivered to where your team already works — no new tooling required.

JSON
Nested hierarchy perfect for fitment relationships
CSV
Flat file with typed columns for simple part lists
XLS
Excel compatible format for manual review
Parquet
Columnar format for BigQuery, Snowflake, Athena
AWS S3
Direct bucket delivery compatible with any data lake
Webhook
HTTP POST per record for real-time downstream processing
API
REST endpoints for on-demand data retrieval
PostgreSQL
Upsert into your existing relational schema
S3
Direct bucket delivery — compatible with any data lake
// faq

Common questions.

About partsouq.com scraping, legality, and pipeline operations.

Ask us directly →
Is scraping Partsouq legal?

Scraping publicly available catalogue information is generally permissible under applicable law. DataFlirt targets only public, non-authenticated OEM part data, diagrams, and pricing. We do not extract personal data or circumvent authentication walls. Clients should review Terms of Service and consult legal counsel for specific use cases.

How do you handle VIN search limits?

We distribute VIN decoding requests across a large pool of residential ISP proxies and implement strict concurrency limits per IP to avoid triggering rate blocks or CAPTCHA challenges.

Which automotive makes do you support?

We extract data for all makes available on Partsouq, including Toyota, Nissan, Lexus, Mitsubishi, Subaru, Honda, Hyundai, Kia, and more, across all regional catalogues.

Can you extract the interactive diagrams?

Yes. We extract the base image URLs alongside the HTML coordinate maps, allowing you to rebuild the interactive click-to-part functionality in your own applications.

How fresh is the pricing data?

For continuous pipelines, we can run daily or weekly diffs to capture pricing updates and stock availability changes without re-scraping the entire static catalogue.

What is the minimum viable engagement?

Our smallest packages start at a defined list of 10,000 VINs or a specific Make/Model subset. For full catalogue extractions, we price based on volume and delivery frequency.

$ dataflirt scope --new-project --source=partsouq.com ready

Tell us what
to extract.
We do the rest.

20-minute scoping call. Pilot dataset within the week. Production within two. Whether you need a one-off OEM catalogue dump or continuous VIN decoding at scale, we scope, build, and operate the pipeline. Tell us what you need.

hello@dataflirt.com · Bengaluru · IST · typical reply < 4h
Related Scrapers

More in automotive

Services

Data Extraction for Every Industry

View All Services →