SYSTEM all green source conrad.de queue 18,942 pages p99 latency 215ms dataflirt.com · scraper/conrad-de
RUN * 34 active pipelines * conrad.de live

Conrad.de data,
at warehouse scale.

We extract electronic components, MPNs, tiered B2B pricing, stock availability, and technical specifications from Conrad.de. Delivered as clean JSON, CSV, or Parquet to S3, BigQuery, or Snowflake on your cadence.

Components extracted
842K /day
Price updates
1.2M /24h
Datasheets parsed
45K /run
Active pipelines
34
Uptime
99.95%
Data Dictionary

Every field we extract from conrad.de

Structured, schema-consistent data across all major object types — delivered clean, typed, and ready to query.

Complete list of extractable fields for Component Specs objects from conrad.de. All fields typed and schema-versioned.

skumpneanbrandcategory_pathtitletechnical_attributesrohs_compliantweight_gdimensions_mmdatasheet_urlimage_urls
component_specs
● 200 OK
"sku": "2345678-62",
"mpn": "NE555P",
"ean": "4016138123456",
"brand": "Texas Instruments",
"rohs_compliant": true,
"datasheet_url": "https://asset.conrad.com/media10/add/160267/c1/-/en/002345678DS01/datasheet.pdf",
"technical_attributes": "['Package: DIP-8', 'Timer Type: Standard', 'Max Operating Temp: +70 C']"
# skumpneanbrandcategory_pathtitle
1
2
3

Complete list of extractable fields for B2B & B2C Pricing objects from conrad.de. All fields typed and schema-versioned.

skuprice_netprice_grossvat_ratecurrencytier_1_qtytier_1_pricetier_2_qtytier_2_pricetier_3_qtytier_3_pricetimestamp
b2b_& b2c pricing
● 200 OK
"sku": "2345678-62",
"price_net": 0.45,
"price_gross": 0.54,
"vat_rate": 19.0,
"currency": "EUR",
"tier_1_qty": 10,
"tier_1_price": 0.42,
"tier_2_qty": 100,
"tier_2_price": 0.38,
"timestamp": "2026-05-12T09:14:00Z"
# skuprice_netprice_grossvat_ratecurrencytier_1_qty
1
2
3

Complete list of extractable fields for Stock & Delivery objects from conrad.de. All fields typed and schema-versioned.

skuin_stockstock_leveldelivery_time_dayswarehouse_locationshipping_costclick_and_collect_eligiblerestock_datescraped_at
stock_& delivery
● 200 OK
"sku": "2345678-62",
"in_stock": true,
"stock_level": 4500,
"delivery_time_days": "1-2",
"warehouse_location": "Wernberg-Koblitz",
"shipping_cost": 5.95,
"click_and_collect_eligible": true,
"scraped_at": "2026-05-12T09:14:00Z"
# skuin_stockstock_leveldelivery_time_dayswarehouse_locationshipping_cost
1
2
3

Complete list of extractable fields for Marketplace Sellers objects from conrad.de. All fields typed and schema-versioned.

skuseller_nameseller_idseller_ratingseller_price_netseller_price_grossdelivery_timereturn_policyis_conrad_fulfilled
marketplace_sellers
● 200 OK
"sku": "2345678-62",
"seller_name": "Elektronik-Partner GmbH",
"seller_id": "SEL-8921",
"seller_rating": 4.7,
"seller_price_net": 0.48,
"is_conrad_fulfilled": false,
"delivery_time": "3-4 days"
# skuseller_nameseller_idseller_ratingseller_price_netseller_price_gross
1
2
3

Complete list of extractable fields for Categories & Search objects from conrad.de. All fields typed and schema-versioned.

keywordcategory_idpositionskutitlebase_priceratingreview_countis_promotedscraped_at
categories_& search
● 200 OK
"keyword": "555 timer ic",
"category_id": "c17305",
"position": 1,
"sku": "2345678-62",
"base_price": 0.54,
"rating": 4.9,
"review_count": 124,
"is_promoted": false
# keywordcategory_idpositionskutitlebase_price
1
2
3

Capabilities

Industrial data extraction without the overhead

Our Conrad.de scraper handles B2B pricing toggles, dynamic stock hydration, and complex technical attribute mapping, delivering clean data ready for procurement analysis.

MPN & EAN Matching

Extract Manufacturer Part Numbers and European Article Numbers for exact cross-referencing against your internal BOMs.

Tiered Pricing Extraction

Capture base prices alongside volume discount tiers, distinguishing between net B2B and gross B2C pricing.

Stock Level Monitoring

Track exact inventory counts, warehouse locations, and estimated delivery windows across the European supply chain.

Datasheet PDF Links

Scrape direct URLs to manufacturer datasheets, safety instructions, and RoHS/REACH compliance certificates.

Marketplace Intelligence

Monitor third-party sellers on the Conrad Marketplace, capturing competitor pricing, ratings, and fulfilment methods.

Deep Technical Attributes

Parse nested technical specifications into structured key-value pairs, normalising measurements and package types.

Search Rank Tracking

Monitor organic and promoted positions for specific components across critical category pages and search terms.

Alternative Part Suggestions

Extract Conrad's suggested alternative components and accessories for supply chain contingency planning.

Scheduled Diffs

Run pipelines at daily or hourly cadences, delivering only records that have changed since the last execution.

// engagement pipeline

From component list to warehouse record

Brief in. Clean data out.

Define Scope
d 0

Provide SKUs, MPNs, category URLs, or search terms. We design the extraction schema together.

Pipeline Build
d 2–4

We configure Scrapy / Playwright crawlers, proxy rotation, and session management for conrad.de.

Validation & QA
d 4–6

Schema validation, null-rate checks, price-outlier detection, and sample data before full launch.

Delivery
ongoing

JSON / CSV / Parquet pushed to your S3 bucket, BigQuery dataset, or Snowflake stage on agreed cadence.

Under the hood

How our Conrad.de pipeline handles the hard parts

Scraping industrial distributors requires more than basic HTTP requests. Here is how we maintain resilient extraction.

pipeline-monitor · conrad.de · live ● active
// fingerprinting
Identity rotation
TLS fingerprintrandomised
User-agentrotated
IP poolresidential
Challenges blocked0
// pagination
Page coverage
48,291 pages queued running
// observability
Pipeline health
99.9%
uptime
142ms
p99 lat
0.3%
null rate
2
alerts
Dynamic stock hydration
JavaScript rendering for inventory levels

Conrad loads live stock levels and delivery estimates via asynchronous JavaScript after the initial page load. We use Playwright to execute these scripts, ensuring inventory data is captured accurately rather than relying on stale HTML placeholders.

B2B vs B2C context
Session state management

Pricing on Conrad.de changes based on the user session (net vs gross, business vs consumer). We manage strict cookie and header states to ensure the pipeline consistently extracts the correct pricing context for your use case.

Attribute parsing
Normalising technical specifications

Electronic components have dozens of technical attributes (voltage, package type, tolerance) displayed in complex tables. Our parsers normalise these into structured JSON objects, handling unit variations and missing fields gracefully.

Anti-bot layer
Localised proxy rotation

We route requests through German residential proxies to avoid geolocation blocks and rate limiting, mimicking standard enterprise procurement traffic patterns.

Change detection
Only re-scrape what has changed

For massive component catalogues, we maintain a hash index of last-seen values per SKU. Subsequent runs only push diffs, reducing compute cost and downstream processing load.

Applications

Who uses Conrad.de data - and how

Teams across industries use conrad.de data to build competitive products and smarter operations.

01
Procurement Intelligence

Purchasing teams monitor price fluctuations across millions of SKUs to optimise buying cycles and negotiate better terms.

02
Competitor Price Matching

Other distributors track Conrad's pricing tiers and marketplace offers to adjust their own pricing algorithms.

03
Supply Chain Forecasting

Manufacturers monitor component availability and delivery times to predict potential production bottlenecks.

04
BOM Cost Estimation

Engineering teams automatically match internal Bill of Materials against current market prices for real-time project costing.

05
Assortment Gap Analysis

Retailers analyse Conrad's category depth and new product additions to identify missing lines in their own catalogues.

06
Distributor Margin Tracking

Brands monitor how their products are priced across tiers to enforce MAP policies and understand distributor margins.

Why DataFlirt

"Conrad.de holds the definitive European catalogue for electronic components, but extracting tiered pricing and technical specs requires precision infrastructure."

Scraping industrial distributors demands more than simple scripts. You need JavaScript rendering for dynamic stock levels, session handling for B2B pricing toggles, and structured parsing for thousands of nested technical attributes. DataFlirt builds and maintains this pipeline so your procurement team can focus on sourcing.

Technical Spec

Conrad.de scraper - technical capabilities

Everything supported by our conrad.de scraper — rendered SPA elements, auth walls, rate-limit evasion and beyond.

JavaScript rendering
Full Playwright sessions - required for live stock levels and delivery estimates
Supported
Residential proxy rotation
ISP-grade residential IPs from DE pools - rotated per request
Supported
MPN / EAN mapping
Extraction of standard identifiers for cross-referencing
Supported
Tiered pricing capture
Extracts all volume discount tiers and base prices
Supported
Datasheet PDF links
Direct URLs to manufacturer documentation and safety sheets
Supported
Change detection (diffs)
Hash-based diff: only emit records with changed fields since last run
Supported
Webhook delivery
HTTP POST per record or batch - useful for real-time inventory alerts
Supported
Custom negotiated B2B terms
Pricing specific to individual corporate accounts requiring login
Partial
Account-specific procurement history
Past orders and invoices tied to a specific user account
Partial
Infrastructure

Infrastructure powering the Conrad pipeline

Open-source tooling on proven cloud infra — no vendor lock-in, full observability.

ScrapyPlaywrightPython 3.12RedisPostgreSQLApache AirflowAWS LambdaS3CloudWatch2CaptchaCapSolverResidential ProxiesDockerKubernetesGrafanaPrometheus
Scrapy + Playwright Stack

Scrapy handles crawl orchestration, deduplication, and retry logic. Playwright handles JavaScript rendering and session toggles. Combined via scrapy-playwright middleware.

Localised Proxy Infrastructure

We maintain pools of residential ISP proxies in Germany. Rotation happens per-request with sticky sessions to maintain consistent pricing context.

Cloud-Native Orchestration

Pipelines run on AWS Lambda (burst) and ECS (sustained). Airflow handles scheduling, dependency management, and SLA alerting. All state stored in managed Postgres.

Output & Delivery

Your data, your destination

Data delivered to where your team already works — no new tooling required.

JSON
Newline-delimited or nested - schema versioned per run
CSV
Flat file with typed columns - Excel/Sheets compatible
XLS
Excel format for direct procurement team usage
Parquet
Columnar format for BigQuery, Snowflake, Athena
AWS S3
Direct bucket delivery - compatible with any data lake
Webhook
HTTP POST per record for real-time downstream processing
API
REST endpoint to query latest extracted component data
BigQuery
Streamed directly into your dataset with schema auto-detect
S3
Direct bucket delivery — compatible with any data lake
// faq

Common questions.

About conrad.de scraping, legality, and pipeline operations.

Ask us directly →
Is scraping Conrad.de legal?

Scraping publicly available information from Conrad.de is generally permissible under applicable law. DataFlirt targets only public, non-authenticated product, pricing, and stock data. We do not extract personal data or circumvent authentication walls. Clients should review Conrad's terms and consult legal counsel for specific use cases.

How do you handle B2B vs B2C pricing?

Conrad displays different pricing based on user session context. We configure our crawlers with strict session management to maintain either a B2B (net pricing) or B2C (gross pricing) state, ensuring the data matches your specific requirements.

Can you match my internal BOMs to Conrad SKUs?

Yes. If you provide a list of Manufacturer Part Numbers (MPNs) or European Article Numbers (EANs), we can configure the pipeline to search and map these to the corresponding Conrad SKUs, returning exact pricing and stock levels.

How fresh is the stock and availability data?

For targeted SKU lists, we can run pipelines at hourly cadences to capture near real-time stock fluctuations. Full category refreshes typically run daily during off-peak hours.

Do you extract data from third-party sellers on the Conrad Marketplace?

Yes. When a component has multiple offers, we extract the primary buybox winner as well as all alternative marketplace sellers, including their specific pricing, delivery times, and ratings.

Can I request a sample dataset before committing?

Absolutely. We provide a sample run of up to 500 SKUs or specific search terms as part of the pre-engagement scoping process, allowing you to validate schema fit and data quality before signing any contract.

$ dataflirt scope --new-project --source=conrad.de ready

Tell us what
to extract.
We do the rest.

20-minute scoping call. Pilot dataset within the week. Production within two. Whether you need a one-off component catalogue dump or a continuous price-monitoring feed across 500K SKUs, we scope, build, and operate the pipeline. Tell us what you need.

hello@dataflirt.com · Bengaluru · IST · typical reply < 4h
Related Scrapers

More in industrial and mro

Services

Data Extraction for Every Industry

View All Services →