SYSTEM all green source idealo.de queue 34,192 pages p99 latency 159ms dataflirt.com · scraper/idealo-de
RUN · 147 active pipelines · idealo.de live

Idealo data,
at warehouse scale.

We extract cross-merchant product pricing, deal scores, merchant ratings, shipping costs, price history signals, and category rankings from Idealo — Europe's leading price comparison platform. Delivered as clean JSON, CSV, or Parquet to S3, BigQuery, or Snowflake on your cadence.

Products tracked
2.2M /day
Price comparisons
14.8M /24h
Merchant records
890K /run
Active pipelines
147
Uptime
99.96%
Data Dictionary

Every field we extract from idealo.de

Structured, schema-consistent data across all major object types — delivered clean, typed, and ready to query.

Complete list of extractable fields for Product Overview objects from idealo.de. All fields typed and schema-versioned.

product_idtitlebrandcategorysub_categoryeanmodel_numberbest_priceprice_range_lowprice_range_highcurrencymerchant_countdeal_scoredeal_labelidealo_ratingreview_counteco_scoreis_refurbished_availablespecificationsimage_urlsproduct_urlscraped_at
product_overview
● 200 OK
"product_id": "ide_prod_84291047",
"title": "Apple iPhone 16 Pro 256GB Desert Titanium",
"brand": "Apple",
"ean": "0195949469268",
"best_price": 1099.00,
"price_range_low": 1099.00,
"price_range_high": 1249.00,
"currency": "EUR",
"merchant_count": 41,
"deal_score": 82,
"deal_label": "Sehr günstig"
# product_idtitlebrandcategorysub_categoryean
1
2
3

Complete list of extractable fields for Merchant Comparisons objects from idealo.de. All fields typed and schema-versioned.

product_idmerchant_namemerchant_urlmerchant_ratingmerchant_review_countpricecurrencyshipping_costtotal_priceshipping_estimate_daysreturn_dayspayment_methodsidealo_direct_purchaseconditionprice_timestamp
merchant_comparisons
● 200 OK
"product_id": "ide_prod_84291047",
"merchant_name": "MediaMarkt",
"merchant_rating": 4.2,
"price": 1099.00,
"shipping_cost": 0.00,
"total_price": 1099.00,
"return_days": 30,
"idealo_direct_purchase": true,
"condition": "Neu"
# product_idmerchant_namemerchant_urlmerchant_ratingmerchant_review_countprice
1
2
3

Complete list of extractable fields for Price History objects from idealo.de. All fields typed and schema-versioned.

product_iddatebest_pricemerchant_countdeal_scorecurrencyprice_sourceis_all_time_lowpct_above_all_time_low
price_history
● 200 OK
"product_id": "ide_prod_84291047",
"date": "2026-05-12",
"best_price": 1099.00,
"merchant_count": 41,
"deal_score": 82,
"is_all_time_low": false,
"pct_above_all_time_low": 4.2
# product_iddatebest_pricemerchant_countdeal_scorecurrency
1
2
3

Complete list of extractable fields for Category Rankings objects from idealo.de. All fields typed and schema-versioned.

category_pathpositionproduct_idtitlebrandbest_pricecurrencymerchant_countdeal_scoreidealo_ratingis_bestsellerscraped_at
category_rankings
● 200 OK
"category_path": "Handys & Telefonie > Handys > Apple",
"position": 1,
"product_id": "ide_prod_84291047",
"best_price": 1099.00,
"deal_score": 82,
"is_bestseller": true,
"scraped_at": "2026-05-12T08:00:00Z"
# category_pathpositionproduct_idtitlebrandbest_price
1
2
3

Capabilities

Everything you need from Idealo — nothing you don't

Idealo is Europe's leading price comparison platform — aggregating pricing from thousands of merchants across Germany, the UK, France, Spain, Italy, and Austria. Our scraper captures the full competitive picture: cross-merchant pricing, deal scores, price history, merchant ratings, shipping costs, and category rankings.

Cross-Merchant Price Aggregation

For any product, capture every merchant's price, shipping cost, total landed cost, return policy, and merchant rating — the complete competitive pricing landscape in a single structured record.

Price History Signal Extraction

Idealo surfaces price history data per product. We scrape best-price time-series, all-time-low flags, and deal score progression — building historical price context from day one of your pipeline.

Deal Score Intelligence

Idealo's proprietary deal score (1–100) signals how good a current price is relative to history. We capture deal score, deal label (Sehr günstig / Günstig), and all-time-low proximity per product per run.

Merchant Rating Data

Merchant name, Idealo rating, review count, Idealo Direct Purchase status, and return policy — for every merchant offering per product.

Shipping Cost Aggregation

Per-merchant shipping cost and estimated delivery days captured alongside product price — enabling true total-cost comparison across the merchant set.

Eco Score Capture

Idealo's eco score per product — an environmental impact rating surfaced on electronics and appliances — extracted for sustainability research and ESG-focused product analysis.

New vs Refurbished Pricing

Capture new and refurbished merchant offers separately — with condition labels in German and English — for secondary market price comparison and circular economy research.

Multi-Country Coverage

idealo.de, idealo.co.uk, idealo.fr, idealo.es, idealo.it, idealo.at — all from a unified schema with currency normalisation and country-tagged merchant records.

Scheduled + Streaming Modes

One-off cross-merchant price snapshots or continuous deal score monitoring at hourly, daily, or real-time cadences with change-detection diffing.

// engagement pipeline

From product ID to warehouse record

Brief in. Clean data out.

Define Scope
d 0

Provide product IDs, EANs, category paths, brand lists, or keyword sets. Specify target Idealo country sites.

Pipeline Build
d 2–4

We configure Scrapy / Playwright crawlers with German/European residential proxies, locale headers, and CAPTCHA handling for idealo.de.

Validation & QA
d 4–6

Merchant coverage audits, deal score null-rate checks, price history completeness validation, and sample records before full launch.

Delivery
ongoing

JSON / CSV / Parquet pushed to your S3 bucket, BigQuery dataset, or Snowflake stage on agreed cadence.

Under the hood

How our Idealo pipeline handles the hard parts

Price comparison platforms require breadth — thousands of product-merchant combinations per run — and precision: deal scores, price history, and shipping costs that vary by merchant and product in real time.

pipeline-monitor · idealo.de · live ● active
// fingerprinting
Identity rotation
TLS fingerprintrandomised
User-agentrotated
IP poolresidential
Challenges blocked0
// pagination
Page coverage
48,291 pages queued running
// observability
Pipeline health
99.9%
uptime
142ms
p99 lat
0.3%
null rate
2
alerts
German residential proxies
DE IP pool for geo-authentic merchant sets and pricing

Idealo serves country-specific merchant sets, pricing, and availability — German results differ from UK or French results for the same product. Our pipeline uses German ISP residential proxies for idealo.de, UK proxies for idealo.co.uk, and so on — ensuring your merchant comparison data reflects what consumers in each country actually see.

Deal score extraction
Idealo's proprietary price evaluation signal

Idealo's deal score (1–100) and deal label (Sehr günstig, Günstig, etc.) are computed per product based on price history — they signal how good a current price is relative to its historical range. We capture both the numeric score and the label per product per run, enabling deal-quality monitoring and alerting across your product watchlist.

Merchant list pagination
All merchants captured, not just the top three

Idealo's merchant comparison pages paginate beyond the initial display. Our Playwright pipeline loads the full merchant list — capturing every merchant, their price, shipping cost, and rating — rather than only the top-ranked offers that naive scrapers return.

Price history capture
Historical price context from Idealo's own graph data

Idealo surfaces price history charts per product. Our pipeline extracts the underlying price history data — best price per day, merchant count, and deal score progression — building time-series history from the moment your pipeline starts and complementing it with Idealo's own historical graph where accessible.

Monitoring & alerting
24/7 pipeline health with anomaly detection

Every run emits structured logs to our observability stack. We alert on merchant coverage drops, deal score null-rates, price history completeness failures, and schema drift — and respond before you notice. SLA uptime is contractual, not aspirational.

Applications

Who uses Idealo data — and how

Teams across industries use idealo.de data to build competitive products and smarter operations.

01
European Price Intelligence & Repricing

Brands and merchants selling through European retailers monitor Idealo's cross-merchant pricing to reprice competitively, detect MAP violations, and track their own deal score positioning.

02
Merchant & Retailer Competitive Analysis

European retailers use Idealo data to map which competitors are present on the platform, their pricing relative to market best price, and their merchant rating trajectory over time.

03
Deal Score & Promotional Timing Research

Brand teams use Idealo's deal score as a guide for promotional timing — understanding when their products are algorithmically labelled as 'Sehr günstig' and how that designation correlates with click-through and conversion.

04
Consumer Electronics Market Research

Analysts use Idealo's category rankings, merchant count per product, and price range spreads to assess market saturation, brand penetration, and retailer concentration in German and European electronics markets.

05
AI Training Data

ML teams use Idealo product specifications, cross-merchant price tables, and deal score data to train European market pricing models, cross-lingual product matching engines, and deal detection classifiers.

06
Sustainability & Eco Score Research

ESG researchers and sustainability teams use Idealo's eco score data — surfaced on electronics and appliances — to assess the environmental impact profile of product categories sold through European retail channels.

Why DataFlirt

"Idealo is the price comparison layer that sits between European consumers and every major retailer — and its deal scores, merchant ratings, and price history data are the richest competitive pricing intelligence available for the European market."

Reliable Idealo scraping requires German and European residential proxies, full merchant list pagination, deal score extraction, price history capture, and daily selector maintenance across six country domains. DataFlirt absorbs that complexity so your European pricing and commercial teams get clean, complete data — without building and maintaining a six-country scraping stack.

Technical Spec

Idealo scraper — technical capabilities

Everything supported by our idealo.de scraper — rendered SPA elements, auth walls, rate-limit evasion and beyond.

JavaScript rendering
Full Playwright sessions — required for merchant lists, price history panels, and deal scores
Supported
CAPTCHA bypass
Automated 2Captcha + CapSolver integration with fallback to manual queue
Supported
European residential proxies
ISP-grade DE/UK/FR/ES/IT residential IPs — geo-targeted per Idealo country domain
Supported
Deal score extraction
Numeric deal score (1–100) and deal label per product per run
Supported
Full merchant list capture
All merchants paginated — not just the top three displayed by default
Supported
Shipping cost per merchant
Per-merchant shipping cost and estimated delivery days captured alongside product price
Supported
Price history capture
Historical best price, merchant count, and deal score from Idealo's graph data
Supported
All-time-low detection
All-time-low flag and pct above all-time-low calculated per product
Supported
Eco score extraction
Idealo eco score per product where surfaced — electronics and appliances
Supported
Refurbished offer capture
New vs refurbished merchant offers captured separately with condition labels
Supported
Multi-country coverage
idealo.de, .co.uk, .fr, .es, .it, .at — unified schema with currency normalisation
Supported
Idealo account-gated data
Personalised watchlist alerts and purchase history require authenticated Idealo sessions
Partial
Infrastructure

Infrastructure powering the Idealo pipeline

Open-source tooling on proven cloud infra — no vendor lock-in, full observability.

ScrapyPlaywrightPython 3.12RedisPostgreSQLApache AirflowAWS LambdaS3CloudWatch2CaptchaCapSolverEU Residential ProxiesDockerKubernetesGrafanaPrometheus
Scrapy + Playwright Stack

Scrapy handles crawl orchestration, deduplication, and retry logic. Playwright handles Idealo's JavaScript-rendered merchant list pagination, price history panels, and deal score widgets.

European Residential Proxy Infrastructure

We maintain pools of ISP residential proxies across DE, UK, FR, ES, IT, and AT — geo-targeted to the correct Idealo country domain for each pipeline. Rotation happens per-request with IP score monitoring.

Cloud-Native Orchestration

Pipelines run on AWS Lambda (burst) and ECS (sustained). Airflow handles scheduling, dependency management, and SLA alerting. All state stored in managed Postgres.

Output & Delivery

Your data, your destination

Data delivered to where your team already works — no new tooling required.

JSON
Newline-delimited or nested — schema versioned per run
CSV
Flat file with typed columns — Excel/Sheets compatible
Parquet
Columnar format for BigQuery, Snowflake, Athena
S3
Direct bucket delivery — compatible with any data lake
BigQuery
Streamed directly into your dataset with schema auto-detect
Webhook
HTTP POST per record for real-time downstream processing
Postgres
Upsert into your existing schema with conflict resolution
Snowflake
Stage + COPY INTO workflow — incremental or full-replace
// faq

Common questions.

About idealo.de scraping, legality, and pipeline operations.

Ask us directly →
Is scraping Idealo legal?

Scraping publicly available product, pricing, and merchant data from Idealo is generally permissible under applicable law in Germany and the EU — consistent with the hiQ v. LinkedIn ruling and similar international precedents. DataFlirt targets only public, non-authenticated comparison data. We do not extract personal data, circumvent authentication walls, or violate GDPR. We recommend clients review Idealo's ToS independently and consult legal counsel for specific use cases.

Which Idealo country sites do you support?

We support idealo.de, idealo.co.uk, idealo.fr, idealo.es, idealo.it, and idealo.at — all from a unified schema with country-tagged merchant records and currency normalisation. Each domain is accessed using residential proxies from the corresponding country.

Can you capture Idealo's deal score and deal label?

Yes. Idealo's numeric deal score (1–100) and deal label (Sehr günstig, Günstig, Normal, Teuer) are captured per product per run. These are among the most distinctive signals on the platform — computing a price's attractiveness relative to its own history — and are a key input for deal monitoring and promotional timing decisions.

Do you capture all merchants, or just the top-ranked ones?

We capture all merchants on the comparison page — including those hidden behind 'Show all X offers' pagination. This is a critical distinction: Idealo's default display shows only the top three or four merchant offers, but the full merchant set contains the complete competitive pricing picture.

Can you extract price history data from Idealo?

Yes. Idealo surfaces price history chart data per product. We extract the underlying time-series — best price per day, merchant count, and deal score — building historical price context from your pipeline start date and complementing it with Idealo's own historical graph data where accessible.

Can you capture shipping costs per merchant?

Yes. Per-merchant shipping cost and estimated delivery days are captured alongside the product price in every merchant record — enabling true total-landed-cost comparison rather than just the headline offer price.

What's the minimum viable engagement?

Our smallest packages start at a defined product list (typically 1,000–15,000 products) with daily delivery across a target Idealo country site. For multi-country European programmes or deal score monitoring at hourly cadences, we price based on product volume and frequency.

Can I request a sample dataset before committing?

Absolutely. We provide a sample run of up to 200 products with full merchant comparisons, deal scores, and price history as part of the pre-engagement scoping process — so you can validate merchant coverage depth and schema fit before signing any contract.

$ dataflirt scope --new-project --source=idealo.de ready

Tell us what
to extract.
We do the rest.

20-minute scoping call. Pilot dataset within the week. Production within two. Whether you need a European cross-merchant price monitor, deal score tracking across 50K products, or a full merchant comparison dataset — we scope, build, and operate the pipeline.

hello@dataflirt.com · Bengaluru · IST · typical reply < 4h
Services

Data Extraction for Every Industry

View All Services →