SYSTEM all green source kaufland.de queue 18,492 pages p99 latency 218ms dataflirt.com · scraper/kaufland-de
RUN · 18 active pipelines · kaufland.de live

Kaufland data,
at warehouse scale.

We extract marketplace listings, FMCG pricing, seller intelligence, and availability from kaufland.de. Delivered as clean JSON, CSV, or Parquet to S3, BigQuery, or Snowflake on your cadence.

Products extracted
1.2M /day
Price updates
4.7M /24h
Seller records
112K /run
Active pipelines
18
Uptime
99.94%
Data Dictionary

Every field we extract from kaufland.de

Structured, schema-consistent data across all major object types — delivered clean, typed, and ready to query.

Complete list of extractable fields for FMCG & Groceries objects from kaufland.de. All fields typed and schema-versioned.

product_ideantitlebrandcategory_pathpricebase_pricebase_unitpfand_amountnutri_scoreingredientsallergensstock_statuskaufland_card_priceimage_urls
fmcg_& groceries
● 200 OK
"ean": "4000400085115",
"title": "K-Classic Apfelsaft naturtrüb 1l",
"brand": "K-Classic",
"price": 0.99,
"base_price": 0.99,
"base_unit": "1 l",
"pfand_amount": 0.25,
"nutri_score": "C",
"stock_status": "in_stock"
# product_ideantitlebrandcategory_pathprice
1
2
3

Complete list of extractable fields for Marketplace Listings objects from kaufland.de. All fields typed and schema-versioned.

item_idtitlemanufacturermpnconditionbuybox_pricebuybox_sellerdelivery_time_mindelivery_time_maxshipping_costenergy_labelrating_scorereview_countvariant_optionsurl
marketplace_listings
● 200 OK
"item_id": "314829104",
"title": "Bosch Serie 6 Waschmaschine",
"manufacturer": "Bosch",
"buybox_price": 499.0,
"buybox_seller": "ElektroWelt24",
"shipping_cost": 39.9,
"delivery_time_min": 2,
"delivery_time_max": 4,
"energy_label": "A"
# item_idtitlemanufacturermpnconditionbuybox_price
1
2
3

Complete list of extractable fields for Seller Data objects from kaufland.de. All fields typed and schema-versioned.

seller_idseller_namecompany_namelegal_addressvat_idreturn_policyimprintrating_percentagerating_countjoined_dateactive_offersseller_url
seller_data
● 200 OK
"seller_id": "84921",
"seller_name": "ElektroWelt24",
"company_name": "ElektroWelt24 GmbH",
"vat_id": "DE123456789",
"rating_percentage": 98.4,
"rating_count": 4192,
"active_offers": 1450,
"joined_date": "2019-11-04"
# seller_idseller_namecompany_namelegal_addressvat_idreturn_policy
1
2
3

Complete list of extractable fields for Pricing & Offers objects from kaufland.de. All fields typed and schema-versioned.

item_ideanseller_idpricelist_pricediscount_pctshipping_feetotal_priceis_buybox_winnerstock_quantitycondition_notescraped_at
pricing_& offers
● 200 OK
"item_id": "314829104",
"seller_id": "84921",
"price": 499.0,
"shipping_fee": 39.9,
"total_price": 538.9,
"is_buybox_winner": true,
"discount_pct": 15,
"scraped_at": "2026-05-12T10:15:00Z"
# item_ideanseller_idpricelist_pricediscount_pct
1
2
3

Complete list of extractable fields for Search Results objects from kaufland.de. All fields typed and schema-versioned.

keywordpositionitem_idtitlepriceis_sponsoredratingreview_countdelivery_badgeseller_nameimage_urlscraped_at
search_results
● 200 OK
"keyword": "kaffeemaschine",
"position": 3,
"item_id": "8192041",
"is_sponsored": true,
"price": 129.99,
"rating": 4.6,
"review_count": 312,
"seller_name": "Kaufland",
"scraped_at": "2026-05-12T10:16:22Z"
# keywordpositionitem_idtitlepriceis_sponsored
1
2
3

Capabilities

Extract the complete Kaufland catalogue

Our infrastructure handles location-based grocery pricing, third-party marketplace offers, and complex variant structures. We manage the session states and bot mitigation required for reliable extraction.

FMCG & Grocery Extraction

Capture base prices, Pfand amounts, ingredients, allergens, and Nutri-Score ratings for the direct retail catalogue.

Marketplace Offer Tracking

Monitor third-party sellers, buybox ownership, shipping costs, and delivery windows across millions of SKUs.

Location-Based Pricing

Simulate specific PLZ (zip code) sessions to extract regional availability and localized pricing differences.

EAN & GTIN Mapping

Extract exact product identifiers to match Kaufland inventory against competitor catalogues and internal databases.

Seller Intelligence

Aggregate seller ratings, legal imprint data, VAT IDs, and total active assortment sizes for market research.

Kaufland Card & Deals

Identify standard prices versus loyalty card discounts and track weekly promotional flyers (Prospekte) digitally.

SERP & Sponsored Ads

Track organic search rankings and identify sponsored product placements for retail media auditing.

Energy & Compliance Data

Extract EU energy efficiency labels, hazard warnings, and mandatory compliance documentation links.

Incremental Updates

Run delta extractions that only deliver records where price, stock, or buybox status has changed.

// engagement pipeline

From SKU list to warehouse record

Brief in. Clean data out.

Define Scope
d 0

Provide EANs, category URLs, or search terms. We define the extraction schema and PLZ targeting together.

Pipeline Build
d 2–4

We configure Scrapy crawlers, session management, and proxy rotation to handle Kaufland's bot protection.

Validation & QA
d 4–6

Schema validation, null-rate checks, and price-outlier detection run on sample data before launch.

Delivery
ongoing

JSON, CSV, or Parquet pushed to your S3 bucket, BigQuery dataset, or Snowflake stage on schedule.

Under the hood

Handling Kaufland's technical barriers

Extracting data from a hybrid grocery and marketplace platform requires handling complex session states and aggressive bot mitigation.

pipeline-monitor · kaufland.de · live ● active
// fingerprinting
Identity rotation
TLS fingerprintrandomised
User-agentrotated
IP poolresidential
Challenges blocked0
// pagination
Page coverage
48,291 pages queued running
// observability
Pipeline health
99.9%
uptime
142ms
p99 lat
0.3%
null rate
2
alerts
Geo-fenced sessions
PLZ-specific availability mapping

Grocery availability and delivery windows on Kaufland.de depend heavily on the user's postal code. We maintain stateful browser sessions injected with specific PLZ cookies to extract accurate regional data.

Bot mitigation
Residential IPs and fingerprinting

Kaufland employs strict bot protection. We route requests through German residential proxies and utilise Playwright to generate valid browser fingerprints, solving challenges before they block the pipeline.

Dynamic rendering
Hydrating marketplace offers

Third-party seller lists and shipping calculations are loaded asynchronously via JavaScript. Our infrastructure executes the necessary scripts to capture the complete offer stack, not just the buybox winner.

Schema normalisation
Unifying grocery and marketplace records

Kaufland's DOM structure differs significantly between fresh groceries and electronics. We normalise these disparate layouts into a single, predictable schema for your data warehouse.

Delta processing
Efficient price updates

To monitor marketplace pricing across millions of SKUs, we use hash-based diffing. The pipeline only emits records when a price, stock status, or buybox owner changes, reducing your ingest costs.

Applications

Who uses Kaufland data

Teams across industries use kaufland.de data to build competitive products and smarter operations.

01
FMCG Price Monitoring

Brands track retail prices, promotional discounts, and Kaufland Card offers to ensure pricing parity across German supermarkets.

02
Competitor Seller Tracking

Marketplace merchants monitor competitor buybox win rates, shipping fees, and stock levels to optimise their own repricing algorithms.

03
MAP Compliance

Manufacturers audit third-party sellers on the Kaufland marketplace for Minimum Advertised Price violations.

04
Assortment Analysis

Retail analysts map category depth, brand presence, and private label penetration (e.g., K-Classic) within specific segments.

05
Retail Media Auditing

Agencies track sponsored product placements and organic search share of voice for targeted keywords.

06
Demand Forecasting

Supply chain teams ingest delivery window estimates and stock status changes to model marketplace demand velocity.

Why DataFlirt

"Kaufland.de merges a massive grocery operation with a sprawling third-party marketplace, creating a highly complex but valuable pricing dataset."

Extracting data from Kaufland requires handling location-specific sessions, dynamic shipping logic, and aggressive bot mitigation. DataFlirt manages the residential proxy routing and JavaScript execution, ensuring you receive clean, normalised records without maintaining infrastructure.

Technical Spec

Kaufland scraper technical specifications

Everything supported by our kaufland.de scraper — rendered SPA elements, auth walls, rate-limit evasion and beyond.

JavaScript rendering
Playwright sessions required for asynchronous offer lists and shipping calculations
Supported
Location targeting
Session injection for specific German postal codes (PLZ)
Supported
Marketplace seller mapping
Extraction of all offers behind the buybox, including seller IDs
Supported
EAN/GTIN scraping
Capture of exact product identifiers for cross-platform matching
Supported
Pfand & Base Price
Separation of deposit amounts and calculation of price per unit (e.g., per 100g)
Supported
Change detection
Delta delivery for changed prices or stock statuses
Supported
Kaufland Card exclusive history
Personalised loyalty pricing requiring authenticated user accounts
Partial
Customer purchase history
Historical order data restricted behind user login
Partial
Delivery slot booking
Dynamic checkout slot availability requiring active cart sessions
Partial
Infrastructure

Infrastructure powering the Kaufland pipeline

Open-source tooling on proven cloud infra — no vendor lock-in, full observability.

ScrapyPlaywrightPython 3.12RedisPostgreSQLApache AirflowAWS LambdaS3CloudWatch2CaptchaCapSolverResidential ProxiesDockerKubernetesGrafanaPrometheus
Scrapy + Playwright Stack

Scrapy manages orchestration and deduplication. Playwright handles JavaScript execution and stateful PLZ sessions.

Residential Proxy Infrastructure

German ISP proxies route requests to bypass bot protection and maintain realistic geographic profiles.

Cloud-Native Orchestration

Pipelines execute on AWS Lambda and ECS, orchestrated by Airflow for strict SLA adherence.

Output & Delivery

Your data, your destination

Data delivered to where your team already works — no new tooling required.

JSON
Newline-delimited files for nested variant data
CSV
Flat tabular files for analysts and spreadsheet workflows
Parquet
Columnar storage optimised for data warehouses
S3
Direct delivery to your AWS infrastructure
BigQuery
Streamed inserts into Google Cloud
Snowflake
Automated staging and COPY INTO commands
Postgres
Direct database upserts with primary key constraints
Webhook
HTTP POST payloads for real-time price alerts
API
REST endpoints to query your extracted datasets
// faq

Common questions.

About kaufland.de scraping, legality, and pipeline operations.

Ask us directly →
Can you extract data based on specific German zip codes?

Yes. We configure our crawlers to initiate sessions using specific PLZ (postal codes) to capture accurate regional pricing, grocery availability, and delivery estimates.

Do you capture all marketplace sellers or just the buybox winner?

We extract the complete list of offers for every SKU. This includes the buybox winner as well as all alternative third-party sellers, their pricing, shipping costs, and condition notes.

How do you handle Kaufland's bot protection?

We utilize German residential proxy pools and full Playwright browser sessions to generate valid TLS fingerprints and solve challenges dynamically, ensuring uninterrupted extraction.

Can you separate the Pfand (deposit) from the item price?

Yes. Our schema normalises pricing by explicitly separating the base item price, the mandatory Pfand amount for beverages, and the calculated base price per unit.

Is it possible to track Kaufland Card promotional prices?

We extract publicly visible Kaufland Card discount prices displayed on product pages and digital flyers. However, we do not support scraping personalised offers that require account authentication.

How frequently can you update marketplace pricing?

We configure pipelines based on your requirements. Critical SKU lists can be tracked hourly for repricing algorithms, while full category sweeps typically run daily or weekly.

Do you extract EANs and GTINs for matching?

Yes. When exposed in the DOM or structured metadata, we extract exact product identifiers (EAN/GTIN) to facilitate matching against Amazon, eBay, or your internal catalogue.

$ dataflirt scope --new-project --source=kaufland.de ready

Tell us what
to extract.
We do the rest.

20-minute scoping call. Pilot dataset within the week. Production within two. Whether you need daily FMCG price monitoring or continuous marketplace seller tracking, we build and maintain the pipeline. Specify your requirements.

hello@dataflirt.com · Bengaluru · IST · typical reply < 4h
Related Scrapers

More in food drink and kitchen

Services

Data Extraction for Every Industry

View All Services →