We extract article text, author metadata, taxonomy, and publication timelines from sueddeutsche.de. Delivered as clean JSON, CSV, or Parquet to S3, BigQuery, or Snowflake on your cadence.
Structured, schema-consistent data across all major object types — delivered clean, typed, and ready to query.
Complete list of extractable fields for Article Metadata objects from sueddeutsche.de. All fields typed and schema-versioned.
"url": "https://www.sueddeutsche.de/politik/bundestagswahl-kanzlerkandidat-1.581923", "article_id": "1.581923", "headline": "Die Debatte um den Kanzlerkandidaten", "author": "Stefan Kornelius", "published_at": "2026-03-14T18:30:00Z", "section": "Politik", "is_sz_plus": false, "word_count": 842
| # | url | article_id | headline | subheadline | author | published_at |
|---|---|---|---|---|---|---|
| 1 | ||||||
| 2 | ||||||
| 3 |
Complete list of extractable fields for Full-Text Content objects from sueddeutsche.de. All fields typed and schema-versioned.
"article_id": "1.581923", "lead_paragraph": "In der Parteizentrale wächst der Druck auf die Führungsebene.", "body_text": "Es war ein langer Abend in Berlin. Die Delegierten diskutierten bis tief in die Nacht...", "quotes": "['Wir müssen jetzt Geschlossenheit zeigen.', 'Die Umfragen sind eindeutig.']", "image_urls": "['https://www.sueddeutsche.de/image/sz.1.581924']", "image_captions": "['Der Parteivorsitzende am Rednerpult in Berlin.']", "paywall_hit": false
| # | article_id | lead_paragraph | body_text | quotes | image_urls | image_captions |
|---|---|---|---|---|---|---|
| 1 | ||||||
| 2 | ||||||
| 3 |
Complete list of extractable fields for Author Profiles objects from sueddeutsche.de. All fields typed and schema-versioned.
"name": "Stefan Kornelius", "role": "Ressortleiter Politik", "profile_url": "https://www.sueddeutsche.de/autoren/stefan-kornelius-1.12345", "twitter_handle": "@skornelius", "article_count": 1432, "bio": "Leitet das Politikressort der Süddeutschen Zeitung seit 2000."
| # | author_id | name | role | profile_url | twitter_handle | |
|---|---|---|---|---|---|---|
| 1 | ||||||
| 2 | ||||||
| 3 |
Complete list of extractable fields for Taxonomy & Tags objects from sueddeutsche.de. All fields typed and schema-versioned.
"article_id": "1.581923", "primary_category": "Politik", "sub_category": "Deutschland", "tags": "['Bundestagswahl', 'Kanzlerkandidat', 'Parteitag']", "keywords": "['Berlin', 'Wahlkampf', 'Kandidatur']", "region": "National", "entities_mentioned": "['CDU', 'SPD', 'Berlin']"
| # | article_id | primary_category | sub_category | tags | keywords | region |
|---|---|---|---|---|---|---|
| 1 | ||||||
| 2 | ||||||
| 3 |
Complete list of extractable fields for Homepage Ranking objects from sueddeutsche.de. All fields typed and schema-versioned.
"feed_name": "Startseite Top-Themen", "position": 1, "article_id": "1.581923", "headline": "Die Debatte um den Kanzlerkandidaten", "scraped_at": "2026-03-15T08:00:00Z", "is_breaking": true, "promotion_type": "Hero Banner"
| # | feed_name | position | article_id | headline | scraped_at | is_breaking |
|---|---|---|---|---|---|---|
| 1 | ||||||
| 2 | ||||||
| 3 |
Our pipeline handles the complexities of German news extraction: strict cookie consent banners, SZ Plus paywall boundaries, dynamic article feeds, and regional redirects.
Lead paragraphs, body text, blockquotes, and embedded elements parsed cleanly from the DOM without HTML clutter.
Flags gated content automatically. Extracts available preview text and metadata without triggering paywall blocks.
Extract author names, roles, profile URLs, and bio information linked to each published piece.
Target specific regional feeds like München or Bayern, capturing localized news and municipal updates.
Paginate through the sueddeutsche.de /archiv to backfill historical datasets based on date ranges or topics.
Capture initial published timestamps and subsequent updated timestamps to track article revisions over time.
Extract native categories, sub-categories, and thematic tags assigned to articles by the editorial team.
Capture high-resolution image URLs, alt text, and editorial captions embedded within the article body.
Run one-off historical exports or configure continuous pipelines at hourly cadences for breaking news feeds.
Brief in. Clean data out.
Provide target sections, keywords, or date ranges. We design the extraction schema together.
We configure Playwright crawlers, German residential proxies, and CMP consent bypass logic.
Schema validation, null-rate checks, and text encoding verification before full launch.
JSON / CSV / Parquet pushed to your S3 bucket, BigQuery dataset, or Snowflake stage on agreed cadence.
German news sites deploy strict rate limits, GDPR consent walls, and dynamic paywalls. Here is how we maintain steady extraction without triggering blocks.
Sueddeutsche.de uses strict Consent Management Platforms (CMP) to enforce GDPR. Our Playwright sessions automatically negotiate these banners, accepting necessary cookies to access the DOM without triggering bot defenses.
The SZ Plus paywall dynamically truncates article bodies based on user session state. We identify the paywall injection point, flag the article as gated, and extract the available preview text and metadata without failing the scrape.
Accessing regional news or high-volume feeds from data centre IPs triggers immediate blocks or CAPTCHAs. We route requests through German residential proxies to mimic legitimate domestic readership.
Editorial teams frequently use custom layouts for long-form features or breaking news. Our selector strategy uses multiple fallback chains to ensure consistent text extraction regardless of the visual template.
News articles evolve after publication. We track the 'updated_at' timestamps and emit diffs when headlines or body text change, providing a clean changelog of editorial revisions.
Agencies track brand mentions, executive quotes, and sentiment across Germany's leading broadsheet.
AI teams ingest high-quality, editorially verified German text corpora to train language models and sentiment classifiers.
Corporations monitor industry news, regulatory announcements, and competitor coverage in the Wirtschaft section.
Quant funds correlate macroeconomic news sentiment from top-tier publications with DAX market movements.
Universities analyse political discourse, election coverage bias, and agenda-setting trends over multi-year archives.
Researchers map narrative propagation by comparing mainstream editorial coverage against fringe media sources.
"Süddeutsche Zeitung represents the definitive record of German political and economic discourse — extracting it cleanly requires navigating dynamic paywalls and strict rate limits."
Most teams underestimate the complexity of scraping top-tier German publishers. It requires localized residential proxies, precise handling of cookie consent banners (GDPR walls), and intelligent parsing of SZ Plus paywall boundaries. DataFlirt manages this infrastructure so your NLP engineers can focus on tokenisation, not DOM traversal.
Everything supported by our sueddeutsche.de scraper — rendered SPA elements, auth walls, rate-limit evasion and beyond.
Open-source tooling on proven cloud infra — no vendor lock-in, full observability.
Scrapy orchestrates the crawl and handles deduplication. Playwright manages CMP banners, cookie sessions, and infinite scroll feeds.
We route requests through German residential IPs to bypass regional rate limits and ensure access to localized content feeds.
Pipelines run on AWS Lambda and ECS. Airflow handles scheduling, dependency management, and SLA alerting. All state stored in Postgres.
Data delivered to where your team already works — no new tooling required.
About sueddeutsche.de scraping, legality, and pipeline operations.
Ask us directly →Scraping publicly available facts and headlines is generally permissible. Under the EU Copyright Directive and German UrhG, text and data mining (TDM) exceptions exist for research and commercial purposes, provided the publisher has not applied machine-readable opt-outs. DataFlirt extracts public data. Clients must ensure their downstream use case complies with copyright law.
We detect the paywall boundary dynamically. Our pipeline extracts all available metadata, the headline, and the free lead paragraph, then flags the 'is_sz_plus' field as true. We do not circumvent technical access controls to steal gated content.
Our Playwright integration automatically interacts with the Consent Management Platform (CMP) overlay, accepting the minimum required cookies to render the article DOM without triggering bot detection heuristics.
Yes. We can target the sueddeutsche.de /archiv structure to paginate through historical publications based on specific date ranges, categories, or keyword queries.
For monitored homepage feeds or specific sections, we can configure pipelines to run at sub-15-minute intervals, capturing new articles and editorial revisions as they are published.
We extract the high-resolution source URLs for embedded images, along with their editorial captions and alt text. We do not download the binary image files directly, but provide the URLs for your downstream ingestion.
20-minute scoping call. Pilot dataset within the week. Production within two. Whether you need a historical archive export or a continuous feed of breaking news articles — we scope, build, and operate the pipeline. Tell us what you need.
