SYSTEM all green source politiken.dk queue 18,492 URLs p99 latency 214ms dataflirt.com · scraper/politiken-dk
RUN · 14 active pipelines · politiken.dk live

Politiken data,
at warehouse scale.

We extract full article text, author profiles, comment sections, and publication metadata from Politiken. Delivered as clean JSON, CSV, or Parquet to S3, BigQuery, or Snowflake on your cadence.

Articles extracted
4.2K /day
Comments parsed
12.4K /24h
Author profiles
842 /run
Active pipelines
14
Uptime
99.98%
Data Dictionary

Every field we extract from politiken.dk

Structured, schema-consistent data across all major object types — delivered clean, typed, and ready to query.

Complete list of extractable fields for Articles objects from politiken.dk. All fields typed and schema-versioned.

article_idurlheadlinesubheadlineauthor_namepublished_atupdated_atsectionbody_textpaywalledtagsimage_urls
articles
● 200 OK
"article_id": "9384712",
"headline": "Nye klimamål kræver massive investeringer",
"author_name": "Lars Jensen",
"published_at": "2026-03-14T08:30:00Z",
"section": "Indland",
"paywalled": true,
"tags": "['Klima', 'Politik', 'Økonomi']"
# article_idurlheadlinesubheadlineauthor_namepublished_at
1
2
3

Complete list of extractable fields for Authors objects from politiken.dk. All fields typed and schema-versioned.

author_idnameprofile_urlroletwitter_handleemailarticle_countlatest_article_datebioimage_url
authors
● 200 OK
"author_id": "auth_8472",
"name": "Lars Jensen",
"role": "Klimakorrespondent",
"twitter_handle": "@larsjensen_pol",
"article_count": 342,
"latest_article_date": "2026-03-14T08:30:00Z"
# author_idnameprofile_urlroletwitter_handleemail
1
2
3

Complete list of extractable fields for Comments objects from politiken.dk. All fields typed and schema-versioned.

comment_idarticle_iduser_nametimestamptextlikesreplies_countis_moderated
comments
● 200 OK
"comment_id": "c_993821",
"article_id": "9384712",
"user_name": "Mette Nielsen",
"timestamp": "2026-03-14T09:15:22Z",
"text": "Dette er et vigtigt skridt for fremtiden.",
"likes": 42,
"replies_count": 3
# comment_idarticle_iduser_nametimestamptextlikes
1
2
3

Complete list of extractable fields for Sections objects from politiken.dk. All fields typed and schema-versioned.

section_idsection_nameparent_sectionurltop_headlinearticle_countlast_updatedtrending_topics
sections
● 200 OK
"section_id": "sec_indland",
"section_name": "Indland",
"parent_section": "Nyheder",
"url": "https://politiken.dk/indland/",
"top_headline": "Nye klimamål kræver massive investeringer",
"last_updated": "2026-03-14T10:05:00Z"
# section_idsection_nameparent_sectionurltop_headlinearticle_count
1
2
3

Complete list of extractable fields for Search Results objects from politiken.dk. All fields typed and schema-versioned.

querypositionarticle_urlheadlinesnippetdateauthormatch_scoretype
search_results
● 200 OK
"query": "klima investering",
"position": 1,
"article_url": "https://politiken.dk/indland/art9384712/",
"headline": "Nye klimamål kræver massive investeringer",
"date": "2026-03-14",
"author": "Lars Jensen"
# querypositionarticle_urlheadlinesnippetdate
1
2
3

Capabilities

Complete news corpus extraction

Our Politiken scraper handles dynamic pagination, section hierarchies, and paywall detection, delivering clean, structured journalism data for your models and monitoring tools.

Full Article Extraction

Extract headlines, subheadlines, bylines, publication dates, and body text from both free and publicly available summary sections.

Author Metadata

Track journalist output, role designations, social handles, and publication frequency across all Politiken sections.

Paywall Flagging

Automatically detect and flag premium (Plus) content versus free-to-read articles for accurate dataset filtering.

Comment Mining

Extract user comments, timestamps, like counts, and reply threads from article discussion sections.

Tag Normalisation

Capture and structure internal Politiken tags, keywords, and category assignments for precise topical clustering.

Update Tracking

Monitor articles for post-publication edits by tracking the updated_at timestamp and comparing body text diffs.

Section Hierarchies

Map the entire site structure from top-level categories down to specific regional or topical sub-sections.

Breaking News Alerts

Configure high-frequency polls on the front page and RSS feeds to capture breaking news within minutes of publication.

Scheduled Archives

Run daily or weekly batch jobs to build historical archives of Danish news coverage and opinion pieces.

// engagement pipeline

From URL list to warehouse record

Brief in. Clean data out.

Define Scope
d 0

Provide target sections, author lists, or historical date ranges. We design the extraction schema together.

Pipeline Build
d 2–4

We configure Scrapy / Playwright crawlers, proxy rotation, and dynamic content handling for politiken.dk.

Validation & QA
d 4–6

Schema validation, null-rate checks, and paywall detection logic verification before full launch.

Delivery
ongoing

JSON / CSV / Parquet pushed to your S3 bucket, BigQuery dataset, or Snowflake stage on agreed cadence.

Under the hood

How our Politiken pipeline handles the hard parts

News sites employ dynamic rendering and strict rate limits. Here is how we maintain data flow.

pipeline-monitor · politiken.dk · live ● active
// fingerprinting
Identity rotation
TLS fingerprintrandomised
User-agentrotated
IP poolresidential
Challenges blocked0
// pagination
Page coverage
48,291 pages queued running
// observability
Pipeline health
99.9%
uptime
142ms
p99 lat
0.3%
null rate
2
alerts
Dynamic rendering
Playwright for comment sections

Politiken loads comments and certain dynamic widgets via JavaScript after the initial page load. We use Playwright to execute these scripts and capture the full DOM state.

Paywall detection
Accurate premium content flagging

We identify Politiken Plus articles via meta tags and DOM structure, ensuring your dataset accurately reflects what is publicly readable versus paywalled.

Rate limiting
Distributed crawling with DK proxies

To prevent IP bans from heavy scraping, we distribute requests across a pool of Danish residential proxies, maintaining realistic request rates.

Schema stability
Resilient selectors for news layouts

Media sites frequently run A/B tests on article layouts. Our extraction logic uses multiple fallback selectors, relying on JSON-LD structured data where available.

Update tracking
Capturing editorial changes

News articles evolve. We track publication and modification timestamps, capturing diffs when an article is significantly updated post-publish.

Applications

Who uses Politiken data — and how

Teams across industries use politiken.dk data to build competitive products and smarter operations.

01
Media Monitoring

PR firms and corporate communications teams track brand mentions, executive coverage, and crisis developments in real time.

02
NLP Training

Machine learning teams use structured Danish text corpora to train and fine-tune language models.

03
Sentiment Analysis

Financial analysts and political researchers gauge public sentiment by analysing opinion pieces and comment sections.

04
Author Tracking

Media analysts track journalist output, topic focus, and bias across different publications.

05
Competitor Analysis

Rival media organisations monitor Politiken's publishing cadence, section popularity, and paywall strategies.

06
Archival and Compliance

Institutions build searchable historical archives of Danish news for academic research and regulatory compliance.

Why DataFlirt

"Politiken represents the pulse of Danish journalism, but extracting structured historical archives requires navigating dynamic frontend frameworks and paywalls."

Most teams underestimate the investment required: reliable media scraping requires residential proxies, full JavaScript rendering for comment sections, and daily selector maintenance. DataFlirt absorbs that complexity so your engineers can focus on the analysis, not the infrastructure.

Technical Spec

Politiken scraper — technical capabilities

Everything supported by our politiken.dk scraper — rendered SPA elements, auth walls, rate-limit evasion and beyond.

JavaScript rendering
Full Playwright sessions for comments and dynamic content loading
Supported
CAPTCHA bypass
Automated 2Captcha + CapSolver integration
Supported
Residential proxy rotation
ISP-grade residential IPs from DK pools
Supported
Full text extraction
Captures complete article body for non-paywalled content
Supported
Comment pagination
Extracts all user comments and reply threads
Supported
Change detection
Identifies post-publication edits via updated_at timestamps
Supported
Premium paywalled article body
Full text of Politiken Plus articles requires active user credentials
Partial
User account settings
Extraction of private user profiles or billing data
Partial
Infrastructure

Infrastructure powering the Politiken pipeline

Open-source tooling on proven cloud infra — no vendor lock-in, full observability.

ScrapyPlaywrightPython 3.12RedisPostgreSQLApache AirflowAWS LambdaS3CloudWatch2CaptchaCapSolverResidential ProxiesDockerKubernetesGrafanaPrometheus
Scrapy + Playwright Stack

Scrapy handles crawl orchestration and deduplication. Playwright handles JavaScript rendering for dynamic comments and lazy-loaded images.

Residential Proxy Infrastructure

We maintain pools of residential ISP proxies across DK regions to prevent rate limiting and IP blocks during high-volume archival scrapes.

Cloud-Native Orchestration

Pipelines run on AWS Lambda and ECS. Airflow handles scheduling, dependency management, and SLA alerting. State is stored in Postgres.

Output & Delivery

Your data, your destination

Data delivered to where your team already works — no new tooling required.

JSON
Newline-delimited or nested
CSV
Flat file with typed columns
XLS
Excel compatible format for analysts
Parquet
Columnar format for BigQuery, Snowflake, Athena
AWS S3
Direct bucket delivery
Webhook
HTTP POST per record for real-time alerts
API
REST endpoints for on-demand queries
BigQuery
Streamed directly into your dataset
Snowflake
Stage + COPY INTO workflow
Postgres
Upsert into your existing schema
S3
Direct bucket delivery — compatible with any data lake
// faq

Common questions.

About politiken.dk scraping, legality, and pipeline operations.

Ask us directly →
Is scraping Politiken legal?

Scraping publicly available information is generally permissible. DataFlirt targets only public, non-authenticated article and metadata. We do not extract personal data beyond public bylines, circumvent authentication walls, or violate GDPR. Clients should review Politiken's ToS and consult legal counsel for specific use cases.

How do you handle Politiken Plus paywalls?

Our crawlers detect paywall metadata and DOM flags. For paywalled articles, we extract the publicly available headline, subheadline, author, and metadata, flagging the record as 'paywalled: true'. We do not bypass the paywall to access premium body text.

Can you extract historical archives?

Yes. We can configure pipelines to crawl historical sitemaps and search archives, extracting decades of available news articles subject to the same paywall restrictions.

How fresh is the breaking news data?

For breaking news monitoring, we can configure high-frequency polling on specific sections or RSS feeds, achieving sub-5-minute latency for new publications.

Do you extract user comments?

Yes. We use Playwright to render the dynamic comment sections on articles, extracting user names, timestamps, comment text, and engagement metrics.

Can I request a sample dataset?

Absolutely. We provide a sample run of up to 500 articles as part of the pre-engagement scoping process so you can validate schema fit and data quality.

$ dataflirt scope --new-project --source=politiken.dk ready

Tell us what
to extract.
We do the rest.

20-minute scoping call. Pilot dataset within the week. Production within two. Whether you need a historical archive dump or a continuous news monitoring feed — we scope, build, and operate the pipeline. Tell us what you need.

hello@dataflirt.com · Bengaluru · IST · typical reply < 4h
Related Scrapers

More in news and media

Services

Data Extraction for Every Industry

View All Services →