SYSTEM all green source nrc.nl queue 12,408 URLs p99 latency 218ms dataflirt.com · scraper/nrc-nl
RUN : 41 active pipelines : nrc.nl live

NRC article data,
at warehouse scale.

We extract news articles, author metadata, opinion pieces, and financial reporting from nrc.nl. Delivered as clean JSON, CSV, or Parquet to S3, BigQuery, or Snowflake on your cadence.

Articles extracted
4,892 /day
Author profiles
840 /run
Metadata updates
18.2K /24h
Active pipelines
41
Uptime
99.94%
Data Dictionary

Every field we extract from nrc.nl

Structured, schema-consistent data across all major object types — delivered clean, typed, and ready to query.

Complete list of extractable fields for Articles objects from nrc.nl. All fields typed and schema-versioned.

urlheadlinesubheadlineauthorpublish_dateupdate_datebody_texttagscategoryis_premium
articles
● 200 OK
"url": "https://www.nrc.nl/nieuws/2026/05/12/example-article",
"headline": "Dutch economy shows signs of recovery",
"author": "Jeroen Bos",
"publish_date": "2026-05-12T08:30:00Z",
"category": "Economie",
"is_premium": true
# urlheadlinesubheadlineauthorpublish_dateupdate_date
1
2
3

Complete list of extractable fields for Authors objects from nrc.nl. All fields typed and schema-versioned.

author_idnameprofile_urlrolearticle_countlatest_article_urltwitter_handlebiodepartment
authors
● 200 OK
"author_id": "auth_8492",
"name": "Jeroen Bos",
"role": "Financial Reporter",
"article_count": 412,
"twitter_handle": "@jeroenbos_nrc",
"bio": "Covers macroeconomics and Dutch financial markets."
# author_idnameprofile_urlrolearticle_countlatest_article_url
1
2
3

Complete list of extractable fields for Frontpage News objects from nrc.nl. All fields typed and schema-versioned.

positionheadlineurlsectiontimestampis_breakingimage_urlsummaryread_time_minutes
frontpage_news
● 200 OK
"position": 1,
"headline": "Elections yield unexpected coalition",
"section": "Politiek",
"is_breaking": true,
"summary": "The formation of the new cabinet took an unexpected turn yesterday.",
"timestamp": "2026-05-12T09:15:22Z"
# positionheadlineurlsectiontimestampis_breaking
1
2
3

Complete list of extractable fields for Podcasts objects from nrc.nl. All fields typed and schema-versioned.

episode_idtitleshow_namedurationpublish_dateaudio_urldescriptionguest_namesfile_size_mb
podcasts
● 200 OK
"episode_id": "pod_1029",
"title": "De Dag: The future of energy",
"show_name": "NRC Vandaag",
"duration": "24:15",
"publish_date": "2026-05-11T06:00:00Z",
"audio_url": "https://audio.nrc.nl/vandaag/ep1029.mp3"
# episode_idtitleshow_namedurationpublish_dateaudio_url
1
2
3

Complete list of extractable fields for Opinion & Columns objects from nrc.nl. All fields typed and schema-versioned.

columnist_nameheadlineurlpublish_datetopicbody_textrelated_articlescomment_countsentiment_flag
opinion_& columns
● 200 OK
"columnist_name": "Caroline de Gruyter",
"headline": "Europe must find its own voice",
"topic": "Europa",
"publish_date": "2026-05-10T14:00:00Z",
"url": "https://www.nrc.nl/nieuws/2026/05/10/europe-column",
"comment_count": 142
# columnist_nameheadlineurlpublish_datetopicbody_text
1
2
3

Capabilities

Everything you need from NRC, nothing you do not

Our NRC scraper handles every layer of the platform: article extraction, author mapping, paywall detection, and cookie consent bypass. We deliver clean text ready for NLP pipelines.

Full Article Extraction

Headline, subheadline, author, body text, and publication dates scraped cleanly.

Paywall Detection

Accurately flags premium content versus free articles without triggering block rules.

Author Tracking

Maps journalists to their entire publication history across the nrc.nl domain.

Metadata Normalisation

Extracts and structures tags, categories, and internal link graphs.

Cookie Wall Bypass

Handles European GDPR consent banners automatically via Playwright sessions.

Podcast & Media Data

Captures embedded audio links, episode descriptions, and runtime metrics.

Frontpage Monitoring

Tracks article positioning and duration on the main landing page.

Scheduled Operations

Runs at hourly or daily cadences to capture breaking news.

Clean Text Output

Strips HTML boilerplate, ads, and navigation elements from the article body.

// engagement pipeline

From URL list to warehouse record

Brief in. Clean data out.

Define Scope
d 0

Provide category URLs, author profiles, or keyword sets. We design the extraction schema.

Pipeline Build
d 2–4

We configure Scrapy crawlers, proxy rotation, and cookie consent handlers for nrc.nl.

Validation & QA
d 4–6

Schema validation, null-rate checks, and article body formatting tests before launch.

Delivery
ongoing

JSON, CSV, or Parquet pushed to your S3 bucket or warehouse on agreed cadence.

Under the hood

How our NRC pipeline handles the hard parts

Media extraction requires sophisticated session management. Here is how we bypass blocks and deliver clean text.

pipeline-monitor · nrc.nl · live ● active
// fingerprinting
Identity rotation
TLS fingerprintrandomised
User-agentrotated
IP poolresidential
Challenges blocked0
// pagination
Page coverage
48,291 pages queued running
// observability
Pipeline health
99.9%
uptime
142ms
p99 lat
0.3%
null rate
2
alerts
Cookie banners
Automated GDPR consent handling

nrc.nl enforces strict GDPR consent walls. We manage session cookies and accept-states via Playwright to ensure uninterrupted access to article content.

Paywall logic
Accurate premium content flagging

Differentiating between free and premium articles requires DOM inspection. We flag gated content accurately without triggering security blocks.

Anti-bot layer
Residential IP rotation

We use residential proxies and realistic browser fingerprints to prevent IP bans during high-volume archive scrapes.

Unstructured HTML
Clean text parsing

News articles contain varied formatting, embedded tweets, and images. We parse this into flat, readable text suitable for NLP models.

Change detection
Headline revision tracking

We track headline updates and article revisions over time using hash indexing, delivering a clean changelog of editorial updates.

Applications

Who uses NRC data, and how

Teams across industries use nrc.nl data to build competitive products and smarter operations.

01
Media Monitoring

Track brand mentions, PR impact, and crisis communications across Dutch journalism.

02
NLP Model Training

Feed high-quality Dutch language text into LLMs and sentiment analysis engines.

03
Financial Intelligence

Extract corporate mentions and economic reporting for algorithmic trading signals.

04
Political Analysis

Monitor election coverage, policy debates, and public sentiment trends.

05
Competitor Tracking

Analyse publication frequency, topic coverage, and author output against competing outlets.

06
Academic Research

Build historical corpuses of Dutch media narratives for sociological studies.

Why DataFlirt

"NRC provides the most rigorous journalism in the Netherlands, but turning their digital archive into a structured NLP dataset requires bypassing complex cookie walls and dynamic content rendering."

Media extraction requires more than simple HTTP requests. You need to handle aggressive cookie consent banners, detect premium paywalls accurately, and parse unstructured HTML into clean body text. DataFlirt manages proxy rotation, session state, and DOM parsing so your data science team receives clean, machine readable text ready for analysis.

Technical Spec

NRC scraper: technical capabilities

Everything supported by our nrc.nl scraper — rendered SPA elements, auth walls, rate-limit evasion and beyond.

JavaScript rendering
Full Playwright sessions required for dynamic content and images
Supported
Cookie consent bypass
Automated interaction with GDPR iframes
Supported
Residential proxy rotation
ISP-grade residential IPs from NL pools
Supported
Article revision tracking
Hash-based diffs for headline and body text changes
Supported
Author history mapping
Pagination through complete author archives
Supported
Clean text extraction
Removal of ads, sidebars, and boilerplate HTML
Supported
Premium article full text
Requires active NRC subscription credentials
Partial
User comment sections
Gated behind authenticated user sessions
Partial
Infrastructure

Infrastructure powering the NRC pipeline

Open-source tooling on proven cloud infra — no vendor lock-in, full observability.

ScrapyPlaywrightPython 3.12RedisPostgreSQLApache AirflowAWS LambdaS3CloudWatch2CaptchaCapSolverResidential ProxiesDockerKubernetesGrafanaPrometheus
Crawler Stack

Scrapy handles crawl orchestration and deduplication. Playwright handles JavaScript rendering and cookie sessions.

Proxy Infrastructure

We maintain pools of residential ISP proxies across NL regions. Rotation happens per request to avoid rate limits.

Orchestration

Pipelines run on AWS Lambda. Airflow handles scheduling and dependency management. All state stored in Postgres.

Output & Delivery

Your data, your destination

Data delivered to where your team already works — no new tooling required.

JSON
Newline-delimited JSON objects
CSV
Flat file with text columns
XLS
Excel compatible format for analysts
Parquet
Columnar format for data warehouses
AWS S3
Direct bucket delivery
Webhook
HTTP POST for real-time news alerts
API
REST endpoint for on-demand queries
BigQuery
Streamed directly into your dataset
Snowflake
Stage and COPY INTO workflow
S3
Direct bucket delivery — compatible with any data lake
// faq

Common questions.

About nrc.nl scraping, legality, and pipeline operations.

Ask us directly →
Is scraping nrc.nl legal?

Scraping public news metadata and free article text is generally permissible for non-copyright-infringing use cases. We do not bypass authentication to steal premium content.

How do you handle the premium paywall?

We extract the publicly available metadata including headline, author, summary, and tags, and flag the is_premium boolean. We do not extract gated body text.

Can you bypass the cookie consent screen?

Yes. Our Playwright instances automatically interact with the consent iframe to establish a valid session before extracting data.

How clean is the extracted article text?

We strip all advertisements, navigation elements, embedded scripts, and boilerplate HTML, returning pure paragraph text.

What is the delivery latency for breaking news?

Streaming pipelines can monitor the frontpage and RSS feeds, delivering new article payloads within 5 minutes of publication.

Can you extract historical archives?

Yes. We can paginate through author profiles and category archives to extract historical articles dating back years.

$ dataflirt scope --new-project --source=nrc.nl ready

Tell us what
to extract.
We do the rest.

20-minute scoping call. Pilot dataset within the week. Production within two. Whether you need a historical archive dump or a continuous news monitoring feed, we scope, build, and operate the pipeline. Tell us what you need.

hello@dataflirt.com · Bengaluru · IST · typical reply < 4h
Related Scrapers

More in news and media

Services

Data Extraction for Every Industry

View All Services →