SYSTEM all green source cna.com.tw queue 12,408 articles p99 latency 218ms dataflirt.com · scraper/cna-com.tw
RUN · 42 active pipelines · cna.com.tw live

Taiwan news data,
at warehouse scale.

We extract articles, breaking news, political updates, economic reports, and historical archives from cna.com.tw. Delivered as clean JSON, CSV, or Parquet to S3, BigQuery, or Snowflake on your cadence.

Articles extracted
45.2K /day
Breaking alerts
8,491 /24h
Archive records
1.2M /run
Active pipelines
42
Uptime
99.94%
Data Dictionary

Every field we extract from cna.com.tw

Structured, schema-consistent data across all major object types — delivered clean, typed, and ready to query.

Complete list of extractable fields for News Articles objects from cna.com.tw. All fields typed and schema-versioned.

article_idurlheadlinesubheadlinecontent_bodypublish_timestampupdate_timestampauthorcategorytagsimage_urls
news_articles
● 200 OK
"article_id": "202310240012",
"headline": "Taiwan export orders decline narrows in September",
"publish_timestamp": "2023-10-24T10:15:00Z",
"update_timestamp": "2023-10-24T11:02:15Z",
"author": "Pan Tzu-yu",
"category": "Economics",
"tags": "['exports', 'manufacturing', 'MOEA']",
"url": "https://focustaiwan.tw/business/202310240012"
# article_idurlheadlinesubheadlinecontent_bodypublish_timestamp
1
2
3

Complete list of extractable fields for Breaking Alerts objects from cna.com.tw. All fields typed and schema-versioned.

alert_idheadlinesummarytimestamppriority_levelcategorysource_urlrelated_tags
breaking_alerts
● 200 OK
"alert_id": "B-99281",
"headline": "Central Bank announces rate decision",
"timestamp": "2023-10-24T08:30:00Z",
"priority_level": "high",
"category": "Finance",
"source_url": "https://www.cna.com.tw/news/afe/202310240001.aspx",
"related_tags": "['Central Bank', 'Interest Rates']"
# alert_idheadlinesummarytimestamppriority_levelcategory
1
2
3

Complete list of extractable fields for Author Metadata objects from cna.com.tw. All fields typed and schema-versioned.

author_idnamerolearticle_countrecent_articlesdesk_locationcontact_emailprofile_url
author_metadata
● 200 OK
"author_id": "A-4492",
"name": "Yeh Su-ping",
"role": "Senior Political Reporter",
"desk_location": "Taipei",
"article_count": 1420,
"recent_articles": "['202310240015', '202310230088']"
# author_idnamerolearticle_countrecent_articlesdesk_location
1
2
3

Complete list of extractable fields for Categories & Tags objects from cna.com.tw. All fields typed and schema-versioned.

category_idnameparent_categoryarticle_count_24htrending_scoretop_article_urllast_updatedfeed_url
categories_& tags
● 200 OK
"category_id": "C-12",
"name": "Cross-Strait",
"parent_category": "Politics",
"article_count_24h": 45,
"trending_score": 88.5,
"last_updated": "2023-10-24T12:00:00Z",
"feed_url": "https://www.cna.com.tw/list/acn.aspx"
# category_idnameparent_categoryarticle_count_24htrending_scoretop_article_url
1
2
3

Complete list of extractable fields for Media Extraction objects from cna.com.tw. All fields typed and schema-versioned.

media_idimage_urlcaptionphotographerarticle_urlresolutionformatupload_timestamp
media_extraction
● 200 OK
"media_id": "IMG-20231024-001",
"image_url": "https://imgcdn.cna.com.tw/www/WebPhotos/1024/20231024/1024x768.jpg",
"caption": "TSMC facility in Hsinchu Science Park.",
"photographer": "CNA Photo",
"resolution": "1024x768",
"format": "image/jpeg",
"article_url": "https://www.cna.com.tw/news/afe/202310240012.aspx"
# media_idimage_urlcaptionphotographerarticle_urlresolution
1
2
3

Capabilities

Everything you need from CNA - nothing you do not

Our CNA scraper captures every layer of the publication: breaking news alerts, deep historical archives, author metadata, and categorised feeds - with proper UTF-8 encoding and anti-bot circumvention built in.

Full Article Extraction

Headline, body text, author, publish date, and update timestamps extracted cleanly without boilerplate HTML.

Real-Time Breaking News

Sub-minute polling on breaking feeds to capture high-priority alerts the moment they are published.

Historical Archive Traversal

Pagination through years of historical content to build comprehensive datasets for backtesting and research.

Traditional Chinese NLP Ready

Strict UTF-8 text normalisation ensures no mojibake or encoding corruption in your downstream models.

Metadata & Tagging

Extract internal CNA tags, categories, and related article links to map topic clusters accurately.

Media & Image Capture

High-resolution image URLs, captions, and photographer credits captured and linked to the parent article.

Author & Desk Tracking

Monitor specific reporters or regional desks to track editorial focus and coverage volume.

Cross-Strait & Geopolitics

Targeted extraction of specific political and international relations feeds for geopolitical risk modeling.

Scheduled + Streaming Modes

Run one-off historical exports or configure continuous pipelines at hourly or real-time cadences.

// engagement pipeline

From URL list to warehouse record

Brief in. Clean data out.

Define Scope
d 0

Provide target categories, historical date ranges, or keyword sets. We design the extraction schema together.

Pipeline Build
d 2–4

We configure Scrapy crawlers, proxy rotation, and encoding normalisation specifically for cna.com.tw.

Validation & QA
d 4–6

Schema validation, null-rate checks, timestamp parsing verification, and text encoding tests before full launch.

Delivery
ongoing

JSON / CSV / Parquet pushed to your S3 bucket, BigQuery dataset, or Snowflake stage on agreed cadence.

Under the hood

How our CNA pipeline handles the hard parts

News scraping requires high-frequency polling without triggering rate limits. Here is how we maintain reliable extraction.

pipeline-monitor · cna.com.tw · live ● active
// fingerprinting
Identity rotation
TLS fingerprintrandomised
User-agentrotated
IP poolresidential
Challenges blocked0
// pagination
Page coverage
48,291 pages queued running
// observability
Pipeline health
99.9%
uptime
142ms
p99 lat
0.3%
null rate
2
alerts
High-frequency polling
Managing rate limits for breaking news

To capture breaking alerts in real time, we distribute polling requests across a wide pool of Taiwanese residential IPs, preventing IP bans while maintaining sub-minute latency on critical feeds.

Pagination depth
Handling dynamic loading for archives

Older articles often require navigating through complex paginated structures and dynamic API endpoints. Our crawlers map these hidden endpoints to extract deep historical data efficiently.

Text sanitisation
Traditional Chinese UTF-8 handling

News sites frequently contain mixed encodings or invisible control characters. We apply strict normalisation rules to ensure all Traditional Chinese text is perfectly formatted for NLP ingestion.

Change detection
Tracking article updates and corrections

News articles are frequently updated after initial publication. We maintain a hash of article contents and emit diffs when headlines, bodies, or timestamps change.

Monitoring
Detecting layout changes instantly

Media sites update their CMS templates without warning. We monitor field null-rates in real time and automatically alert our engineers if a DOM change impacts data completeness.

Applications

Who uses CNA data - and how

Teams across industries use cna.com.tw data to build competitive products and smarter operations.

01
Geopolitical Risk Analysis

Firms monitor cross-strait relations, defense updates, and diplomatic statements to model regional stability.

02
Financial Market Intelligence

Quants ingest economic reports, central bank announcements, and export data to inform trading algorithms.

03
NLP & LLM Training

AI teams use clean, high-quality Traditional Chinese text corpora to train and fine-tune language models.

04
Media Monitoring & PR

Agencies track brand mentions, executive coverage, and industry sentiment across Taiwan's primary news network.

05
Supply Chain Alerting

Manufacturers monitor semiconductor industry news, energy policy changes, and infrastructure updates.

06
Academic & Policy Research

Researchers analyse historical publication trends, political discourse, and editorial shifts over time.

Why DataFlirt

"CNA is the definitive source for Taiwanese geopolitical and economic developments - but raw HTML is useless for programmatic analysis."

Most teams underestimate the investment required: reliable news scraping requires high-frequency polling, strict encoding management, proxy rotation, and real-time diffing to catch article corrections. DataFlirt absorbs that complexity so your engineers can focus on the analysis - not the infrastructure.

Technical Spec

CNA scraper - technical capabilities

Everything supported by our cna.com.tw scraper — rendered SPA elements, auth walls, rate-limit evasion and beyond.

Real-time polling
Sub-minute extraction for breaking news categories
Supported
Archive pagination
Deep traversal of historical article indexes
Supported
UTF-8 normalisation
Strict encoding sanitisation for Traditional Chinese text
Supported
Article update diffing
Detects and emits records when published articles are modified
Supported
Image URL extraction
Captures high-resolution media assets and captions
Supported
Author metadata tracking
Extracts reporter names, desks, and contact information
Supported
Category feed extraction
Maps articles to primary and secondary CNA taxonomies
Supported
Paywalled subscriber content
Premium B2B wire service data gated behind enterprise logins
Partial
Internal CNA editorial comments
CMS-level editorial notes not exposed to the public DOM
Partial
Infrastructure

Infrastructure powering the CNA pipeline

Open-source tooling on proven cloud infra — no vendor lock-in, full observability.

ScrapyPlaywrightPython 3.12RedisPostgreSQLApache AirflowAWS LambdaS3CloudWatch2CaptchaCapSolverResidential ProxiesDockerKubernetesGrafanaPrometheus
Scrapy + Playwright Stack

Scrapy handles high-throughput crawl orchestration and deduplication. Playwright renders dynamic article components and infinite-scroll archive pages.

Residential Proxy Infrastructure

We maintain pools of Taiwanese residential IPs to ensure requests appear as local reader traffic, avoiding geo-blocks and rate limits.

Cloud-Native Orchestration

Pipelines run on AWS Lambda for burst scaling during breaking news events. Airflow handles scheduling and SLA alerting.

Output & Delivery

Your data, your destination

Data delivered to where your team already works — no new tooling required.

JSON
Newline-delimited or nested - schema versioned per run
CSV
Flat file with typed columns - Excel/Sheets compatible
XLS
Legacy spreadsheet format for non-technical teams
Parquet
Columnar format for BigQuery, Snowflake, Athena
AWS S3
Direct bucket delivery - compatible with any data lake
Webhook
HTTP POST per record for real-time downstream processing
API
REST endpoint to query your extracted dataset
BigQuery
Streamed directly into your dataset with schema auto-detect
S3
Direct bucket delivery — compatible with any data lake
// faq

Common questions.

About cna.com.tw scraping, legality, and pipeline operations.

Ask us directly →
Is scraping cna.com.tw legal?

Scraping publicly available news articles is generally permissible for analysis and indexing. DataFlirt extracts only public, non-authenticated text and metadata. We do not bypass enterprise paywalls or extract proprietary internal feeds. Clients should review applicable copyright laws regarding the redistribution of scraped news content.

How do you handle rate limits during breaking news?

We distribute polling requests across a large pool of Taiwanese residential proxies. This ensures our aggregate request volume remains high while individual IP request rates stay well below CNA's blocking thresholds.

Can you extract historical archives from previous years?

Yes. We can configure pipelines to traverse historical indexes and search endpoints to extract articles dating back several years, building a complete retrospective dataset.

How fast is breaking news delivered?

For real-time pipelines, we poll specific category feeds at sub-minute intervals. Newly detected articles are processed and pushed via Webhook within seconds of publication.

Do you handle Traditional Chinese encoding correctly?

Yes. Our pipelines enforce strict UTF-8 normalisation. We strip invisible control characters and ensure the text payload is perfectly formatted for ingestion by modern NLP and LLM training pipelines.

Can I filter extraction by specific political or economic tags?

Yes. We can restrict the crawl scope to specific CNA categories, author IDs, or keyword sets, ensuring you only pay for and process the data relevant to your models.

What happens if an article is updated after publishing?

News sites frequently correct or expand articles. Our change-detection system hashes article content on each pass. If an article changes, we emit a new record with the updated payload and the new modification timestamp.

$ dataflirt scope --new-project --source=cna.com.tw ready

Tell us what
to extract.
We do the rest.

20-minute scoping call. Pilot dataset within the week. Production within two. Whether you need a one-off historical archive dump or a continuous real-time news feed - we scope, build, and operate the pipeline. Tell us what you need.

hello@dataflirt.com · Bengaluru · IST · typical reply < 4h
Related Scrapers

More in news and media

Services

Data Extraction for Every Industry

View All Services →