SYSTEM all green source globo.com queue 12,943 URLs p99 latency 318ms dataflirt.com · scraper/globo-com
RUN · 42 active pipelines · globo.com live

Globo data,
at warehouse scale.

We extract articles, live sports statistics, entertainment feeds, and multimedia metadata across the Globo network. Delivered as clean JSON, CSV, or Parquet to S3, BigQuery, or Snowflake on your cadence.

Articles extracted
48.2K /day
Sports updates
112K /24h
Comments parsed
89.4K /run
Active pipelines
42
Uptime
99.98%
Data Dictionary

Every field we extract from globo.com

Structured, schema-consistent data across all major object types — delivered clean, typed, and ready to query.

Complete list of extractable fields for G1 News Articles objects from globo.com. All fields typed and schema-versioned.

article_idurlheadlinesubheadlineauthorpublish_dateupdate_datebody_texttagsregioncategoryis_paywalled
g1_news articles
● 200 OK
"article_id": "g1-8492018",
"headline": "Copom mantém taxa Selic em 10,50% ao ano",
"author": "G1 Economia",
"publish_date": "2026-05-12T18:30:00Z",
"region": "Nacional",
"category": "Economia",
"is_paywalled": false
# article_idurlheadlinesubheadlineauthorpublish_date
1
2
3

Complete list of extractable fields for ge.globo Sports objects from globo.com. All fields typed and schema-versioned.

match_idtournamentteam_hometeam_awayscore_homescore_awaystatusminutepossession_homeshots_on_target_homeeventsvenue
ge.globo_sports
● 200 OK
"match_id": "ge-bra-1029",
"tournament": "Brasileirão Série A",
"team_home": "Flamengo",
"team_away": "Palmeiras",
"score_home": 2,
"score_away": 1,
"status": "IN_PROGRESS",
"minute": "78"
# match_idtournamentteam_hometeam_awayscore_homescore_away
1
2
3

Complete list of extractable fields for gshow Entertainment objects from globo.com. All fields typed and schema-versioned.

article_idtitleshow_namecelebrity_tagspublish_dateimage_urlsummaryengagement_countcomments_countauthor
gshow_entertainment
● 200 OK
"article_id": "gs-991823",
"title": "Resumo da novela: próximos capítulos",
"show_name": "Renascer",
"celebrity_tags": "['Marcos Palmeira', 'Juan Paiva']",
"publish_date": "2026-05-12T10:00:00Z",
"comments_count": 342
# article_idtitleshow_namecelebrity_tagspublish_dateimage_url
1
2
3

Complete list of extractable fields for Authors & Journalists objects from globo.com. All fields typed and schema-versioned.

author_idnamerolebioarticle_countrecent_articlestwitter_handleemailprofile_urldepartment
authors_& journalists
● 200 OK
"author_id": "auth-102",
"name": "Andréia Sadi",
"role": "Comentarista",
"department": "Política",
"article_count": 1420,
"twitter_handle": "@AndreiaSadi",
"profile_url": "https://g1.globo.com/autor/andreia-sadi/"
# author_idnamerolebioarticle_countrecent_articles
1
2
3

Complete list of extractable fields for Video Metadata objects from globo.com. All fields typed and schema-versioned.

video_idtitleduration_secondsviewspublish_datethumbnail_urlshow_categorytagsis_premiumembed_url
video_metadata
● 200 OK
"video_id": "vid-882319",
"title": "Gols de São Paulo 2 x 0 Corinthians",
"duration_seconds": 184,
"show_category": "Futebol",
"is_premium": false,
"publish_date": "2026-05-11T23:45:00Z"
# video_idtitleduration_secondsviewspublish_datethumbnail_url
1
2
3

Capabilities

Extract the entire Globo network

Our Globo scraper navigates the complex structure of Brazil's largest media conglomerate, handling regional subdomains, live-updating sports pages, and infinite-scroll news feeds.

Full Article Extraction

Extract headlines, body text, timestamps, author metadata, and embedded media links across G1, O Globo, and Valor Econômico.

Live Sports Tracking

Poll ge.globo match pages for real-time score updates, possession statistics, card events, and minute-by-minute commentary.

Entertainment & Pop Culture

Capture reality TV updates, soap opera summaries, and celebrity news from gshow with full tag extraction.

Infinite Scroll Hydration

Execute JavaScript to load paginated content on section fronts and author pages, ensuring no historical articles are missed.

Comment Corpus Mining

Extract user comments, upvotes, and timestamps from article pages for sentiment analysis and public opinion tracking.

Regional News Segmentation

Target specific state or city subdomains (e.g., g1.globo.com/sp) to build localized datasets.

Multimedia Metadata

Scrape video titles, durations, categories, and view counts from embedded Globoplay and ge.globo players.

High-Frequency Polling

Configure sub-minute execution schedules for breaking news alerts and live sports match tracking.

Paywall Flagging

Automatically detect and flag articles gated behind the Globo Mais subscription, extracting visible teaser content.

// engagement pipeline

From target sections to warehouse records

Brief in. Clean data out.

Define Scope
d 0

Provide G1 categories, ge.globo tournaments, or specific author profiles. We design the extraction schema together.

Pipeline Build
d 2–4

We configure Scrapy / Playwright crawlers, proxy rotation, and infinite-scroll handling for the Globo network.

Validation & QA
d 4–6

Schema validation, null-rate checks, and payload inspection before full pipeline activation.

Delivery
ongoing

JSON / CSV / Parquet pushed to your S3 bucket, BigQuery dataset, or Snowflake stage on agreed cadence.

Under the hood

How our Globo pipeline handles the hard parts

Media sites employ complex front-end frameworks and regional routing. Here is how we maintain stable extraction across the Globo ecosystem.

pipeline-monitor · globo.com · live ● active
// fingerprinting
Identity rotation
TLS fingerprintrandomised
User-agentrotated
IP poolresidential
Challenges blocked0
// pagination
Page coverage
48,291 pages queued running
// observability
Pipeline health
99.9%
uptime
142ms
p99 lat
0.3%
null rate
2
alerts
Dynamic loading
Infinite scroll execution

Globo heavily relies on infinite scroll for its news feeds and category pages. We run Playwright to simulate user scrolling, intercepting the underlying XHR requests to extract structured JSON payloads directly rather than parsing the DOM.

Geo-routing
Brazilian residential proxies

Certain video metadata and regional news content behave differently based on the visitor's IP. We route requests through Brazilian residential proxies to ensure we capture the exact content served to local audiences.

Live updates
High-frequency sports polling

For ge.globo match tracking, standard crawling is too slow. We target the specific WebSockets and background API endpoints powering the live match dashboards, achieving sub-second latency on score updates.

Content gating
Paywall boundary detection

Articles on O Globo and Valor Econômico frequently hit the Globo Mais paywall. Our pipeline detects the paywall boundary, captures the available teaser text, and flags the record as 'is_paywalled: true' to maintain dataset integrity.

Schema stability
Handling varied article layouts

A standard news article, a live blog, and an interactive feature on G1 all use different DOM structures. We maintain distinct selector chains for each article archetype, preventing null values when the editorial team uses custom layouts.

Applications

Who uses Globo data — and how

Teams across industries use globo.com data to build competitive products and smarter operations.

01
Media Monitoring & PR

Agencies track brand mentions, executive quotes, and crisis developments across all regional G1 subdomains in real time.

02
Sports Analytics

Analysts aggregate ge.globo match statistics, possession metrics, and historical performance data to feed predictive models.

03
Sentiment Analysis

Data teams extract article comments and reaction metrics to gauge public sentiment on political and economic news.

04
NLP Training Corpora

Machine learning engineers use decades of high-quality Portuguese editorial text from Globo to train regional LLMs.

05
Competitor News Aggregation

Publishers monitor G1 publishing velocity, topic coverage, and author output to benchmark their own editorial operations.

06
Regional Market Intelligence

Investors track local economic developments and infrastructure news by scraping specific state-level G1 portals.

Why DataFlirt

"Globo dictates the news and entertainment cycle for over 200 million people — but capturing that unstructured feed requires a dedicated extraction layer."

Extracting data from Globo's varied properties requires managing infinite scrolls, complex video metadata structures, and regional content variations. DataFlirt handles the heavy lifting of proxy rotation and JavaScript rendering so your analysts can focus on the underlying media signals.

Technical Spec

Globo scraper — technical capabilities

Everything supported by our globo.com scraper — rendered SPA elements, auth walls, rate-limit evasion and beyond.

JavaScript rendering
Full Playwright sessions required for interactive features and video players
Supported
Infinite scroll pagination
Automated scrolling and XHR interception for news feeds
Supported
Residential proxy rotation
BR-specific IP pools to access localized content
Supported
Real-time sports polling
High-frequency extraction of ge.globo live match APIs
Supported
Regional content routing
Targeting specific state subdomains (e.g., g1.globo.com/rj)
Supported
Article body extraction
Clean text extraction stripping ads and related-link modules
Supported
Comment section scraping
Extraction of user comments via external commenting platform APIs
Supported
Webhook delivery
HTTP POST per article for breaking news alerts
Supported
Globo Mais paywalled text
Full text of premium articles requiring a paid subscription
Partial
Globoplay premium streams
Direct download or extraction of DRM-protected video files
Partial
Infrastructure

Infrastructure powering the Globo pipeline

Open-source tooling on proven cloud infra — no vendor lock-in, full observability.

ScrapyPlaywrightPython 3.12RedisPostgreSQLApache AirflowAWS LambdaS3CloudWatch2CaptchaCapSolverResidential ProxiesDockerKubernetesGrafanaPrometheus
Scrapy + Playwright Stack

Scrapy handles crawl orchestration and deduplication. Playwright manages JavaScript execution for infinite scrolls and dynamic media embeds.

Regional Proxy Infrastructure

We maintain pools of Brazilian residential proxies to ensure accurate geo-targeting and prevent rate-limiting by Globo's CDN.

Cloud-Native Orchestration

Pipelines run on AWS Lambda for burst extraction of breaking news, managed by Airflow for strict SLA adherence.

Output & Delivery

Your data, your destination

Data delivered to where your team already works — no new tooling required.

JSON
Nested schema ideal for complex article structures
CSV
Flat file format for simple metadata exports
XLS
Excel compatible format for analyst review
Parquet
Columnar format optimized for analytical queries
AWS S3
Direct delivery to your cloud storage bucket
Webhook
Real-time HTTP POST for breaking news records
API
Queryable REST endpoints for historical data retrieval
BigQuery
Direct streaming into Google Cloud data warehouses
Snowflake
Automated staging and ingestion workflows
PostgreSQL
Direct upsert into relational database schemas
S3
Direct bucket delivery — compatible with any data lake
// faq

Common questions.

About globo.com scraping, legality, and pipeline operations.

Ask us directly →
Is scraping Globo legal?

Scraping publicly accessible news articles, sports statistics, and metadata is generally permissible. DataFlirt extracts only public data, respecting paywall boundaries. We do not bypass DRM, extract premium video content, or violate authentication mechanisms. Clients must ensure their downstream use complies with copyright laws.

How do you handle regional news variations?

G1 serves localized content via subdomains. We configure pipelines to target specific state or city endpoints, using Brazilian residential proxies to ensure the correct regional variations are served by the CDN.

Can you track live sports scores on ge.globo?

Yes. We bypass the HTML DOM and directly poll the backend APIs powering the ge.globo live match dashboards, allowing us to capture events, possession stats, and scores with sub-minute latency.

Do you extract comments from G1 articles?

Yes. We intercept the requests to Globo's third-party commenting infrastructure, extracting user handles, comment text, timestamps, and upvote metrics for sentiment analysis.

What happens when an article hits the Globo Mais paywall?

Our pipeline identifies the paywall boundary, extracts the visible headline and teaser text, and flags the record with an 'is_paywalled' boolean. We do not use compromised credentials to bypass the paywall.

How fast can you poll for breaking news?

For critical news monitoring, we configure high-frequency pipelines that poll G1 front pages every 60 seconds, delivering new article URLs and headlines via Webhook instantly.

Do you support video downloads from Globoplay?

No. We extract video metadata — titles, durations, tags, and view counts — but we do not download or extract the actual video files or bypass Globoplay DRM protections.

$ dataflirt scope --new-project --source=globo.com ready

Tell us what
to extract.
We do the rest.

20-minute scoping call. Pilot dataset within the week. Production within two. Whether you need a one-off historical news dump or a continuous live sports feed — we scope, build, and operate the pipeline. Tell us what you need.

hello@dataflirt.com · Bengaluru · IST · typical reply < 4h
Related Scrapers

More in news and media

Services

Data Extraction for Every Industry

View All Services →