SYSTEM all green source tokopedia.com queue 27,619 pages p99 latency 195ms dataflirt.com · scraper/tokopedia-com
RUN · 98 active pipelines · tokopedia.com live

Tokopedia data,
at warehouse scale.

We extract product listings, pricing signals, flash deal windows, Official Store intelligence, reviews, and search rankings from Tokopedia. Delivered as clean JSON, CSV, or Parquet to S3, BigQuery, or Snowflake on your cadence.

Products extracted
1.9M /day
Price updates
8.4M /24h
Review records
620K /run
Active pipelines
98
Uptime
99.94%
Data Dictionary

Every field we extract from tokopedia.com

Structured, schema-consistent data across all major object types — delivered clean, typed, and ready to query.

Complete list of extractable fields for Product Listings objects from tokopedia.com. All fields typed and schema-versioned.

product_idtitlebrandshop_namecategorysub_categorypriceoriginal_pricecurrencydiscount_pctin_stockstock_quantityofficial_store_badgepower_merchant_badgeratingreview_countsold_countdescriptionspecificationsimage_urlsvariation_countsku_idmin_orderweightconditionpage_url
product_listings
● 200 OK
"product_id": "883721049",
"title": "Xiaomi Redmi Note 13 Pro 5G 8/256GB Smartphone",
"brand": "Xiaomi",
"price": 3499000,
"currency": "IDR",
"discount_pct": 18,
"official_store_badge": true,
"rating": 4.9,
"review_count": 9203,
"sold_count": 31400,
"in_stock": true
# product_idtitlebrandshop_namecategorysub_category
1
2
3

Complete list of extractable fields for Pricing & Promotions objects from tokopedia.com. All fields typed and schema-versioned.

product_idpriceoriginal_pricediscount_pctflash_deal_priceflash_deal_startflash_deal_endflash_deal_stockvoucher_codevoucher_discountcashback_amountfree_shipping_eligiblego_send_eligibleprice_timestampcurrency
pricing_& promotions
● 200 OK
"product_id": "883721049",
"price": 3499000,
"original_price": 4299000,
"discount_pct": 18,
"flash_deal_price": 3199000,
"flash_deal_end": "2026-05-12T20:00:00+07:00",
"flash_deal_stock": 47,
"cashback_amount": 175000,
"price_timestamp": "2026-05-12T11:22:00Z"
# product_idpriceoriginal_pricediscount_pctflash_deal_priceflash_deal_start
1
2
3

Complete list of extractable fields for Reviews & Ratings objects from tokopedia.com. All fields typed and schema-versioned.

review_idproduct_idreviewer_nameverified_purchasestar_ratingreview_bodyreview_datehelpful_votessku_reviewedimage_urlsshop_replyshop_reply_date
reviews_& ratings
● 200 OK
"review_id": "tkp_rv_4421839",
"product_id": "883721049",
"star_rating": 5,
"verified_purchase": true,
"review_body": "Pengiriman cepat, barang original, performa mantap!",
"helpful_votes": 112,
"review_date": "2026-04-30",
"shop_reply": true
# review_idproduct_idreviewer_nameverified_purchasestar_ratingreview_body
1
2
3

Complete list of extractable fields for Shop Intelligence objects from tokopedia.com. All fields typed and schema-versioned.

shop_idshop_nameshop_urlofficial_storepower_merchantshop_scoreresponse_rateship_on_time_ratechat_response_timefollower_countactive_listings_countlocation_cityjoined_date
shop_intelligence
● 200 OK
"shop_id": "xiaomi-id-official",
"shop_name": "Xiaomi Official Store",
"official_store": true,
"power_merchant": true,
"shop_score": 98,
"response_rate": 100,
"ship_on_time_rate": 99,
"follower_count": 2140000,
"active_listings_count": 518
# shop_idshop_nameshop_urlofficial_storepower_merchantshop_score
1
2
3

Complete list of extractable fields for Search Results objects from tokopedia.com. All fields typed and schema-versioned.

keywordpositionproduct_idtitlepriceratingsold_countofficial_store_badgetopads_sponsoredfree_shipping_badgethumbnail_urlscraped_at
search_results
● 200 OK
"keyword": "smartphone 5g murah",
"position": 2,
"product_id": "883721049",
"topads_sponsored": false,
"official_store_badge": true,
"price": 3499000,
"scraped_at": "2026-05-12T11:22:18Z"
# keywordpositionproduct_idtitlepricerating
1
2
3

Capabilities

Everything you need from Tokopedia — nothing you don't

Our Tokopedia scraper handles every layer of Indonesia's largest marketplace: product listings, flash deal pricing, Official Store intelligence, review corpus, and TopAds SERP rankings.

Full Product Data Extraction

Title, specs, description, images, SKU variants, sold counts, condition, and every metadata field Tokopedia surfaces — scraped at product level with full variant mapping.

Flash Deal & Promo Tracking

Capture flash deal prices, countdown windows, stock depth, cashback amounts, voucher codes, and free-shipping eligibility — timestamped per crawl.

Official Store & Power Merchant Data

Shop score, response rate, on-time shipping rate, follower count, Official Store and Power Merchant badge status — for every shop on the platform.

Review & Rating Mining

Full review text, star ratings, helpful votes, verified purchase flags, SKU reviewed, shop replies, and review images — paginated across all review pages.

SERP & TopAds Rank Tracking

Track organic vs TopAds sponsored position for any keyword across Tokopedia — with Official Store and free-shipping badge capture.

Product Variant Mapping

Parent product to child SKU relationships with full option matrix — colour, size, storage, and any custom attribute sellers configure.

Harbolnas & Campaign Monitoring

Monitor Harbolnas (12.12), Tokopedia Birthday, and other mega-campaign price movements at the product level — with pre/during/post campaign snapshots.

Tokopedia NOW Coverage

Extract data from Tokopedia NOW (quick-commerce) listings — including express delivery eligibility, fulfilment hub, and same-day availability indicators.

Scheduled + Streaming Modes

Run one-off bulk exports or configure continuous pipelines at hourly, daily, or campaign-triggered cadences with change-detection diffing.

// engagement pipeline

From product list to warehouse record

Brief in. Clean data out.

Define Scope
d 0

Provide product ID lists, category URLs, keyword sets, or shop IDs. We design the extraction schema together.

Pipeline Build
d 2–4

We configure Scrapy / Playwright crawlers, proxy rotation, session management, and anti-bot handling for Tokopedia.

Validation & QA
d 4–6

Schema validation, null-rate checks, price-outlier detection, and sample reviews before full launch.

Delivery
ongoing

JSON / CSV / Parquet pushed to your S3 bucket, BigQuery dataset, or Snowflake stage on agreed cadence.

Under the hood

How our Tokopedia pipeline handles the hard parts

Tokopedia is Indonesia's most-visited marketplace with sophisticated bot defences. Here's how we stay resilient at scale.

pipeline-monitor · tokopedia.com · live ● active
// fingerprinting
Identity rotation
TLS fingerprintrandomised
User-agentrotated
IP poolresidential
Challenges blocked0
// pagination
Page coverage
48,291 pages queued running
// observability
Pipeline health
99.9%
uptime
142ms
p99 lat
0.3%
null rate
2
alerts
Anti-bot layer
Indonesian residential proxies with fingerprint spoofing

Tokopedia's bot detection operates on TLS fingerprints, browser headers, and IP reputation. Our crawlers use Indonesian residential ISP proxies with realistic browser fingerprints, randomised request timing, and full cookie session management.

JavaScript rendering
Full Playwright execution for dynamic content

Tokopedia product pages, flash deal countdowns, and search results are heavily JavaScript-rendered via React. We run full Playwright sessions to capture price widgets, promotion overlays, and lazy-loaded review content that HTTP clients miss entirely.

Schema stability
Resilient selectors with API intercept fallback

Tokopedia frequently deploys frontend updates. Our selector strategy uses CSS selectors, XPath, and GraphQL API intercept as fallback layers — so a DOM change doesn't break your data pipeline overnight.

Change detection
Only re-scrape what's changed

For large product catalogues, we maintain a hash index of last-seen values per field. Subsequent runs only push diffs — reducing compute cost and storage bloat. You get a clean changelog rather than full re-dumps.

Monitoring & alerting
24/7 pipeline health with anomaly detection

Every run emits structured logs to our observability stack. We alert on null-rate spikes, price outliers, schema drift, and coverage drops — and respond before you notice. SLA uptime is contractual, not aspirational.

Applications

Who uses Tokopedia data — and how

Teams across industries use tokopedia.com data to build competitive products and smarter operations.

01
Price Intelligence & Repricing

Brands and 3P sellers monitor pricing, flash deal windows, and competitor cashback promotions to reprice dynamically and protect margin across Indonesia.

02
Brand & MAP Monitoring

Brands audit unauthorised resellers and MAP violations — protecting brand equity across Indonesia's fragmented seller landscape.

03
Market Research & Category Analysis

Analysts track sold-count velocity, new entrant launches, and category growth to identify whitespace and investment opportunities in Indonesia.

04
AI Training Data

ML teams use Tokopedia datasets — including Bahasa Indonesia reviews — to train recommendation engines, sentiment models, and NLP classifiers.

05
Campaign Performance Tracking

Teams correlate Harbolnas and Tokopedia Birthday campaign price movements with sold-count spikes and revenue outcomes.

06
Investor & Analyst Due Diligence

PE firms and analysts track category leaders, shop growth curves, and review velocity to evaluate performance in Indonesia's largest marketplace.

Why DataFlirt

"Tokopedia is Indonesia's most data-rich marketplace — its 100M+ active buyers make it a goldmine for pricing signals and consumer demand intelligence."

Reliable Tokopedia scraping requires Indonesian residential proxies, Playwright rendering for React-heavy pages, GraphQL API intercept, and continuous selector maintenance. DataFlirt operates managed pipelines that absorb all of this complexity — delivering clean, schema-stable data on your cadence.

Technical Spec

Tokopedia scraper — technical capabilities

Everything supported by our tokopedia.com scraper — rendered SPA elements, auth walls, rate-limit evasion and beyond.

JavaScript rendering
Full Playwright sessions — required for flash deals, price widgets, and React-rendered content
Supported
CAPTCHA bypass
Automated 2Captcha + CapSolver integration with fallback to manual queue
Supported
Residential proxy rotation
Indonesian residential ISP IPs — rotated per request with sticky sessions where needed
Supported
GraphQL API intercept
Intercepts Tokopedia's internal GraphQL API calls for structured, reliable data extraction
Supported
Product variant mapping
Parent → child SKU relationships with full option combination matrix
Supported
Flash deal monitoring
Deal price, countdown, stock depth, and claim rate captured per run
Supported
Review pagination
Full review corpus including all star-filter pages and media reviews
Supported
Shop storefront scraping
All active listings per shop, sorted by any criterion
Supported
TopAds detection
Distinguishes organic vs TopAds sponsored placements in SERP results
Supported
Change detection (diffs)
Hash-based diff: only emit records with changed fields since last run
Supported
Webhook delivery
HTTP POST per record or batch for real-time downstream processing
Supported
Authenticated buyer data
Order history, private vouchers, and account-specific pricing require credentials
Partial
Infrastructure

Infrastructure powering the Tokopedia pipeline

Open-source tooling on proven cloud infra — no vendor lock-in, full observability.

ScrapyPlaywrightPython 3.12RedisPostgreSQLApache AirflowAWS LambdaS3CloudWatch2CaptchaCapSolverResidential Proxies (ID)DockerKubernetesGrafanaPrometheus
Scrapy + Playwright Stack

Scrapy handles crawl orchestration, deduplication, and retry logic. Playwright handles JavaScript rendering and cookie sessions. GraphQL API intercept layer provides a structured fallback for critical fields.

Indonesian Residential Proxy Infrastructure

We maintain pools of Indonesian residential ISP proxies. Rotation happens per-request with sticky sessions where required. IP score monitoring prevents blacklisted pool contamination.

Cloud-Native Orchestration

Pipelines run on AWS Lambda (burst) and ECS (sustained). Airflow handles scheduling, dependency management, and SLA alerting. All state stored in managed Postgres.

Output & Delivery

Your data, your destination

Data delivered to where your team already works — no new tooling required.

JSON
Newline-delimited or nested — schema versioned per run
CSV
Flat file with typed columns — Excel/Sheets compatible
Parquet
Columnar format for BigQuery, Snowflake, Athena
S3
Direct bucket delivery — compatible with any data lake
BigQuery
Streamed directly into your dataset with schema auto-detect
Webhook
HTTP POST per record for real-time downstream processing
Postgres
Upsert into your existing schema with conflict resolution
Snowflake
Stage + COPY INTO workflow — incremental or full-replace
// faq

Common questions.

About tokopedia.com scraping, legality, and pipeline operations.

Ask us directly →
Is scraping Tokopedia legal?

Scraping publicly available information from Tokopedia is generally permissible under applicable law in Indonesia — reinforced by precedents such as hiQ v. LinkedIn. DataFlirt targets only public, non-authenticated product, pricing, and review data. We do not extract personal data or circumvent authentication walls. We recommend clients review Tokopedia's ToS independently and consult legal counsel for specific use cases.

How do you handle Tokopedia's anti-bot systems?

We use Indonesian residential ISP proxies, full Playwright browser sessions with realistic fingerprints, GraphQL API intercept for structured data, and request timing modelled on real user behaviour. Our selectors have multi-layer fallback chains so React frontend changes don't break the pipeline.

Can you track flash deals and campaign pricing?

Yes. We run elevated-frequency crawls during Tokopedia mega-campaigns (Harbolnas 12.12, Tokopedia Birthday) to capture flash deal prices, countdown windows, stock depth, and cashback amounts at the product level — with pre/during/post campaign snapshots.

Do you support Bahasa Indonesia review extraction?

Yes. Reviews are extracted as-is in Bahasa Indonesia (or any language the buyer used). We do not translate by default, but can include a translated field via a post-processing step using a translation API if required.

How fresh is the data?

Standard pipelines deliver daily refreshes. For price and availability monitoring on a defined product set, we offer sub-60-minute latency. Campaign windows can be monitored at 15-minute intervals on request.

Can I request a sample dataset before committing?

Yes. We provide a sample run of up to 500 products or 50 search result pages as part of pre-engagement scoping — so you can validate schema fit, field completeness, and data quality before signing any contract.

$ dataflirt scope --new-project --source=tokopedia.com ready

Tell us what
to extract.
We do the rest.

20-minute scoping call. Pilot dataset within the week. Production within two. Whether you need a one-off product catalogue dump or a continuous price-monitoring feed across Indonesia's largest marketplace — we scope, build, and operate the pipeline. Tell us what you need.

hello@dataflirt.com · Bengaluru · IST · typical reply < 4h
Services

Data Extraction for Every Industry

View All Services →