SYSTEM all green source 1688.com queue 28,401 pages p99 latency 215ms dataflirt.com · scraper/1688-com
RUN * 132 active pipelines * 1688.com live

1688 wholesale data,
at warehouse scale.

We extract bulk product listings, tiered pricing, factory verification metrics, and supplier intelligence from 1688. Delivered as clean JSON, CSV, or Parquet to S3 or BigQuery on your cadence.

Products extracted
1.8M /day
Price tiers
4.2M /24h
Supplier records
145K /run
Active pipelines
132
Uptime
99.95%
Data Dictionary

Every field we extract from 1688.com

Structured, schema-consistent data across all major object types — delivered clean, typed, and ready to query.

Complete list of extractable fields for Product Listings objects from 1688.com. All fields typed and schema-versioned.

product_idtitlecategorysub_categorysupplier_idprice_minprice_maxcurrencymoq_minimumin_stockattributesimagesvariation_countlead_time_daysweight_kgpage_url
product_listings
● 200 OK
"product_id": "678912345678",
"title": "Industrial Grade Stainless Steel Ball Bearing",
"category": "Mechanical Parts",
"price_min": 1.25,
"price_max": 1.8,
"currency": "CNY",
"moq_minimum": 100,
"in_stock": true,
"variation_count": 12
# product_idtitlecategorysub_categorysupplier_idprice_min
1
2
3

Complete list of extractable fields for Pricing & Tiers objects from 1688.com. All fields typed and schema-versioned.

product_idtier_1_moqtier_1_pricetier_2_moqtier_2_pricetier_3_moqtier_3_pricediscount_pctpromotional_pricecurrencyprice_timestamp
pricing_& tiers
● 200 OK
"product_id": "678912345678",
"tier_1_moq": 100,
"tier_1_price": 1.8,
"tier_2_moq": 500,
"tier_2_price": 1.5,
"tier_3_moq": 1000,
"tier_3_price": 1.25,
"currency": "CNY",
"price_timestamp": "2026-05-12T09:14:00Z"
# product_idtier_1_moqtier_1_pricetier_2_moqtier_2_pricetier_3_moq
1
2
3

Complete list of extractable fields for Supplier & Factory objects from 1688.com. All fields typed and schema-versioned.

supplier_idcompany_namebusiness_modellocation_citylocation_provinceyears_activesuper_factory_badgeverification_statusresponse_rate_pctreturn_rate_pcttransaction_volume_30demployee_countstore_url
supplier_& factory
● 200 OK
"supplier_id": "sup_987654321",
"company_name": "Shenzhen Precision Manufacturing Co.",
"business_model": "Manufacturer",
"years_active": 8,
"super_factory_badge": true,
"response_rate_pct": 98.5,
"transaction_volume_30d": 450000.0,
"location_city": "Shenzhen"
# supplier_idcompany_namebusiness_modellocation_citylocation_provinceyears_active
1
2
3

Complete list of extractable fields for Reviews & Ratings objects from 1688.com. All fields typed and schema-versioned.

review_idproduct_idbuyer_tierstar_ratingreview_contentreview_dateimages_attachedhelpful_votesvariant_purchasedrepeat_buyer
reviews_& ratings
● 200 OK
"review_id": "rev_55443322",
"product_id": "678912345678",
"buyer_tier": "L4",
"star_rating": 5,
"review_content": "Excellent quality bearings, fast shipping.",
"review_date": "2026-04-18",
"repeat_buyer": true,
"images_attached": 2
# review_idproduct_idbuyer_tierstar_ratingreview_contentreview_date
1
2
3

Complete list of extractable fields for Search Results objects from 1688.com. All fields typed and schema-versioned.

keywordpage_numberpositionproduct_idtitlepricesupplier_namesales_volume_30dsuper_factory_flagcross_border_flagthumbnail_urlscraped_at
search_results
● 200 OK
"keyword": "stainless steel bearing",
"position": 1,
"product_id": "678912345678",
"price": 1.25,
"sales_volume_30d": 12500,
"super_factory_flag": true,
"cross_border_flag": true,
"scraped_at": "2026-05-12T09:14:33Z"
# keywordpage_numberpositionproduct_idtitleprice
1
2
3

Capabilities

Wholesale data extraction - engineered for scale

Our 1688 scraper parses complex supplier matrices, dynamic MOQ pricing, and rich factory profiles while bypassing Alibaba's strict anti-bot systems.

MOQ Pricing Extraction

Capture tiered pricing structures based on Minimum Order Quantities, including promotional discounts and wholesale volume breaks.

Supplier & Factory Metrics

Extract Super Factory badges, business models, registered capital, years active, and 30-day transaction volumes for vetting.

Product Variation Mapping

Map complex parent-child SKU relationships, including colour, size, material, and specification variants with individual stock levels.

Cross-Border Attributes

Identify products explicitly flagged for cross-border e-commerce, including package weight, dimensions, and export compliance data.

Lead Time & Logistics

Track estimated dispatch times, processing windows, and domestic shipping origins to optimise supply chain planning.

Buyer Reviews & Ratings

Scrape buyer feedback, star ratings, and repeat purchase indicators to assess actual product quality and supplier reliability.

Keyword SERP Tracking

Monitor search visibility, ad placements, and organic rankings for specific industrial keywords across the 1688 ecosystem.

AliGuard Bypass

Automated handling of Alibaba's strict slider CAPTCHAs and request signing using localized residential proxies.

Change Detection

Run continuous pipelines that only emit data when prices, stock levels, or supplier metrics change.

// engagement pipeline

From search term to structured catalogue

Brief in. Clean data out.

Define Scope
d 0

Provide product URLs, supplier IDs, or keyword lists. We design the extraction schema together.

Pipeline Build
d 2–4

We configure Scrapy crawlers, Chinese residential proxy rotation, and slider CAPTCHA solvers for 1688.

Validation & QA
d 4–6

Schema validation, null-rate checks, and translation pipeline testing before full launch.

Delivery
ongoing

JSON, CSV, or Parquet pushed to your S3 bucket or BigQuery dataset on an agreed cadence.

Under the hood

How our 1688 pipeline handles the hard parts

Alibaba invests heavily in scraping detection. Here is how we maintain uptime and data integrity.

pipeline-monitor · 1688.com · live ● active
// fingerprinting
Identity rotation
TLS fingerprintrandomised
User-agentrotated
IP poolresidential
Challenges blocked0
// pagination
Page coverage
48,291 pages queued running
// observability
Pipeline health
99.9%
uptime
142ms
p99 lat
0.3%
null rate
2
alerts
Anti-bot layer
Chinese residential proxies + AliGuard bypass

1688 heavily restricts non-Chinese traffic and deploys aggressive slider CAPTCHAs. We route requests through mainland Chinese residential IPs and use specialized solver APIs to clear AliGuard challenges.

JavaScript rendering
Playwright for dynamic MOQ tables

Pricing on 1688 is heavily dynamic, changing based on selected variants and quantities. We use Playwright to execute JavaScript, interact with variant selectors, and hydrate the correct pricing tiers.

Schema stability
Resilient selectors for complex DOMs

1688 product pages have massive, complex DOM structures. Our extraction logic uses multiple fallback chains - combining CSS selectors, XPath, and regex on inline JSON payloads - to ensure stability.

Data normalisation
Structured output from unstructured listings

Suppliers format specifications inconsistently. We normalise key attributes like weight, dimensions, and materials into strict JSON schemas, making the data queryable immediately.

Monitoring & alerting
24/7 pipeline health

We monitor for CAPTCHA rate spikes, layout changes, and null-field anomalies. If a pipeline degrades, our on-call engineers intervene before you miss a delivery.

Applications

Who uses 1688 data - and how

Teams across industries use 1688.com data to build competitive products and smarter operations.

01
Global Procurement

Sourcing teams extract supplier metrics and pricing tiers to identify primary manufacturers and negotiate better terms.

02
Dropshipping Intelligence

E-commerce platforms correlate 1688 supply data with global demand signals to discover high-margin product opportunities.

03
Competitor Analysis

Brands track competitor supply chains by identifying matching products, factory sources, and wholesale cost baselines.

04
Market Research

Analysts monitor macro trends in manufacturing output, category pricing, and supplier density across Chinese provinces.

05
Supply Chain Mapping

Logistics firms use factory location data and dispatch times to optimise freight routes and consolidation hubs.

06
AI Training Data

Machine learning teams use massive bilingual product catalogues to train translation models and visual search classifiers.

Why DataFlirt

"1688.com contains the world's most comprehensive factory and wholesale pricing data, but extracting it requires bypassing aggressive anti-bot systems and complex dynamic rendering."

Most teams underestimate the investment required: reliable 1688 scraping requires localized mainland Chinese proxies, full JavaScript rendering, slider CAPTCHA bypass, daily selector maintenance, and anomaly monitoring. DataFlirt absorbs that complexity so your engineers can focus on analysis, not infrastructure.

Technical Spec

1688 scraper - technical capabilities

Everything supported by our 1688.com scraper — rendered SPA elements, auth walls, rate-limit evasion and beyond.

JavaScript rendering
Full Playwright sessions required for dynamic MOQ pricing and variant selection
Supported
Slider CAPTCHA bypass
Automated solver integration for AliGuard verification challenges
Supported
Mainland CN proxies
Residential IPs localized to China to prevent geo-blocking
Supported
MOQ tier extraction
Capture all volume-based pricing breaks and promotional discounts
Supported
Supplier verification data
Extract Super Factory status, business model, and transaction history
Supported
Change detection
Hash-based diffs to only emit records with changed pricing or stock
Supported
Buyer-specific discounts
Negotiated pricing tiers requiring specific buyer account history
Partial
Private contact details
Supplier WeChat or direct phone numbers hidden behind login walls
Partial
Infrastructure

Infrastructure powering the 1688 pipeline

Open-source tooling on proven cloud infra — no vendor lock-in, full observability.

ScrapyPlaywrightPython 3.12RedisPostgreSQLApache AirflowAWS LambdaS3CloudWatch2CaptchaCapSolverResidential ProxiesDockerKubernetesGrafanaPrometheus
Scrapy + Playwright Stack

Scrapy handles crawl orchestration, deduplication, and retry logic. Playwright handles JavaScript rendering, cookie sessions, and interaction flows. Combined via scrapy-playwright middleware.

Residential Proxy Infrastructure

We maintain pools of residential ISP proxies localized to mainland China. Rotation happens per-request with sticky sessions where required to prevent AliGuard triggers.

Cloud-Native Orchestration

Pipelines run on AWS Lambda and ECS. Airflow handles scheduling, dependency management, and SLA alerting. All state stored in managed Postgres.

Output & Delivery

Your data, your destination

Data delivered to where your team already works — no new tooling required.

JSON
Newline-delimited or nested - schema versioned per run
CSV
Flat file with typed columns - Excel compatible
XLS
Standard spreadsheet format for procurement teams
Parquet
Columnar format for BigQuery, Snowflake, Athena
AWS S3
Direct bucket delivery - compatible with any data lake
Webhook
HTTP POST per record for real-time downstream processing
API
REST endpoints to query your extracted 1688 datasets
BigQuery
Streamed directly into your dataset with schema auto-detect
S3
Direct bucket delivery — compatible with any data lake
// faq

Common questions.

About 1688.com scraping, legality, and pipeline operations.

Ask us directly →
Is scraping 1688 legal?

Scraping publicly available information is generally permissible, but cross-border data extraction carries specific compliance requirements. DataFlirt targets only public, non-authenticated product, pricing, and supplier data. We do not extract personal buyer data or circumvent authentication walls. Clients should review platform ToS and consult legal counsel.

How do you handle 1688's anti-bot systems?

We use localized Chinese residential proxies, full Playwright browser sessions, and specialized CAPTCHA solvers designed for Alibaba's slider challenges. We monitor for block rate spikes in real time and trigger pool rotation automatically.

Do you translate the Chinese data into English?

Our standard extraction delivers the raw Chinese text exactly as it appears on the DOM. We can implement automated translation pipelines using external APIs (like DeepL or Google Cloud Translation) as an additional processing step if required.

How fresh is the pricing data?

We can configure pipelines to run daily or weekly depending on your requirements. For highly volatile categories, we can track specific ASIN equivalents at higher frequencies to monitor stock and price changes.

Can you extract data from Taobao or Tmall as well?

Yes. While this pipeline is specifically tuned for 1688's B2B structure, we operate separate managed pipelines for Taobao, Tmall, and AliExpress. We can unify data from multiple Alibaba properties into a single schema.

What is the minimum viable engagement?

Our smallest packages start at a defined list of 5,000 product URLs or 100 search keywords with weekly delivery. For larger catalogues, we price based on volume, rendering complexity, and delivery frequency.

$ dataflirt scope --new-project --source=1688.com ready

Tell us what
to extract.
We do the rest.

20-minute scoping call. Pilot dataset within the week. Production within two. Whether you need a one-off category export or a continuous supplier-monitoring feed across 1M products - we scope, build, and operate the pipeline. Tell us what you need.

hello@dataflirt.com · Bengaluru · IST · typical reply < 4h
Related Scrapers

More in industrial and mro

Services

Data Extraction for Every Industry

View All Services →