SYSTEM all green source tradekey.com queue 18,392 pages p99 latency 215ms dataflirt.com · scraper/tradekey-com
RUN · 42 active pipelines · tradekey.com live

Tradekey B2B data,
at warehouse scale.

We extract supplier profiles, product listings, ISO certifications, and buy/sell offers from Tradekey. Delivered as clean JSON, CSV, or Parquet to S3, BigQuery, or Postgres on your cadence.

Suppliers extracted
412K /run
Product listings
3.1M /week
Trade offers
89K /day
Active pipelines
42
Uptime
99.94%
Data Dictionary

Every field we extract from tradekey.com

Structured, schema-consistent data across all major object types — delivered clean, typed, and ready to query.

Complete list of extractable fields for Supplier Profiles objects from tradekey.com. All fields typed and schema-versioned.

company_nametrust_pointsmember_typecountryyear_establishedmain_productsexport_marketsemployee_countcertificationsprofile_url
supplier_profiles
● 200 OK
"company_name": "Shenzhen Industrial Tech Co., Ltd.",
"trust_points": 85,
"member_type": "Gold Key",
"country": "China",
"year_established": 2011,
"main_products": "['CNC Machining', 'Injection Molding', 'Metal Stamping']",
"export_markets": "['North America', 'Western Europe', 'Middle East']",
"employee_count": "101 - 500 People"
# company_nametrust_pointsmember_typecountryyear_establishedmain_products
1
2
3

Complete list of extractable fields for Product Listings objects from tradekey.com. All fields typed and schema-versioned.

product_idtitlecategorysub_categorysupplier_namemin_order_quantityfob_pricesupply_abilityportpayment_termsimages
product_listings
● 200 OK
"product_id": "TK-993821",
"title": "High Precision CNC Aluminum Machining Parts",
"category": "Minerals & Metallurgy",
"sub_category": "Machining",
"min_order_quantity": "500 Pieces",
"fob_price": "USD 0.5 - 5.0 / Piece",
"supply_ability": "50000 Pieces / Month",
"port": "Shenzhen"
# product_idtitlecategorysub_categorysupplier_namemin_order_quantity
1
2
3

Complete list of extractable fields for Buy Offers objects from tradekey.com. All fields typed and schema-versioned.

offer_idtitlebuyer_countrydate_postedexpiry_daterequired_quantitycategorydescriptionbuyer_member_type
buy_offers
● 200 OK
"offer_id": "BO-449102",
"title": "Looking for Copper Wire Scrap",
"buyer_country": "United Arab Emirates",
"date_posted": "2026-03-14",
"required_quantity": "20 Metric Tons",
"category": "Rubber & Plastics",
"buyer_member_type": "Silver Key"
# offer_idtitlebuyer_countrydate_postedexpiry_daterequired_quantity
1
2
3

Complete list of extractable fields for Sell Offers objects from tradekey.com. All fields typed and schema-versioned.

offer_idtitlesupplier_namecountrydate_postedvalid_untilprice_termspackaging_detailsdelivery_time
sell_offers
● 200 OK
"offer_id": "SO-882194",
"title": "Wholesale LED Street Lights 100W",
"supplier_name": "Bright Lighting Co.",
"country": "Taiwan",
"date_posted": "2026-03-10",
"price_terms": "FOB, CIF",
"delivery_time": "15-20 Days"
# offer_idtitlesupplier_namecountrydate_postedvalid_until
1
2
3

Complete list of extractable fields for Certifications & Trust objects from tradekey.com. All fields typed and schema-versioned.

company_idiso_certsfactory_sizeqc_staffr_and_d_staffproduction_linesannual_revenueverification_statustrade_shows
certifications_& trust
● 200 OK
"company_id": "COMP-29104",
"iso_certs": "['ISO 9001:2015', 'ISO 14001']",
"factory_size": "5,000-10,000 square meters",
"qc_staff": "11 - 20 People",
"production_lines": 8,
"verification_status": "Verified Onsite",
"annual_revenue": "US$10 Million - US$50 Million"
# company_idiso_certsfactory_sizeqc_staffr_and_d_staffproduction_lines
1
2
3

Capabilities

Extract global B2B supplier intelligence

Our Tradekey scraper maps the entire B2B ecosystem: supplier profiles, product catalogues, and trade offers — handling complex category trees and anti-bot systems.

Supplier Directory Scraping

Extract company profiles including establishment year, employee count, export markets, and main product categories.

Product Catalogue Extraction

Capture product specifications, FOB pricing tiers, minimum order quantities (MOQ), and supply capacity metrics.

Buy & Sell Offer Monitoring

Track active trade leads, required quantities, target prices, and expiry dates to gauge market demand.

TrustPoint & Verification Data

Extract Tradekey TrustPoints, membership tiers (Gold/Silver), and onsite verification status.

ISO & Certification Tracking

Capture factory certifications, QC staff counts, production line details, and R&D capabilities.

Export Market Mapping

Identify primary export regions and annual revenue brackets for global manufacturers.

Automated Pagination

Traverse deep category trees and paginated search results to ensure complete catalogue coverage.

Delta Updates

Run continuous pipelines that detect new suppliers, updated products, and fresh trade offers without redundant extraction.

Structured Delivery

Normalised JSON or Parquet files delivered directly to your data warehouse on a daily or weekly schedule.

// engagement pipeline

From category selection to warehouse record

Brief in. Clean data out.

Define Scope
d 0

Provide target categories, supplier regions, or keyword sets. We design the extraction schema together.

Pipeline Build
d 2–4

We configure Scrapy crawlers, proxy rotation, session management, and CAPTCHA handling for tradekey.com.

Validation & QA
d 4–6

Schema validation, null-rate checks, and sample exports before full launch.

Delivery
ongoing

JSON / CSV / Parquet pushed to your S3 bucket, BigQuery dataset, or Postgres database on agreed cadence.

Under the hood

How our Tradekey pipeline handles the hard parts

Extracting data from B2B directories requires navigating inconsistent HTML and IP blocks. Here is how we maintain data quality.

pipeline-monitor · tradekey.com · live ● active
// fingerprinting
Identity rotation
TLS fingerprintrandomised
User-agentrotated
IP poolresidential
Challenges blocked0
// pagination
Page coverage
48,291 pages queued running
// observability
Pipeline health
99.9%
uptime
142ms
p99 lat
0.3%
null rate
2
alerts
Anti-bot layer
Residential proxy rotation

B2B directories aggressively rate-limit IP addresses. Our crawlers use global residential ISP proxies with randomised request timing to maintain continuous extraction without triggering blocks.

Pagination handling
Deep category tree traversal

Tradekey organises data in deep, multi-level category trees. We build recursive crawlers that map the entire taxonomy, ensuring no sub-category or paginated supplier list is missed.

Schema stability
Handling inconsistent supplier data

Suppliers format their profiles and product descriptions inconsistently. We use regex and NLP to normalise fields like MOQ, pricing, and production capacity into clean, typed data structures.

Change detection
Only re-scrape what's changed

For large directories, we maintain a hash index of last-seen values per field. Subsequent runs only push diffs — reducing compute cost and downstream processing load.

Monitoring & alerting
24/7 pipeline health

Every run emits structured logs to our observability stack. We alert on null-rate spikes and coverage drops — responding before you notice.

Applications

Who uses Tradekey data — and how

Teams across industries use tradekey.com data to build competitive products and smarter operations.

01
Supplier Sourcing & Procurement

Procurement teams identify alternative manufacturers, comparing MOQs, certifications, and production capacities across regions.

02
Market Research

Analysts track manufacturing trends, export market shifts, and category growth in specific Asian and Middle Eastern regions.

03
Competitor Analysis

Manufacturers monitor competitor product catalogues, pricing strategies, and new certifications to maintain market positioning.

04
Lead Generation for B2B Services

Logistics, freight forwarding, and trade finance companies extract supplier profiles to build targeted outreach lists.

05
Supply Chain Mapping

Risk management teams map global supply chains by analyzing factory locations, employee counts, and export dependencies.

06
Trade Finance Due Diligence

Financial institutions use TrustPoints, verification status, and establishment years to augment credit risk models for SMEs.

Why DataFlirt

"Tradekey holds critical supply chain metadata for global manufacturing — but extracting it requires navigating complex category trees and anti-scraping layers."

Most teams underestimate the investment required: reliable Tradekey scraping requires residential proxies, handling inconsistent supplier-uploaded HTML, daily selector maintenance, and anomaly monitoring. DataFlirt absorbs that complexity so your engineers can focus on the analysis — not the infrastructure.

Technical Spec

Tradekey scraper — technical capabilities

Everything supported by our tradekey.com scraper — rendered SPA elements, auth walls, rate-limit evasion and beyond.

JavaScript rendering
Playwright sessions for dynamic content and contact reveals
Supported
CAPTCHA bypass
Automated CapSolver integration for rate-limit challenges
Supported
Residential proxy rotation
Global ISP-grade residential IPs rotated per request
Supported
Category tree traversal
Recursive mapping of all industry sectors and sub-sectors
Supported
TrustPoint extraction
Capture of proprietary Tradekey trust and verification metrics
Supported
Change detection (diffs)
Hash-based diff: only emit records with changed fields
Supported
Webhook delivery
HTTP POST per record for real-time lead ingestion
Supported
Buyer contact emails
Direct email addresses of buyers posting Buy Offers (requires paid Tradekey membership)
Partial
Private RFQ messages
Internal messaging system data (requires authenticated supplier account)
Partial
Infrastructure

Infrastructure powering the Tradekey pipeline

Open-source tooling on proven cloud infra — no vendor lock-in, full observability.

ScrapyPlaywrightPython 3.12RedisPostgreSQLApache AirflowAWS LambdaS3CloudWatch2CaptchaCapSolverResidential ProxiesDockerKubernetesGrafanaPrometheus
Scrapy + Playwright Stack

Scrapy handles crawl orchestration, deduplication, and retry logic. Playwright handles JavaScript rendering and interaction flows.

Residential Proxy Infrastructure

We maintain pools of residential ISP proxies. Rotation happens per-request with sticky sessions where required to prevent IP bans.

Cloud-Native Orchestration

Pipelines run on Kubernetes. Airflow handles scheduling, dependency management, and SLA alerting. All state stored in managed Postgres.

Output & Delivery

Your data, your destination

Data delivered to where your team already works — no new tooling required.

JSON
Newline-delimited or nested — schema versioned per run
CSV
Flat file with typed columns — Excel/Sheets compatible
XLS
Legacy spreadsheet format for business users
Parquet
Columnar format for BigQuery, Snowflake, Athena
AWS S3
Direct bucket delivery — compatible with any data lake
Webhook
HTTP POST per record for real-time downstream processing
API
REST endpoints to query your extracted datasets
PostgreSQL
Upsert into your existing schema with conflict resolution
BigQuery
Streamed directly into your dataset with schema auto-detect
Snowflake
Stage + COPY INTO workflow — incremental or full-replace
S3
Direct bucket delivery — compatible with any data lake
// faq

Common questions.

About tradekey.com scraping, legality, and pipeline operations.

Ask us directly →
Is scraping Tradekey legal?

Scraping publicly available directory information is generally permissible under applicable law. DataFlirt targets only public, non-authenticated supplier profiles and product catalogues. We do not extract personal data, circumvent authentication walls, or scrape private RFQ messages. Clients should review Tradekey's ToS and consult legal counsel for specific use cases.

How do you handle Tradekey's IP blocks?

We use global residential ISP proxies, randomised request timing, and user-agent rotation. Our crawlers mimic human browsing behaviour to traverse category trees without triggering rate limits or CAPTCHAs.

Can you extract direct buyer emails from Buy Offers?

No. Tradekey typically gates direct contact information behind paid membership tiers or requires users to use their internal messaging system. We extract all publicly visible data on the offer, but cannot bypass authentication walls to retrieve private contact details.

How fresh is the data?

We can configure pipelines to run daily, weekly, or monthly depending on your requirements. For active Buy/Sell offers, daily extraction is recommended to capture leads before they expire.

Can you track specific product categories only?

Yes. You can define the exact scope of the extraction by providing specific category URLs, search keywords, or supplier country filters. We only extract what you need.

What is the minimum viable engagement?

Our smallest packages start at a defined category or keyword list with weekly delivery. For full directory extraction, we price based on volume and delivery frequency. Contact us with your use case for a scoped quote.

$ dataflirt scope --new-project --source=tradekey.com ready

Tell us what
to extract.
We do the rest.

20-minute scoping call. Pilot dataset within the week. Production within two. Whether you need a one-off supplier directory dump or a continuous B2B product feed — we scope, build, and operate the pipeline. Tell us what you need.

hello@dataflirt.com · Bengaluru · IST · typical reply < 4h
Related Scrapers

More in industrial and mro

Services

Data Extraction for Every Industry

View All Services →