SYSTEM all green source kompass.cn queue 12,408 pages p99 latency 215ms dataflirt.com · scraper/kompass-cn
RUN · 38 active pipelines · kompass.cn live

Kompass China data,
at warehouse scale.

We extract manufacturer profiles, product classifications, executive contacts, and export signals from Kompass China. Delivered as clean JSON, CSV, or Parquet to S3, BigQuery, or Snowflake on your cadence.

Companies extracted
3.2M /month
Executive contacts
8.4M /run
Product listings
14.1M /run
Active pipelines
38
Uptime
99.98%
Data Dictionary

Every field we extract from kompass.cn

Structured, schema-consistent data across all major object types — delivered clean, typed, and ready to query.

Complete list of extractable fields for Company Profiles objects from kompass.cn. All fields typed and schema-versioned.

kompass_idcompany_name_encompany_name_zhlegal_statusyear_establishedemployee_countturnover_rangeheadquarters_addressfactory_locationswebsite_urlphone_numberfax_numberkompass_profile_url
company_profiles
● 200 OK
"kompass_id": "CN123456",
"company_name_en": "Shenzhen Tech Manufacturing Co., Ltd.",
"company_name_zh": "深圳市科技制造有限公司",
"year_established": 2008,
"employee_count": "501-1000",
"turnover_range": "10M-50M USD",
"headquarters_address": "Baoan District, Shenzhen, Guangdong, China",
"website_url": "http://www.sztechmfg.com"
# kompass_idcompany_name_encompany_name_zhlegal_statusyear_establishedemployee_count
1
2
3

Complete list of extractable fields for Product Catalogues objects from kompass.cn. All fields typed and schema-versioned.

kompass_idproduct_category_codeproduct_category_namekompass_classification_levelproduct_nameproduct_descriptionspecificationsminimum_order_quantityproduction_capacityimage_urls
product_catalogues
● 200 OK
"kompass_id": "CN123456",
"product_category_code": "34521",
"product_category_name": "Electronic Components",
"kompass_classification_level": 4,
"product_name": "Industrial PCB Assembly",
"minimum_order_quantity": "500 units",
"production_capacity": "50000 units/month"
# kompass_idproduct_category_codeproduct_category_namekompass_classification_levelproduct_nameproduct_description
1
2
3

Complete list of extractable fields for Executive Contacts objects from kompass.cn. All fields typed and schema-versioned.

kompass_idcontact_idfull_namejob_titledepartmentmanagement_levelspoken_languagesdirect_phonelinkedin_url
executive_contacts
● 200 OK
"kompass_id": "CN123456",
"contact_id": "C98765",
"full_name": "Wei Chen",
"job_title": "Director of International Sales",
"department": "Sales & Export",
"management_level": "Senior Management",
"spoken_languages": "['Mandarin', 'English']"
# kompass_idcontact_idfull_namejob_titledepartmentmanagement_level
1
2
3

Complete list of extractable fields for Import & Export objects from kompass.cn. All fields typed and schema-versioned.

kompass_idexporter_statusimporter_statusexport_regionsimport_regionsexport_percentageprimary_export_productscustoms_registration_code
import_& export
● 200 OK
"kompass_id": "CN123456",
"exporter_status": true,
"importer_status": false,
"export_regions": "['Europe', 'North America', 'Southeast Asia']",
"export_percentage": "85%",
"primary_export_products": "['PCB Assemblies', 'Microcontrollers']",
"customs_registration_code": "4403123456"
# kompass_idexporter_statusimporter_statusexport_regionsimport_regionsexport_percentage
1
2
3

Complete list of extractable fields for Certifications objects from kompass.cn. All fields typed and schema-versioned.

kompass_idcertification_namecertification_bodyissue_dateexpiry_datecertificate_numberscopeverification_status
certifications
● 200 OK
"kompass_id": "CN123456",
"certification_name": "ISO 9001:2015",
"certification_body": "SGS",
"issue_date": "2023-04-15",
"expiry_date": "2026-04-14",
"certificate_number": "CN23/12345",
"verification_status": "Verified"
# kompass_idcertification_namecertification_bodyissue_dateexpiry_datecertificate_number
1
2
3

Capabilities

Deep B2B extraction for the Chinese supply chain

Our Kompass.cn scraper handles the complex hierarchy of industrial classifications, dual-language parsing, and deep pagination required to map out Chinese manufacturing capabilities at scale.

Comprehensive Company Profiles

Extract legal names, registration details, employee bands, turnover estimates, and physical factory locations across all Chinese provinces.

Kompass Classification Parsing

Map supplier capabilities using the proprietary 67-category, 3000-branch Kompass classification system down to the product level.

Executive Roster Extraction

Capture key decision makers, department heads, and export managers with their associated job titles and spoken languages.

Trade & Export Signals

Identify active exporters, target export regions, and customs registration details to qualify international supply chain partners.

Quality & ISO Certifications

Extract quality management certificates, ISO compliance details, and auditing bodies to ensure supplier reliability.

Dual-Language Normalisation

Capture and normalise data in both Simplified Chinese and English to maintain accuracy in local names and international aliases.

Branch & Subsidiary Mapping

Link parent companies to their regional sales offices and manufacturing facilities across different industrial zones.

Delta Updates

Monitor specific industrial sectors for new company registrations, updated contact details, or newly acquired certifications.

NAICS/NACE Cross-Referencing

Provide raw Kompass codes ready for mapping against standard North American or European industry classification systems.

// engagement pipeline

From sector target to warehouse record

Brief in. Clean data out.

Define Scope
d 0

Provide target industries, Kompass classification codes, or regional focus areas. We design the extraction schema together.

Pipeline Build
d 2–4

We configure Scrapy crawlers, proxy rotation, session management, and CAPTCHA handling for kompass.cn.

Validation & QA
d 4–6

Schema validation, null-rate checks, language-encoding verification, and sample records before full launch.

Delivery
ongoing

JSON / CSV / Parquet pushed to your S3 bucket, BigQuery dataset, or Snowflake stage on agreed cadence.

Under the hood

How our Kompass pipeline handles the hard parts

B2B directories protect their core asset: the database. Here is how we bypass rate limits and pagination walls to deliver complete datasets.

pipeline-monitor · kompass.cn · live ● active
// fingerprinting
Identity rotation
TLS fingerprintrandomised
User-agentrotated
IP poolresidential
Challenges blocked0
// pagination
Page coverage
48,291 pages queued running
// observability
Pipeline health
99.9%
uptime
142ms
p99 lat
0.3%
null rate
2
alerts
Pagination limits
Bypassing hard search limits

Kompass caps search results to a few hundred pages. We use granular search permutation - combining sector codes, region filters, and employee bands - to break large result sets into smaller, fully extractable chunks.

Proxy rotation
Mainland China residential IPs

Accessing kompass.cn from international data centres triggers immediate blocks. We route traffic through residential proxy pools located within mainland China to maintain access and simulate local buyer traffic.

Taxonomy parsing
Hierarchical data extraction

The Kompass product classification is deeply nested. Our parsers recursively traverse these DOM structures to maintain the parent-child relationship between broad industry sectors and specific product capabilities.

Data normalisation
Cleaning unstructured text fields

Company descriptions and product specifications often contain mixed encodings and unstructured text. Our pipeline normalises this output into clean, typed JSON fields ready for immediate database insertion.

Session handling
Managing cookie lifecycles

Kompass monitors session activity to detect automated scraping. We rotate user agents, manage cookie jars, and introduce randomised delays to prevent session invalidation during deep crawls.

Applications

Who uses Kompass China data

Teams across industries use kompass.cn data to build competitive products and smarter operations.

01
Supply Chain Diversification

Procurement teams map alternative manufacturers and raw material suppliers across different Chinese provinces to mitigate supply chain risk.

02
B2B Lead Generation

Logistics providers and freight forwarders extract active exporters to build targeted outbound sales campaigns.

03
Market Research

Consultancies analyse industrial concentration, tracking the growth of specific manufacturing sectors like EVs or renewables.

04
Competitor Intelligence

Manufacturers monitor competitor profiles for new product lines, facility expansions, and updated ISO certifications.

05
Investment Due Diligence

Private equity firms evaluate the scale, longevity, and export capability of potential acquisition targets in the manufacturing sector.

06
Master Data Management

Enterprise data teams enrich their internal vendor records with standardised Kompass classification codes and verified contact details.

Why DataFlirt

"Kompass China holds the definitive map of Chinese manufacturing output, but querying this hierarchical classification requires a dedicated extraction pipeline."

Most data teams underestimate the complexity of scraping B2B directories. Reliable extraction requires mainland residential proxies, session management, handling deep pagination limits, and parsing complex product taxonomy trees. DataFlirt absorbs this infrastructure overhead so your team can focus on vendor analysis.

Technical Spec

Kompass.cn scraper - technical capabilities

Everything supported by our kompass.cn scraper — rendered SPA elements, auth walls, rate-limit evasion and beyond.

Mainland China proxies
Geo-targeted residential IPs to bypass regional blocks
Supported
Dual-language extraction
Capture of both English and Simplified Chinese profile variants
Supported
Deep pagination bypass
Search permutation to extract records beyond the 50-page limit
Supported
Hierarchical taxonomy mapping
Full path extraction for Kompass product classification codes
Supported
Change detection
Hash-based diffs to identify new suppliers or updated profiles
Supported
Automated CAPTCHA solving
Integration with CapSolver for uninterrupted pipeline execution
Supported
Image URL extraction
Capture of product catalogue image links and company logos
Supported
Premium executive direct emails
Requires authenticated access via a paid Kompass subscription plan
Partial
Private financial filings
Internal accounting data not exposed on the public profile
Partial
Infrastructure

Infrastructure powering the Kompass pipeline

Open-source tooling on proven cloud infra — no vendor lock-in, full observability.

ScrapyPlaywrightPython 3.12RedisPostgreSQLApache AirflowAWS LambdaS3CloudWatch2CaptchaCapSolverResidential ProxiesDockerKubernetesGrafanaPrometheus
Scrapy Orchestration

Scrapy manages the complex crawl logic required to navigate the Kompass sector taxonomy, handling deduplication and request retries at scale.

Regional Proxy Networks

We route requests through ISP-grade residential proxies located in mainland China to ensure high success rates and avoid geo-fencing blocks.

Scalable Delivery

Airflow schedules the extraction runs, processes the raw HTML into structured JSON, and pushes the output directly to your preferred cloud storage.

Output & Delivery

Your data, your destination

Data delivered to where your team already works — no new tooling required.

JSON
Newline-delimited files containing full hierarchical company data
CSV
Flattened tables ideal for CRM import and vendor management systems
XLS
Excel format for immediate business analyst review
Parquet
Columnar storage optimised for Athena and Snowflake querying
AWS S3
Direct delivery to your cloud buckets on a scheduled cadence
Webhook
HTTP POST delivery for immediate downstream processing
API
REST endpoints to query your extracted Kompass dataset
BigQuery
Direct insertion into Google Cloud data warehouses
S3
Direct bucket delivery — compatible with any data lake
// faq

Common questions.

About kompass.cn scraping, legality, and pipeline operations.

Ask us directly →
Can you extract data for specific Kompass classification codes?

Yes. You can provide specific 2-digit, 4-digit, or 5-digit Kompass codes. We will configure the pipeline to target only companies listed under those exact industrial classifications.

How do you handle the bilingual nature of kompass.cn?

The pipeline is built to extract data from both the English and Simplified Chinese versions of the profile. We output both variants, allowing you to maintain accurate local names while using English for global reporting.

Do you provide direct email addresses for executives?

We extract all contact information publicly visible on the company profile. However, Kompass often gates direct executive emails behind their premium paid plans. We capture phone numbers, fax lines, and general inquiry emails that are publicly available.

How frequently can you update the supplier database?

We typically run full sector refreshes on a monthly or quarterly basis. For highly targeted lists of specific competitors or key suppliers, we can configure weekly monitoring for profile changes.

Can you bypass the search pagination limits on Kompass?

Yes. When a sector returns more results than the pagination limit allows, our pipeline automatically splinters the search using secondary filters like province or employee count to ensure 100% capture of the underlying records.

Is the data delivered ready for CRM import?

Absolutely. We can flatten the hierarchical data into CSV formats mapped exactly to your Salesforce or HubSpot schema, ensuring clean ingestion without manual data manipulation.

$ dataflirt scope --new-project --source=kompass.cn ready

Tell us what
to extract.
We do the rest.

20-minute scoping call. Pilot dataset within the week. Production within two. Whether you need a complete dump of the electronics manufacturing sector or targeted extraction of certified exporters, we build the pipeline. Tell us your requirements.

hello@dataflirt.com · Bengaluru · IST · typical reply < 4h
Related Scrapers

More in business directories

Services

Data Extraction for Every Industry

View All Services →