SYSTEM all green source zauba.com queue 112,485 shipments p99 latency 318ms dataflirt.com · scraper/zauba-com
RUN · 41 active pipelines · zauba.com live

Zauba trade data,
at warehouse scale.

We extract shipment records, HS code classifications, port movements, and pricing metrics from Zauba. Delivered as clean JSON, CSV, or Parquet to S3, BigQuery, or Snowflake on your cadence.

Shipment records
845K /day
HS Code updates
12.4K /24h
Port movements
412K /run
Active pipelines
41
Uptime
99.94%
Data Dictionary

Every field we extract from zauba.com

Structured, schema-consistent data across all major object types — delivered clean, typed, and ready to query.

Complete list of extractable fields for Import Shipments objects from zauba.com. All fields typed and schema-versioned.

datehs_codedescriptionorigin_portdestination_portquantityuqcunit_price_inrtotal_value_inrimporter_name
import_shipments
● 200 OK
"date": "2026-05-10",
"hs_code": "85176290",
"description": "ROUTERS FOR TELECOMMUNICATION NETWORKS",
"origin_port": "SHENZHEN (CNSZX)",
"destination_port": "NHAVA SHEVA SEA (INNSA1)",
"quantity": 1250,
"uqc": "NOS",
"unit_price_inr": 4250.5,
"total_value_inr": 5313125.0
# datehs_codedescriptionorigin_portdestination_portquantity
1
2
3

Complete list of extractable fields for Export Shipments objects from zauba.com. All fields typed and schema-versioned.

datehs_codedescriptionorigin_portdestination_portquantityuqcunit_price_inrtotal_value_inrexporter_name
export_shipments
● 200 OK
"date": "2026-05-11",
"hs_code": "30049099",
"description": "PHARMACEUTICAL PRODUCTS - PARACETAMOL TABLETS IP 500MG",
"origin_port": "BOMBAY AIR CARGO (INBOM4)",
"destination_port": "LONDON HEATHROW (GBLHR)",
"quantity": 50000,
"uqc": "PAC",
"unit_price_inr": 12.4,
"total_value_inr": 620000.0
# datehs_codedescriptionorigin_portdestination_portquantity
1
2
3

Complete list of extractable fields for HS Code Directory objects from zauba.com. All fields typed and schema-versioned.

hs_codechapterheadingsub_headingdescriptionimport_duty_pctigst_pcttotal_duty_pctpolicy_typelast_updated
hs_code directory
● 200 OK
"hs_code": "85176290",
"chapter": "85",
"heading": "8517",
"description": "Other apparatus for transmission or reception of voice, images or other data",
"import_duty_pct": 20.0,
"igst_pct": 18.0,
"total_duty_pct": 41.6,
"policy_type": "FREE"
# hs_codechapterheadingsub_headingdescriptionimport_duty_pct
1
2
3

Complete list of extractable fields for Company Profiles objects from zauba.com. All fields typed and schema-versioned.

cincompany_nameroc_coderegistration_numbercompany_categoryclass_of_companydate_of_incorporationauthorized_capitalpaid_up_capitalactive_status
company_profiles
● 200 OK
"cin": "U72900KA2021PTC145892",
"company_name": "DATAFLIRT TECHNOLOGIES PRIVATE LIMITED",
"roc_code": "RoC-Bangalore",
"company_category": "Company limited by Shares",
"class_of_company": "Private",
"date_of_incorporation": "2021-04-12",
"authorized_capital": 1000000.0,
"paid_up_capital": 100000.0
# cincompany_nameroc_coderegistration_numbercompany_categoryclass_of_company
1
2
3

Complete list of extractable fields for Port Analytics objects from zauba.com. All fields typed and schema-versioned.

port_codeport_nameport_typestatetotal_imports_value_inrtotal_exports_value_inrtop_import_hs_codetop_export_hs_codeactive_vessels_countlast_recorded_shipment
port_analytics
● 200 OK
"port_code": "INNSA1",
"port_name": "NHAVA SHEVA SEA",
"port_type": "SEA",
"state": "MAHARASHTRA",
"total_imports_value_inr": 8459200000.0,
"total_exports_value_inr": 6120400000.0,
"top_import_hs_code": "27090010",
"top_export_hs_code": "87032291"
# port_codeport_nameport_typestatetotal_imports_value_inrtotal_exports_value_inr
1
2
3

Capabilities

Everything you need from Zauba — structured and normalised

Our Zauba scraper handles the complex pagination, CAPTCHA walls, and unstructured table data of Indian trade logs — converting raw shipment rows into clean warehouse records.

Import Logs Extraction

Extract Bill of Entry level data including date, HS code, item description, origin port, destination port, and pricing metrics.

Export Logs Extraction

Capture Shipping Bill records with destination markets, export volumes, unit pricing, and total shipment values in INR.

HS Code Classification

Map raw shipment data to the official 8-digit Harmonised System codes, including chapter and sub-heading hierarchies.

Price & Valuation Metrics

Extract unit prices and total shipment values, normalising currencies and calculating average unit costs per HS code.

Port Level Analytics

Track cargo movements across specific Indian ports, mapping origin-to-destination trade routes.

Volume & Quantity Tracking

Capture raw shipment quantities and standardise Unit Quantity Codes (UQC) like KGS, NOS, and LTR for accurate volume analysis.

Historical Trade Data

Backfill years of historical shipment data to build long-term supply chain trend models and seasonal forecasts.

Automated Pagination

Bypass standard UI limits to iterate through thousands of pages of search results without dropping records.

Anti-Bot Circumvention

Handle Zauba's aggressive IP rate limiting and CAPTCHA challenges using residential proxies and automated solving.

// engagement pipeline

From HS code list to warehouse record

Brief in. Clean data out.

Define Scope
d 0

Provide HS codes, product keywords, or company names. We design the extraction schema together.

Pipeline Build
d 2–4

We configure Scrapy crawlers, proxy rotation, session management, and CAPTCHA handling for zauba.com.

Validation & QA
d 4–6

Schema validation, null-rate checks, and unit price normalisation before full launch.

Delivery
ongoing

JSON / CSV / Parquet pushed to your S3 bucket, BigQuery dataset, or Snowflake stage on agreed cadence.

Under the hood

How our Zauba pipeline handles the hard parts

Zauba protects its trade data with rate limits and CAPTCHAs. Here is how we maintain steady extraction throughput.

pipeline-monitor · zauba.com · live ● active
// fingerprinting
Identity rotation
TLS fingerprintrandomised
User-agentrotated
IP poolresidential
Challenges blocked0
// pagination
Page coverage
48,291 pages queued running
// observability
Pipeline health
99.9%
uptime
142ms
p99 lat
0.3%
null rate
2
alerts
CAPTCHA walls
Automated solving at scale

Zauba frequently triggers CAPTCHAs during heavy pagination or specific HS code searches. We integrate CapSolver and 2Captcha directly into the request pipeline to clear challenges without manual intervention.

Unstructured descriptions
Text parsing and normalisation

Shipment descriptions on Zauba are often noisy, concatenated strings entered by customs brokers. We clean and normalise these text fields to extract core product identifiers and specifications.

IP blocking
Residential proxy rotation

Zauba aggressively rate-limits datacenter IPs. We route traffic through Indian residential ISP proxies, rotating per request to maintain high concurrency without triggering blocks.

DOM inconsistency
Resilient table parsing

Table structures for shipment records can vary between historical data and recent entries. Our parsers use structural heuristics rather than rigid XPath indices to extract rows reliably.

Pagination limits
Deep search extraction

Standard searches often cap at a limited number of pages. We use date-range chunking and specific filter combinations to bypass these limits and extract the complete dataset.

Applications

Who uses Zauba data — and how

Teams across industries use zauba.com data to build competitive products and smarter operations.

01
Supply Chain Intelligence

Manufacturers track raw material imports to map global supply chains and identify alternative sourcing regions.

02
Competitor Sourcing Analysis

Brands monitor competitor import volumes and unit costs to reverse-engineer product margins and supplier relationships.

03
Price Benchmarking

Procurement teams use aggregate unit price data across specific HS codes to negotiate better terms with overseas suppliers.

04
Lead Generation for Freight Forwarders

Logistics companies identify high-volume importers and exporters across specific trade lanes to target new client acquisition.

05
Raw Material Tracking

Commodity traders monitor import volumes of specific raw materials to forecast domestic supply gluts or shortages.

06
Market Share Estimation

Analysts aggregate import quantities of finished goods to estimate domestic market share for foreign brands.

Why DataFlirt

"Zauba holds the definitive ledger of Indian cross-border trade — but extracting millions of paginated shipment rows requires serious bypass infrastructure."

Most teams underestimate the investment required: reliable Zauba scraping requires residential proxies, CAPTCHA solving at scale, deep pagination handling, and anomaly monitoring for malformed table rows. DataFlirt absorbs that complexity so your engineers can focus on the analysis — not the infrastructure.

Technical Spec

Zauba scraper — technical capabilities

Everything supported by our zauba.com scraper — rendered SPA elements, auth walls, rate-limit evasion and beyond.

CAPTCHA bypass
Automated integration with CapSolver for search and pagination walls
Supported
Residential proxy rotation
Indian ISP proxies to bypass geographic rate limiting
Supported
Deep pagination extraction
Date-range chunking to bypass standard UI search limits
Supported
UQC normalisation
Standardisation of unit quantity codes (KGS, NOS, LTR, etc.)
Supported
Historical backfills
Extraction of past years' shipment data for trend analysis
Supported
HS Code taxonomy mapping
Linking shipment records to specific 8-digit chapter headings
Supported
Change detection (diffs)
Only emit new shipment records since the last pipeline run
Supported
Webhook delivery
HTTP POST per batch for downstream processing
Supported
Masked buyer/supplier names
Zauba redacts specific company names for privacy or premium tiers
Partial
Unredacted trade secrets
Proprietary formulations or exact component manifests not filed with customs
Partial
Infrastructure

Infrastructure powering the Zauba pipeline

Open-source tooling on proven cloud infra — no vendor lock-in, full observability.

ScrapyPlaywrightPython 3.12RedisPostgreSQLApache AirflowAWS LambdaS3CloudWatch2CaptchaCapSolverResidential ProxiesDockerKubernetesGrafanaPrometheus
Scrapy + Playwright Stack

Scrapy handles high-throughput extraction of static tables, while Playwright manages complex search submissions and CAPTCHA challenge rendering.

Residential Proxy Infrastructure

We maintain pools of Indian residential IPs to ensure requests appear as legitimate domestic traffic, bypassing strict datacenter blocks.

Cloud-Native Orchestration

Pipelines run on Kubernetes. Airflow handles scheduling, dependency management, and SLA alerting. All state stored in managed Postgres.

Output & Delivery

Your data, your destination

Data delivered to where your team already works — no new tooling required.

JSON
Newline-delimited or nested — schema versioned per run
CSV
Flat file with typed columns — Excel/Sheets compatible
XLS
Legacy spreadsheet format for business analysts
Parquet
Columnar format for BigQuery, Snowflake, Athena
AWS S3
Direct bucket delivery — compatible with any data lake
Webhook
HTTP POST per record for real-time downstream processing
API
REST endpoints to query your extracted dataset
BigQuery
Streamed directly into your dataset with schema auto-detect
PostgreSQL
Upsert into your existing schema with conflict resolution
S3
Direct bucket delivery — compatible with any data lake
// faq

Common questions.

About zauba.com scraping, legality, and pipeline operations.

Ask us directly →
Is scraping Zauba legal?

Scraping publicly accessible trade data is generally permissible. We target only public shipment logs, HS codes, and company data displayed on zauba.com. Clients should consult legal counsel for specific commercial use cases.

How do you handle masked buyer and supplier names?

Zauba redacts certain importer and exporter names on the public UI. Our scraper captures exactly what is visible on the page. We cannot unmask names that Zauba has actively hidden.

How fresh is the shipment data?

We can schedule pipelines to run daily or weekly to capture the latest shipment records as soon as Zauba indexes them. Note that Indian customs data often has a slight inherent lag before appearing on public portals.

Can you extract historical data from previous years?

Yes. We can configure backfill pipelines to extract historical shipment records for specific HS codes or product keywords spanning multiple years.

Do you standardise the quantity units?

Yes. We extract the raw quantity and the associated Unit Quantity Code (UQC), allowing you to normalise volumes (e.g., converting NOS, KGS, or PAC) in your downstream analysis.

What is the minimum viable engagement?

Our smallest packages start at a defined set of HS codes or product keywords with monthly delivery. For full category monitoring, we price based on data volume and extraction frequency.

$ dataflirt scope --new-project --source=zauba.com ready

Tell us what
to extract.
We do the rest.

20-minute scoping call. Pilot dataset within the week. Production within two. Whether you need historical shipment logs for a single HS code or continuous tracking of entire product categories — we scope, build, and operate the pipeline. Tell us what you need.

hello@dataflirt.com · Bengaluru · IST · typical reply < 4h
Related Scrapers

More in industrial and mro

Services

Data Extraction for Every Industry

View All Services →