SYSTEM all green source foursource.com queue 11,482 profiles p99 latency 312ms dataflirt.com · scraper/foursource-com
RUN * 14 active pipelines * foursource.com live

Foursource data,
at warehouse scale.

We extract manufacturer profiles, fabric catalogues, MOQ thresholds, sustainability certifications, and production capacities from Foursource. Delivered as clean JSON, CSV, or Parquet to S3, BigQuery, or Snowflake on your cadence.

Suppliers extracted
45.8K /month
Material records
1.4M /run
Certifications parsed
342K /run
Active pipelines
14
Uptime
99.94%
Data Dictionary

Every field we extract from foursource.com

Structured, schema-consistent data across all major object types — delivered clean, typed, and ready to query.

Complete list of extractable fields for Manufacturer Profiles objects from foursource.com. All fields typed and schema-versioned.

supplier_idcompany_namecountrycityestablished_yearemployee_countmoq_minimumlead_time_dayswebsite_urlcontact_nameproduct_categoriesexport_markets
manufacturer_profiles
● 200 OK
"supplier_id": "FS-849201",
"company_name": "Apex Textiles Ltd",
"country": "Bangladesh",
"established_year": 1998,
"employee_count": 4500,
"moq_minimum": 1000,
"lead_time_days": 45,
"product_categories": "['Knitwear', 'Activewear']"
# supplier_idcompany_namecountrycityestablished_yearemployee_count
1
2
3

Complete list of extractable fields for Material Catalogues objects from foursource.com. All fields typed and schema-versioned.

material_idsupplier_idnamecompositionweight_gsmwidth_cmpatterncolour_optionsend_useconstruction_typesustainability_tags
material_catalogues
● 200 OK
"material_id": "MAT-59281",
"supplier_id": "FS-849201",
"name": "Organic Cotton Jersey",
"composition": "95% Organic Cotton, 5% Elastane",
"weight_gsm": 180,
"width_cm": 150,
"construction_type": "Single Jersey",
"sustainability_tags": "['GOTS Certified', 'Organic']"
# material_idsupplier_idnamecompositionweight_gsmwidth_cm
1
2
3

Complete list of extractable fields for Certifications objects from foursource.com. All fields typed and schema-versioned.

cert_idsupplier_idcert_typeissuerissue_dateexpiry_datestatusdocument_urlscopeaudit_score
certifications
● 200 OK
"cert_id": "CERT-10482",
"supplier_id": "FS-849201",
"cert_type": "GOTS",
"issuer": "Control Union",
"issue_date": "2025-02-14",
"expiry_date": "2026-02-13",
"status": "Active",
"scope": "Fabric Dyeing, Knitting"
# cert_idsupplier_idcert_typeissuerissue_dateexpiry_date
1
2
3

Complete list of extractable fields for Production Capabilities objects from foursource.com. All fields typed and schema-versioned.

capability_idsupplier_idmachinery_typemachine_countmonthly_capacity_pcsunit_measurespecial_techniquesquality_standardsin_house_processes
production_capabilities
● 200 OK
"capability_id": "CAP-3910",
"supplier_id": "FS-849201",
"machinery_type": "Circular Knitting",
"machine_count": 120,
"monthly_capacity_pcs": 800000,
"special_techniques": "['Garment Dyeing', 'Enzyme Wash']",
"in_house_processes": "['Knitting', 'Dyeing', 'Sewing']"
# capability_idsupplier_idmachinery_typemachine_countmonthly_capacity_pcsunit_measure
1
2
3

Complete list of extractable fields for Trade Show Exhibitors objects from foursource.com. All fields typed and schema-versioned.

event_idevent_nameyearsupplier_idbooth_numbercollection_namefocus_areaattendee_statusbooking_link
trade_show exhibitors
● 200 OK
"event_name": "Premiere Vision Paris",
"year": 2026,
"supplier_id": "FS-849201",
"booth_number": "Hall 4, Stand B12",
"focus_area": "Sustainable Knits",
"attendee_status": "Confirmed",
"collection_name": "SS27 Eco Basics"
# event_idevent_nameyearsupplier_idbooth_numbercollection_name
1
2
3

Capabilities

Everything you need from Foursource, nothing you do not

Our Foursource scraper handles complex B2B portal navigation, extracting supplier networks, material catalogues, and certification documents with session management and anti-bot circumvention built in.

Full Supplier Profiles

Extract company details, factory locations, employee counts, export markets, and minimum order quantities across all manufacturing categories.

Material Catalogue Extraction

Capture fabric composition, weight in GSM, width, construction type, and colour availability for millions of textile records.

Certification Tracking

Parse GOTS, Oeko-Tex, Higg Index, and ISO compliance data including issue dates, expiry dates, and issuer bodies.

Production Capabilities

Extract machinery types, total machine counts, monthly production volumes, and special manufacturing techniques.

Trade Show Data

Map supplier attendance at major industry events like Premiere Vision and Texworld, including booth numbers and collection highlights.

Advanced Search Scraping

Iterate through complex search grids using country, category, material, and certification filters to build comprehensive target lists.

Session Management

Handle authenticated portal access with cookie rotation and session token renewal to access gated B2B supplier data.

Document Parsing

Download and extract metadata from public audit reports and compliance PDF documents linked on supplier profiles.

Scheduled Updates

Run monthly or quarterly capacity refreshes to track changes in supplier capabilities, certifications, and factory footprint.

// engagement pipeline

From search query to warehouse record

Brief in. Clean data out.

Define Scope
d 0

Provide target categories, countries, or material types. We design the extraction schema together.

Pipeline Build
d 2–4

We configure Playwright crawlers, proxy rotation, and authenticated session management for the Foursource portal.

Validation & QA
d 4–6

Schema validation, null-rate checks, and sample profile reviews before full launch.

Delivery
ongoing

JSON, CSV, or Parquet pushed to your S3 bucket, BigQuery dataset, or Snowflake stage on agreed cadence.

Under the hood

How our Foursource pipeline handles the hard parts

B2B sourcing platforms restrict bulk data access to protect their network. Here is how we stay resilient and why teams choose managed infrastructure over DIY.

pipeline-monitor · foursource.com · live ● active
// fingerprinting
Identity rotation
TLS fingerprintrandomised
User-agentrotated
IP poolresidential
Challenges blocked0
// pagination
Page coverage
48,291 pages queued running
// observability
Pipeline health
99.9%
uptime
142ms
p99 lat
0.3%
null rate
2
alerts
Authentication walls
Session token rotation

Foursource gates detailed supplier data behind authenticated user sessions. We manage credential pools, handle cookie rotation, and renew JWT tokens automatically to maintain continuous pipeline execution without triggering account locks.

Dynamic filtering
Playwright for complex search grids

The platform relies heavily on JavaScript-rendered search interfaces with nested category filters. We use full Playwright browser sessions to interact with these dynamic elements, ensuring we capture all paginated results that simple HTTP requests miss.

Rate limiting
Residential proxy pooling

B2B portals aggressively throttle IPs making high-volume requests. We distribute crawl traffic across ISP-grade residential proxies, matching request velocities to standard human browsing patterns to avoid IP bans.

Schema variability
Fallback selectors for incomplete profiles

Supplier profiles vary wildly in completeness. Some list exact machinery counts; others provide only text descriptions. Our extraction logic uses multiple fallback chains and regex patterns to normalise inconsistent data into a strict schema.

Document extraction
PDF parsing for certificates

Crucial compliance data is often locked inside attached PDF documents rather than HTML text. Our pipeline downloads these files, extracts text via OCR where necessary, and parses audit scores and expiry dates into structured fields.

Applications

Who uses Foursource data and how

Teams across industries use foursource.com data to build competitive products and smarter operations.

01
Sourcing & Procurement Intelligence

Apparel brands map global supplier networks to identify factories meeting specific MOQ, lead time, and material requirements.

02
Supply Chain Diversification

Procurement teams discover alternative manufacturers in new geographies to mitigate regional trade risks and reduce dependency.

03
Sustainability Auditing

Compliance officers track valid GOTS, Oeko-Tex, and Higg Index certifications across thousands of potential partners.

04
Competitor Manufacturer Mapping

Market analysts correlate trade show attendance and public factory profiles to map competitor supply chains.

05
Raw Material Trend Forecasting

Textile innovators analyse fibre composition frequencies across millions of fabric catalogues to identify macro material trends.

06
B2B Marketplace Enrichment

Niche industry directories enrich their own databases with verified factory locations, machinery capabilities, and contact points.

Why DataFlirt

"Foursource holds the most comprehensive global index of apparel manufacturers and textile suppliers, but none of it is queryable unless you build the pipeline."

Most teams underestimate the investment required: reliable B2B portal scraping requires authenticated session management, residential proxies, full JavaScript rendering, and daily selector maintenance. DataFlirt absorbs that complexity so your engineers can focus on the analysis, not the infrastructure.

Technical Spec

Foursource scraper technical capabilities

Everything supported by our foursource.com scraper — rendered SPA elements, auth walls, rate-limit evasion and beyond.

JavaScript rendering
Full Playwright sessions required for dynamic search grids and lazy-loaded catalogues
Supported
Authenticated session handling
Automated login and token rotation to access gated supplier data
Supported
PDF certificate extraction
Download and parse attached compliance documents for expiry dates
Supported
Material composition parsing
Regex extraction to normalise complex blend percentages into structured arrays
Supported
Trade show exhibitor mapping
Extract booth numbers and event participation history per supplier
Supported
Residential proxy rotation
ISP-grade residential IPs to bypass strict B2B portal rate limits
Supported
Change detection (diffs)
Hash-based diffing to only emit records with updated machinery or certifications
Supported
Buyer-to-supplier messaging data
Private communication threads between brands and manufacturers
Partial
Private negotiated pricing
Hidden contract pricing shared only in direct 1-to-1 supplier quotes
Partial
Infrastructure

Infrastructure powering the Foursource pipeline

Open-source tooling on proven cloud infra — no vendor lock-in, full observability.

ScrapyPlaywrightPython 3.12RedisPostgreSQLApache AirflowAWS LambdaS3CloudWatch2CaptchaCapSolverResidential ProxiesDockerKubernetesGrafanaPrometheusFastAPITerraform
Scrapy + Playwright Stack

Scrapy handles orchestration and deduplication. Playwright handles JavaScript rendering, cookie sessions, and search grid interaction. Combined via custom middleware.

Session State Management

We maintain distributed pools of authenticated sessions in Redis, rotating JWT tokens and cookies across workers to prevent account flags while sustaining throughput.

Cloud-Native Orchestration

Pipelines run on AWS ECS. Airflow handles scheduling, dependency management, and SLA alerting. All extracted state is versioned in managed Postgres.

Output & Delivery

Your data, your destination

Data delivered to where your team already works — no new tooling required.

JSON
Newline-delimited or nested arrays for complex material catalogues
CSV
Flat file with typed columns for immediate spreadsheet analysis
XLS
Excel format for procurement and sourcing teams
Parquet
Columnar format optimised for BigQuery, Snowflake, and Athena
AWS S3
Direct bucket delivery compatible with any modern data lake
Webhook
HTTP POST per record for real-time downstream processing
API
Queryable REST endpoints for on-demand profile retrieval
BigQuery
Streamed directly into your dataset with schema auto-detect
S3
Direct bucket delivery — compatible with any data lake
// faq

Common questions.

About foursource.com scraping, legality, and pipeline operations.

Ask us directly →
Is scraping Foursource legal?

Scraping B2B directories involves navigating terms of service and authentication walls. DataFlirt extracts factual business data (company names, machinery lists, material specs) which is generally not subject to copyright. We do not extract personal data or private messages. Clients must provide their own access credentials for gated sections and consult legal counsel regarding their specific use case.

How do you handle the login requirement?

Clients provision standard user accounts for the pipeline. Our infrastructure securely stores these credentials, automates the login flow, and rotates session cookies across distributed workers to distribute request load and prevent account suspension.

Can you extract GOTS and Oeko-Tex certificates?

Yes. We capture the certification type, issuing body, issue date, expiry date, and status. Where documents are attached as PDFs, we can download and parse the metadata to verify audit scores and valid dates.

How fresh is the supplier capacity data?

Foursource profiles are updated sporadically by manufacturers. We recommend monthly or quarterly pipeline runs to capture newly added machinery, updated MOQs, and renewed certifications without incurring unnecessary compute costs.

Do you support material composition filtering?

Yes. We extract full material catalogues and normalise the composition strings (e.g., parsing '95% Cotton, 5% Spandex' into structured arrays) so you can filter the final dataset by exact fibre percentages.

What is the minimum viable engagement?

Our minimum engagement typically starts with a defined extraction of 5,000 supplier profiles or a specific material category. For continuous tracking or full-platform scrapes, we price based on volume and required update frequency.

$ dataflirt scope --new-project --source=foursource.com ready

Tell us what
to extract.
We do the rest.

20-minute scoping call. Pilot dataset within the week. Production within two. Whether you need a one-off manufacturer directory export or continuous tracking of global textile capabilities, we scope, build, and operate the pipeline. Tell us what you need.

hello@dataflirt.com · Bengaluru · IST · typical reply < 4h
Related Scrapers

More in textile and fabric

Services

Data Extraction for Every Industry

View All Services →