We extract yarn specifications, WEBS discount pricing, colourway variants, pattern requirements, and review data from yarn.com. Delivered as clean JSON, CSV, or Parquet to S3, BigQuery, or Snowflake on your cadence.
Structured, schema-consistent data across all major object types — delivered clean, typed, and ready to query.
Complete list of extractable fields for Yarn Specifications objects from yarn.com. All fields typed and schema-versioned.
"sku": "VAL-BERK-01", "brand": "Valley Yarns", "product_name": "Berkshire Bulky", "yarn_weight": "Bulky", "fibre_content": "85% Wool / 15% Alpaca", "yardage": 108, "gauge": "3.5 sts = 1 inch", "needle_size": "US 10.5 (6.5mm)"
| # | sku | brand | product_name | yarn_weight | fibre_content | yardage |
|---|---|---|---|---|---|---|
| 1 | ||||||
| 2 | ||||||
| 3 |
Complete list of extractable fields for Pricing & WEBS Discounts objects from yarn.com. All fields typed and schema-versioned.
"sku": "VAL-BERK-01", "base_price": 10.99, "sale_price": "None", "webs_discount_eligible": true, "discount_tier_20_pct": 8.79, "discount_tier_25_pct": 8.24, "closeout_status": false, "price_timestamp": "2026-08-14T10:12:00Z"
| # | sku | base_price | sale_price | webs_discount_eligible | discount_tier_20_pct | discount_tier_25_pct |
|---|---|---|---|---|---|---|
| 1 | ||||||
| 2 | ||||||
| 3 |
Complete list of extractable fields for Colourways & Inventory objects from yarn.com. All fields typed and schema-versioned.
"parent_sku": "VAL-BERK-01", "variant_sku": "VAL-BERK-01-41", "colour_name": "Burgundy", "colour_number": "41", "in_stock": true, "stock_level": 142, "dye_lot_warning": true
| # | parent_sku | variant_sku | colour_name | colour_number | hex_code | image_url |
|---|---|---|---|---|---|---|
| 1 | ||||||
| 2 | ||||||
| 3 |
Complete list of extractable fields for Patterns & Kits objects from yarn.com. All fields typed and schema-versioned.
"pattern_id": "PAT-VAL-102", "title": "Valley Yarns 102 Cable Cardigan", "designer": "Valley Yarns Designer", "craft_type": "Knitting", "difficulty": "Intermediate", "required_yardage": "1200-1500", "price": 5.99
| # | pattern_id | title | designer | craft_type | difficulty | required_yarn |
|---|---|---|---|---|---|---|
| 1 | ||||||
| 2 | ||||||
| 3 |
Complete list of extractable fields for Reviews & Ratings objects from yarn.com. All fields typed and schema-versioned.
"review_id": "REV-99281", "sku": "VAL-BERK-01", "rating": 5, "review_title": "Soft and works up quickly", "helpful_votes": 12, "verified_purchase": true, "date_posted": "2026-07-22"
| # | review_id | sku | reviewer_name | rating | review_title | review_text |
|---|---|---|---|---|---|---|
| 1 | ||||||
| 2 | ||||||
| 3 |
Our scraper captures the full depth of textile metadata, handling complex colourway grids, dynamic discount tiering, and inventory states with precision.
Extract exact fibre percentages, gauge metrics, weight classifications, and needle size requirements for every yarn line.
Capture base prices alongside the 20% and 25% WEBS discount tiers, including eligibility flags and closeout statuses.
Scrape all child variants under a parent SKU, including colour names, reference numbers, and specific image URLs.
Monitor in-stock status, backorder dates, and low-stock warnings across individual colourway variants.
Extract required yarn lines, total yardage, craft type, and difficulty levels from digital and physical pattern listings.
Gather star ratings, review text, and verified purchase flags to analyse customer sentiment on specific textile blends.
Maintain the exact category tree and brand associations, from major manufacturers to independent dyers.
Track specific dye lot availability notices and mixed-lot warnings on low-inventory items.
Run daily diffs to capture only new products, price changes, or stock status shifts without re-processing the entire catalogue.
Brief in. Clean data out.
Provide target brands, categories, or specific URLs. We map the required textile data fields.
We configure Scrapy / Playwright crawlers to handle yarn.com pagination, variant grids, and pricing logic.
Schema validation, null-rate checks on critical specs like fibre content, and price-tier verification.
JSON / CSV / Parquet pushed to your S3 bucket, BigQuery dataset, or Snowflake stage on agreed cadence.
Extracting textile data requires navigating dense variant matrices and dynamic pricing models. Here is how we ensure data integrity.
A single yarn line on yarn.com can feature over 80 colourways, each with its own stock status and ID. We iterate through the JavaScript-rendered variant selection grid to emit a flat, queryable record for every individual colourway.
Yarn.com applies a complex volume discount model (the WEBS discount) that reduces prices by 20% or 25% based on cart value, but excludes certain brands and closeouts. We extract the eligibility flags and calculate the exact tier pricing for your records.
To prevent IP bans during deep catalogue crawls, we route requests through US-based residential proxies with strict concurrency limits, mimicking normal browsing behaviour across category pagination.
Fibre content is often written in unstructured text strings. We parse and normalise these strings into structured key-value pairs, ensuring your database receives clean percentages rather than raw HTML blocks.
For clients monitoring stock levels, we run high-frequency passes over target SKUs, using hash comparisons to emit only records where inventory status or pricing has changed since the last run.
Independent yarn retailers track closeouts and WEBS discount pricing to adjust their own promotional calendars.
Distributors monitor stock depth across major brands to anticipate supply chain bottlenecks in specific fibre types.
Textile manufacturers analyse trending fibre blends, popular gauge weights, and colourway saturation to inform product development.
Crafting applications map required yarn specifications to their internal databases to suggest alternative yarns for specific patterns.
Yarn brands audit retail pricing to ensure compliance with Minimum Advertised Price policies across standard and discount tiers.
ML teams train recommendation engines on the relationships between pattern difficulty, craft type, and selected fibre blends.
"Yarn.com holds the definitive catalogue of commercial textile specifications, but extracting nested colourway grids and dynamic discount tiers requires dedicated infrastructure."
Textile data extraction fails on variant complexity. A single yarn line might have 80 colourways, each with distinct stock levels and WEBS discount eligibility. DataFlirt handles the JavaScript rendering and variant mapping so your engineers receive clean, normalised textile data without touching a single DOM element.
Everything supported by our yarn.com scraper — rendered SPA elements, auth walls, rate-limit evasion and beyond.
Open-source tooling on proven cloud infra — no vendor lock-in, full observability.
Scrapy manages the crawl orchestration and deduplication, while Playwright handles the JavaScript rendering required to expose full colourway grids and dynamic pricing.
We route requests through US-based residential IP pools, rotating per request to prevent rate limiting and ensure uninterrupted access to the catalogue.
Pipelines execute on AWS infrastructure with Airflow scheduling. Data is normalised and pushed directly to your warehouse with strict SLA monitoring.
Data delivered to where your team already works — no new tooling required.
About yarn.com scraping, legality, and pipeline operations.
Ask us directly →Yes. We iterate through the variant selection elements on the product page to extract the specific SKU, colour name, hex code reference, and stock status for every colourway associated with a yarn line.
We capture the base retail price and check the product's discount eligibility flag. We then calculate and provide the 20% and 25% discount tier prices directly in the output payload.
We extract the raw fibre string and apply parsing logic to normalise it into structured key-value pairs (e.g., 80% Merino Wool, 20% Nylon), making it immediately queryable.
Yes. We can configure daily or sub-daily runs on specific SKUs. Using hash-based diffing, we output only the records where stock status or pricing has changed.
Yes. We extract the metadata from pattern listings, including required yarn brands, total yardage estimates, needle sizes, and difficulty levels.
Pipelines can be configured for one-off bulk extractions, weekly catalogue refreshes, or daily inventory monitoring depending on your requirements.
20-minute scoping call. Pilot dataset within the week. Production within two. Whether you need a full catalogue extraction or continuous tracking of WEBS discount pricing and colourway inventory — we handle the infrastructure. Tell us your requirements.
