We extract product specifications, stock depth, dye lot availability, and pricing from Woolwarehouse. Delivered as clean JSON, CSV, or Parquet to S3, BigQuery, or Snowflake on your cadence.
Structured, schema-consistent data across all major object types — delivered clean, typed, and ready to query.
Complete list of extractable fields for Yarn Specifications objects from woolwarehouse.co.uk. All fields typed and schema-versioned.
"sku": "YRN-STY-1001", "brand": "Stylecraft", "range_name": "Special DK", "composition": "100% Acrylic", "weight_category": "DK", "ball_weight_g": 100, "length_m": 295, "tension": "22 stitches, 30 rows to 10cm", "needle_size": "4mm"
| # | sku | brand | range_name | composition | weight_category | ball_weight_g |
|---|---|---|---|---|---|---|
| 1 | ||||||
| 2 | ||||||
| 3 |
Complete list of extractable fields for Colourways & Stock objects from woolwarehouse.co.uk. All fields typed and schema-versioned.
"sku": "YRN-STY-1001-1005", "parent_sku": "YRN-STY-1001", "colour_name": "Aster", "colour_code": "1005", "in_stock": true, "stock_quantity": 142, "price": 2.29, "currency": "GBP", "image_url": "https://woolwarehouse.co.uk/media/aster.jpg"
| # | sku | parent_sku | colour_name | colour_code | dye_lot | in_stock |
|---|---|---|---|---|---|---|
| 1 | ||||||
| 2 | ||||||
| 3 |
Complete list of extractable fields for Knitting Patterns objects from woolwarehouse.co.uk. All fields typed and schema-versioned.
"pattern_id": "PAT-SIR-9082", "brand": "Sirdar", "craft_type": "Knitting", "format": "Physical Leaflet", "yarn_required": "Snuggly DK", "sizes_available": "0-6 months to 2-3 years", "price": 3.5, "image_url": "https://woolwarehouse.co.uk/media/pat9082.jpg"
| # | pattern_id | brand | designer | craft_type | format | yarn_required |
|---|---|---|---|---|---|---|
| 1 | ||||||
| 2 | ||||||
| 3 |
Complete list of extractable fields for Fabric By Length objects from woolwarehouse.co.uk. All fields typed and schema-versioned.
"sku": "FAB-TUL-001", "brand": "Tula Pink", "collection": "Moon Garden", "material": "100% Cotton", "width_cm": 112, "price_per_metre": 16.0, "stock_metres": 24.5, "pattern_repeat_cm": 60
| # | sku | brand | collection | designer | material | width_cm |
|---|---|---|---|---|---|---|
| 1 | ||||||
| 2 | ||||||
| 3 |
Complete list of extractable fields for Pricing & Promotions objects from woolwarehouse.co.uk. All fields typed and schema-versioned.
"sku": "YRN-DRO-005", "base_price": 3.1, "sale_price": 2.15, "discount_pct": 30, "multipack_discount": false, "vat_included": true, "currency": "GBP", "promotion_tag": "Drops Alpaca Party", "scrape_timestamp": "2023-11-01T10:00:00Z"
| # | sku | base_price | sale_price | discount_pct | multipack_discount | vat_included |
|---|---|---|---|---|---|---|
| 1 | ||||||
| 2 | ||||||
| 3 |
Our Woolwarehouse scraper captures the exact specifications required by textile retailers and craft aggregators: composition percentages, dye lot matching, gauge metrics, and real-time stock levels.
Extract exact fibre percentages (e.g., 75% Wool, 25% Nylon) into structured arrays for filtering and search indexing.
Track individual shades, colour codes, and swatch images across massive yarn ranges with 100+ variants.
Capture exact ball counts and metre lengths available in inventory to forecast supplier shortages.
Extract stitch and row counts per 10cm square to enable accurate pattern matching algorithms.
Link knitting and crochet patterns to their required yarn ranges, quantities, and recommended needle sizes.
Calculate per-metre, half-metre, and fat quarter pricing structures from raw fabric listings.
Flag yarns moving to clearance or marked as discontinued to manage secondary market pricing.
Extract recommended tool sizes in metric and US sizing formats directly from yarn bands.
Capture clean swatch images for colourways and pattern photography for visual machine learning models.
Brief in. Clean data out.
Provide brand lists, category URLs, or specific yarn ranges. We design the extraction schema together.
We configure Scrapy crawlers, UK proxy rotation, and variant mapping logic for woolwarehouse.co.uk.
Schema validation, null-rate checks, and composition parsing verification before full launch.
JSON / CSV / Parquet pushed to your S3 bucket, BigQuery dataset, or Snowflake stage on agreed cadence.
Woolwarehouse presents unique categorisation challenges with deep variant trees and complex stock states. We manage the extraction logic so you receive clean tables.
Yarn ranges often have 50 to 100 colourways. We flatten these nested structures into tabular records, ensuring every shade inherits its parent's composition and gauge data.
Craft data often mixes yards, metres, ounces, and grams. Our pipeline parses and standardises these units into consistent numeric fields for database ingestion.
We identify exact stock counts, backorder statuses, and specific dye lot availability, ensuring your inventory models reflect reality.
We extract the relationships between pattern leaflets and the specific yarn ranges they require, building a relational map of the catalogue.
We route requests through UK-based residential proxies to avoid rate limits and geo-blocking during heavy catalogue sweeps.
Independent yarn shops monitor Woolwarehouse pricing, sales, and multi-buy discounts to maintain competitive margins.
Wholesale suppliers track depletion rates of specific colourways across major retailers to anticipate manufacturing orders.
Pattern search engines use detailed yarn specifications to suggest exact alternatives based on gauge and composition.
Retailers analyse new brand additions, seasonal colourway launches, and discontinued lines to spot craft trends.
Secondary markets track specific dye lot availability to help crafters complete projects when primary stock runs out.
AI teams train computer vision models on structured swatch images and text descriptions to automate colour categorisation.
"Textile retail relies on precise specifications. A missing gauge metric or incorrect composition percentage renders the dataset useless for pattern matching."
Extracting data from Woolwarehouse requires handling complex variant matrices where a single yarn range might have 80 colourways, each with distinct stock levels and dye lots. DataFlirt normalises these nested structures into flat, queryable tables for your data warehouse, ensuring every metric from ball weight to needle size is perfectly typed.
Everything supported by our woolwarehouse.co.uk scraper — rendered SPA elements, auth walls, rate-limit evasion and beyond.
Open-source tooling on proven cloud infra — no vendor lock-in, full observability.
Scrapy handles crawl orchestration and deduplication. Playwright handles JavaScript rendering for dynamic stock widgets and variant selectors.
We maintain pools of UK residential ISP proxies. Rotation happens per-request to avoid rate limits during full catalogue extraction.
Pipelines run on AWS Lambda and ECS. Airflow handles scheduling, dependency management, and SLA alerting. All state stored in Postgres.
Data delivered to where your team already works — no new tooling required.
About woolwarehouse.co.uk scraping, legality, and pipeline operations.
Ask us directly →Yes. The scraper iterates through all colourway variants on a product page, extracting the specific colour code, name, stock level, and swatch image for each shade.
Out-of-stock items are captured with a boolean flag and zero stock count. If a restock date is provided on the listing, we extract that as a separate timestamp field.
Yes. We parse raw text like '75% Wool, 25% Nylon' into structured JSON arrays, allowing you to query the dataset for specific fibre content thresholds.
For targeted ASIN or SKU lists, we can run hourly pipelines to monitor stock depth. Full catalogue sweeps are typically executed on a daily or weekly cadence.
Yes. When a pattern page lists required yarn ranges and quantities, we extract these relationships so you can map patterns to active inventory.
Absolutely. We provide a sample run of up to 500 SKUs or specific brand categories as part of the pre-engagement scoping process.
20-minute scoping call. Pilot dataset within the week. Production within two. Whether you need a one-off catalogue dump or continuous stock monitoring across 300K colourways - we scope, build, and operate the pipeline. Tell us what you need.
