We extract product listings, yarn specifications, colourway variants, pattern metadata, and pricing signals from Deramores. Delivered as clean JSON, CSV, or Parquet to S3, BigQuery, or Snowflake on your cadence.
Structured, schema-consistent data across all major object types — delivered clean, typed, and ready to query.
Complete list of extractable fields for Yarn Listings objects from deramores.com. All fields typed and schema-versioned.
"sku": "DER-YRN-0042", "title": "Stylecraft Special DK", "brand": "Stylecraft", "yarn_weight": "DK", "composition": "100% Acrylic", "tension": "22 stitches, 30 rows to 10cm", "needle_size": "4mm", "ball_weight": "100g", "yardage": "295m", "price": 2.15, "currency": "GBP", "in_stock": true
| # | sku | title | brand | yarn_weight | composition | tension |
|---|---|---|---|---|---|---|
| 1 | ||||||
| 2 | ||||||
| 3 |
Complete list of extractable fields for Colourways objects from deramores.com. All fields typed and schema-versioned.
"parent_sku": "DER-YRN-0042", "variant_sku": "DER-YRN-0042-1005", "colour_name": "Plum", "colour_code": "1005", "swatch_url": "https://cdn.deramores.com/swatches/1005.jpg", "stock_status": "In Stock", "price": 2.15, "discount_pct": 0
| # | parent_sku | variant_sku | colour_name | colour_code | hex_value | image_url |
|---|---|---|---|---|---|---|
| 1 | ||||||
| 2 | ||||||
| 3 |
Complete list of extractable fields for Patterns & Kits objects from deramores.com. All fields typed and schema-versioned.
"sku": "DER-PAT-9921", "title": "Autumn Leaves Cardigan", "designer": "Deramores Studio", "format": "Digital PDF", "difficulty": "Intermediate", "required_yarns": "['DER-YRN-0042-1005', 'DER-YRN-0042-1080']", "required_needles": "['4mm', '4.5mm']", "price": 3.5
| # | sku | title | designer | format | difficulty | required_yarns |
|---|---|---|---|---|---|---|
| 1 | ||||||
| 2 | ||||||
| 3 |
Complete list of extractable fields for Pricing & Offers objects from deramores.com. All fields typed and schema-versioned.
"sku": "DER-YRN-0042", "base_price": 2.15, "sale_price": 1.95, "discount_pct": 9, "clearance_flag": false, "promotional_badge": "Autumn Sale", "currency": "GBP", "scraped_at": "2026-09-14T08:12:44Z"
| # | sku | base_price | sale_price | discount_pct | bulk_discount_tiers | clearance_flag |
|---|---|---|---|---|---|---|
| 1 | ||||||
| 2 | ||||||
| 3 |
Complete list of extractable fields for Reviews & Ratings objects from deramores.com. All fields typed and schema-versioned.
"review_id": "REV-883910", "sku": "DER-YRN-0042", "reviewer_name": "Sarah J.", "rating": 5, "review_title": "Soft and easy to work with", "review_body": "Perfect for my latest blanket project. The plum colour is rich and consistent across balls.", "review_date": "2026-08-22", "verified_purchase": true
| # | review_id | sku | reviewer_name | rating | review_title | review_body |
|---|---|---|---|---|---|---|
| 1 | ||||||
| 2 | ||||||
| 3 |
Yarn and fabric catalogues present unique structural challenges: massive variant counts per parent SKU, complex metadata like tension and gauge, and nested kit components. Our pipeline normalises it all.
Capture structural metadata including yarn weight, composition percentages, tension, gauge, yardage, and recommended needle sizes.
Map up to 100+ colour variants per yarn line. Extract colour names, manufacturer codes, and high-resolution swatch images.
Extract designer names, difficulty levels, required materials, and format types (digital vs physical) from pattern listings.
Parse project kits into their constituent SKUs, mapping the exact quantities of specific yarn colourways required.
Monitor stock availability at the variant level, capturing clearance events and low-stock warnings.
Track base prices, sale discounts, bulk purchase tiers, and promotional badges across the entire catalogue.
Extract customer reviews, star ratings, and verified purchase flags to understand material quality and workability.
Structure data for knitting needles, crochet hooks, and accessories, capturing material type, length, and diameter.
Run continuous pipelines that only emit records when prices drop, new colourways are added, or stock depletes.
Brief in. Clean data out.
Specify target categories, brands, or pattern types. We design the schema to capture textile-specific attributes.
We configure crawlers, handle pagination, and write custom parsers for swatch galleries and kit bundles.
Schema validation ensures all variant mappings are correct and composition percentages total 100.
JSON, CSV, or Parquet pushed to your S3 bucket, BigQuery dataset, or Snowflake stage on agreed cadence.
Scraping textile eCommerce requires precise variant mapping. Here is how we maintain data integrity across thousands of colourways.
Textile sites nest massive amounts of data within a single product URL. We execute JavaScript state changes to iterate through every colourway, extracting the specific SKU, stock status, and price for each variant.
Colour accuracy is critical. We bypass low-res thumbnails and intercept network requests to extract the highest resolution swatch images directly from the CDN.
Kits bundle patterns with specific yarn quantities. Our parsers deconstruct these bundles, mapping the required constituent SKUs and their quantities back to the main catalogue.
Retail sites change DOM structures during seasonal sales. We use fallback chains incorporating CSS selectors, XPath, and JSON-LD structured data to ensure extraction does not fail when layouts shift.
We maintain a state hash of the catalogue. Subsequent runs only push updates when a price changes, a new colourway is added, or a dye lot goes out of stock, reducing your processing compute.
Specialist retailers track base prices, clearance events, and bulk discounts on major yarn brands to remain competitive.
Merchandisers analyse new colourway introductions and category expansion to identify market trends.
Monitor out-of-stock rates across specific brands and yarn weights to anticipate supply chain bottlenecks.
Machine learning teams use structured textile data to train models for pattern generation or colour matching.
Analysts track brand dominance within specific product categories like DK yarn or circular needles.
Yarn manufacturers audit retail pricing to ensure compliance with Minimum Advertised Price agreements.
"Deramores holds a critical textile dataset: thousands of yarn variants mapped perfectly to gauge, tension, and composition metrics."
Extracting crafting supplies requires more than basic HTML parsing. Colourway swatches load dynamically, kit components are nested within pattern pages, and stock levels fluctuate wildly during clearance events. DataFlirt manages this complexity so your merchandising teams can focus on analysis.
Everything supported by our deramores.com scraper — rendered SPA elements, auth walls, rate-limit evasion and beyond.
Open-source tooling on proven cloud infra — no vendor lock-in, full observability.
Scrapy handles orchestration and deduplication. Playwright executes JavaScript to iterate through complex colourway selectors and trigger dynamic image loading.
We route traffic through UK-based residential ISP proxies, rotating IPs per request to bypass rate limits during full-catalogue extraction runs.
Pipelines run on AWS Lambda and ECS. Airflow manages scheduling and dependencies, while all state and diff hashes are stored in managed Postgres.
Data delivered to where your team already works — no new tooling required.
About deramores.com scraping, legality, and pipeline operations.
Ask us directly →Scraping publicly available catalogue and pricing data is generally permissible. DataFlirt targets only public product listings and reviews. We do not extract personal data, bypass authentication walls, or download copyrighted digital patterns. Clients should consult legal counsel for their specific use cases.
We use Playwright to execute the JavaScript required to select each colourway. This allows us to map the specific variant SKU, stock status, price, and swatch image back to the parent yarn product.
Yes. We parse pattern and kit pages to extract metadata including designer, difficulty, and the specific list of required yarn SKUs and needle sizes.
Pipelines can be configured to run daily or at higher frequencies for specific high-velocity categories. Change detection ensures you only process updates when stock status shifts.
No. Digital patterns are copyrighted assets and often gated behind a paywall. We only extract the public metadata, pricing, and required materials listed on the product page.
We typically scope pipelines starting at a full catalogue extraction with weekly updates. Pricing scales based on delivery frequency and schema complexity. Contact us for a precise quote.
Yes. We provide a sample extraction of up to 500 products during the scoping phase, allowing your team to validate the schema, variant mapping, and data quality.
20-minute scoping call. Pilot dataset within the week. Production within two. Whether you need a one-off catalogue dump or a continuous price-monitoring feed across thousands of yarn variants, we build and operate the pipeline. Tell us what you need.
