SYSTEM all green source lovecrafts.com queue 12,409 pages p99 latency 184ms dataflirt.com · scraper/lovecrafts-com
RUN · 14 active pipelines · lovecrafts.com live

Crafting data,
at warehouse scale.

We extract yarn compositions, independent pattern listings, designer profiles, pricing, and project galleries from LoveCrafts. Delivered as clean JSON, CSV, or Parquet to S3, BigQuery, or Snowflake on your cadence.

Yarn SKUs extracted
42.1K /day
Patterns tracked
114K /week
Designer profiles
8.3K /run
Active pipelines
14
Uptime
99.94%
Data Dictionary

Every field we extract from lovecrafts.com

Structured, schema-consistent data across all major object types — delivered clean, typed, and ready to query.

Complete list of extractable fields for Yarn & Supplies objects from lovecrafts.com. All fields typed and schema-versioned.

product_idbrandnamecompositionyarn_weighttension_gaugeneedle_sizepricecurrencyyardage_meterscare_instructionscolourways_availablestock_statusurl
yarn_& supplies
● 200 OK
"product_id": "YRN-8492",
"brand": "Paintbox Yarns",
"name": "Simply Chunky",
"composition": "100% Acrylic",
"yarn_weight": "Chunky",
"tension_gauge": "14 stitches, 20 rows to 10cm",
"price": 3.5,
"currency": "GBP",
"stock_status": "In Stock"
# product_idbrandnamecompositionyarn_weighttension_gauge
1
2
3

Complete list of extractable fields for Digital Patterns objects from lovecrafts.com. All fields typed and schema-versioned.

pattern_idtitledesigner_namecraft_typedifficulty_levelsizes_availableyarn_weight_requiredyardage_requiredpricecurrencyratingreview_countdownloadable
digital_patterns
● 200 OK
"pattern_id": "PAT-19384",
"title": "Classic Raglan Sweater",
"designer_name": "Jane Knits",
"craft_type": "Knitting",
"difficulty_level": "Intermediate",
"yarn_weight_required": "DK",
"price": 6.0,
"rating": 4.8
# pattern_idtitledesigner_namecraft_typedifficulty_levelsizes_available
1
2
3

Complete list of extractable fields for Designer Profiles objects from lovecrafts.com. All fields typed and schema-versioned.

designer_idnamebiojoined_datepattern_countfollower_countsocial_linkstop_selling_patternaverage_ratingprofile_url
designer_profiles
● 200 OK
"designer_id": "DES-992",
"name": "Jane Knits",
"pattern_count": 42,
"follower_count": 1205,
"top_selling_pattern": "Classic Raglan Sweater",
"average_rating": 4.7,
"profile_url": "https://www.lovecrafts.com/en-gb/user/Jane-Knits"
# designer_idnamebiojoined_datepattern_countfollower_count
1
2
3

Complete list of extractable fields for Reviews & Ratings objects from lovecrafts.com. All fields typed and schema-versioned.

review_idproduct_idproduct_typereviewer_namestar_ratingreview_textdate_postedcraft_experience_levelhelpful_votesverified_buyer
reviews_& ratings
● 200 OK
"review_id": "REV-38471",
"product_id": "YRN-8492",
"star_rating": 5,
"review_text": "Great stitch definition and very soft for acrylic.",
"date_posted": "2025-11-14",
"craft_experience_level": "Advanced",
"helpful_votes": 12,
"verified_buyer": true
# review_idproduct_idproduct_typereviewer_namestar_ratingreview_text
1
2
3

Complete list of extractable fields for Community Projects objects from lovecrafts.com. All fields typed and schema-versioned.

project_iduser_nameproject_titlepattern_usedyarn_usedstatusstart_datecompletion_datelikes_countimage_urls
community_projects
● 200 OK
"project_id": "PRJ-5582",
"user_name": "KnitCrafter99",
"project_title": "Winter Beanie",
"pattern_used": "Basic Ribbed Hat",
"yarn_used": "Paintbox Yarns Simply Chunky",
"status": "Completed",
"likes_count": 45,
"image_urls": "['https://images.lovecrafts.com/project-5582-1.jpg']"
# project_iduser_nameproject_titlepattern_usedyarn_usedstatus
1
2
3

Capabilities

Everything you need from LoveCrafts

Our pipeline handles the specific metadata of the crafting world: yarn compositions, gauge metrics, independent designer listings, and community project mapping.

Yarn Specification Extraction

Capture composition percentages, weight classifications, tension gauge, and recommended needle sizes for every yarn SKU.

Digital Pattern Mining

Extract independent designer listings, mapping difficulty levels, required yardage, and craft types across thousands of PDFs.

Price & Promotion Tracking

Monitor base prices, clearance discounts, and multi-buy promotions across GBP, USD, and EUR localised storefronts.

Stock Level Monitoring

Track availability at the colourway level to identify supply chain constraints and popular dye lots.

Designer Intelligence

Analyse independent creator output, tracking pattern release velocity, pricing strategies, and community ratings.

Review Aggregation

Extract full review text and star ratings, filtering by the self-reported craft experience level of the reviewer.

Community Project Scraping

Map the relationship between patterns and the actual yarns users choose by scraping community project galleries.

Multi-Region Support

Extract localised catalogues for the UK, US, and EU markets from a unified schema.

Change Detection

Run continuous pipelines that only emit records when prices, stock status, or review counts change.

// engagement pipeline

From craft category to warehouse record

Brief in. Clean data out.

Define Scope
d 0

Provide category URLs, brand lists, or designer profiles. We design the extraction schema together.

Pipeline Build
d 2–4

We configure Scrapy crawlers, proxy rotation, and session management tailored for lovecrafts.com.

Validation & QA
d 4–6

Schema validation, null-rate checks, and variant mapping verification before full launch.

Delivery
ongoing

JSON / CSV / Parquet pushed to your S3 bucket or Snowflake stage on agreed cadence.

Under the hood

Handling the complexity of crafting data

Extracting data from LoveCrafts requires parsing highly specific variant matrices and managing dynamic frontend filtering.

pipeline-monitor · lovecrafts.com · live ● active
// fingerprinting
Identity rotation
TLS fingerprintrandomised
User-agentrotated
IP poolresidential
Challenges blocked0
// pagination
Page coverage
48,291 pages queued running
// observability
Pipeline health
99.9%
uptime
142ms
p99 lat
0.3%
null rate
2
alerts
Variant complexity
Colourways and dye lots

Yarn listings on LoveCrafts often feature 50+ colour variants on a single product page. Our crawlers iterate through every variant combination to capture specific stock status and pricing per colourway.

JavaScript rendering
React-based filtering

Category pages and community galleries rely heavily on client-side rendering. We deploy Playwright to execute JavaScript, ensuring we capture items loaded dynamically via infinite scroll and AJAX filters.

Schema stability
Resilient metadata parsing

Crafting metadata (gauge, composition, yardage) is often formatted inconsistently across different brands. We use regex and NLP parsing to normalise unstructured text into clean, typed database columns.

Anti-bot layer
Residential proxy rotation

To prevent IP bans and rate limiting, our infrastructure routes requests through UK and US residential proxies, mimicking natural browsing patterns across the LoveCrafts catalogue.

Change detection
Only re-scrape what changes

For large pattern catalogues, we maintain a hash index of last-seen values. Subsequent runs only push diffs for price changes or new reviews, reducing downstream processing load.

Applications

Who uses LoveCrafts data

Teams across industries use lovecrafts.com data to build competitive products and smarter operations.

01
Competitor Price Monitoring

Retailers track pricing, promotions, and clearance events across major yarn brands to optimise their own pricing strategies.

02
Assortment Planning

Merchandisers identify trending yarn weights, compositions, and colourways based on review velocity and stock depletion rates.

03
Designer Trend Analysis

Publishers and yarn brands track popular independent pattern creators to identify partnership and sponsorship opportunities.

04
Supply Chain Forecasting

Manufacturers monitor stockouts on specific dye lots and materials to anticipate market demand and adjust production schedules.

05
Market Research

Analysts track the shift in popularity between different craft types (knitting vs crochet) over time.

06
AI Recommendation Training

ML teams map patterns to their required yarn types and user execution to build better product recommendation engines.

Why DataFlirt

"LoveCrafts holds the definitive graph mapping independent pattern designers to specific yarn compositions and community execution."

Extracting crafting data requires parsing highly specific metadata: yarn weights, gauge metrics, and dye lot variations. DataFlirt handles the complex variant mapping and JavaScript rendering so your analysts can focus on market trends rather than broken DOM selectors.

Technical Spec

LoveCrafts scraper — technical capabilities

Everything supported by our lovecrafts.com scraper — rendered SPA elements, auth walls, rate-limit evasion and beyond.

JavaScript rendering
Full Playwright sessions for infinite scroll and dynamic filtering
Supported
CAPTCHA bypass
Automated solver integration for WAF challenges
Supported
Residential proxy rotation
ISP-grade residential IPs rotated per request
Supported
Yarn colourway mapping
Extract stock and price for every individual colour variant
Supported
Designer pattern aggregation
Collect all patterns associated with specific designer profiles
Supported
Community project mapping
Link user projects to the specific patterns and yarns used
Supported
Change detection (diffs)
Hash-based diff: only emit records with changed fields
Supported
PDF pattern downloads
Actual digital pattern files are gated behind purchase transactions
Partial
User purchase history
Requires individual account authentication and violates privacy policies
Partial
Infrastructure

Infrastructure powering the pipeline

Open-source tooling on proven cloud infra — no vendor lock-in, full observability.

ScrapyPlaywrightPython 3.12RedisPostgreSQLApache AirflowAWS LambdaS3CloudWatch2CaptchaCapSolverResidential ProxiesDockerKubernetesGrafanaPrometheus
Scrapy + Playwright Stack

Scrapy handles crawl orchestration and retry logic. Playwright handles JavaScript rendering for dynamic category filters and community galleries.

Residential Proxy Infrastructure

We maintain pools of residential ISP proxies across UK and US regions. Rotation happens per-request to bypass rate limits.

Cloud-Native Orchestration

Pipelines run on AWS Lambda and ECS. Airflow handles scheduling and dependency management. All state stored in managed Postgres.

Output & Delivery

Your data, your destination

Data delivered to where your team already works — no new tooling required.

JSON
Newline-delimited or nested arrays for complex variant data
CSV
Flat file with typed columns for simple catalogue exports
XLS
Excel compatible format for merchandising teams
Parquet
Columnar format for BigQuery, Snowflake, and Athena
AWS S3
Direct bucket delivery compatible with any data lake
Webhook
HTTP POST per record for real-time stock alerts
API
REST endpoints to query your extracted datasets
PostgreSQL
Direct database insertion with schema normalisation
S3
Direct bucket delivery — compatible with any data lake
// faq

Common questions.

About lovecrafts.com scraping, legality, and pipeline operations.

Ask us directly →
Is scraping LoveCrafts legal?

Scraping publicly available information from LoveCrafts is generally permissible. DataFlirt targets only public, non-authenticated product, pricing, and review data. We do not bypass payment gateways to download PDF patterns or extract personal user data.

Can you extract data for every yarn colourway?

Yes. Our pipeline iterates through the frontend variant selectors to capture exact pricing, stock status, and image URLs for every individual dye lot and colourway listed on a product page.

Do you capture independent designer profiles?

Yes. We extract designer bios, social links, follower counts, and aggregate metrics for their entire pattern catalogue.

How do you handle unstructured yarn specifications?

Crafting metadata can be messy. We use custom parsing logic to normalise tension gauge formats, composition percentages, and recommended needle sizes into structured database columns.

Can you track stock levels over time?

Yes. We can configure daily or hourly pipelines to monitor stock status across specific brands or categories, emitting alerts when items go out of stock.

What delivery formats are supported?

We deliver data in JSON, CSV, XLS, or Parquet formats. Files can be pushed directly to AWS S3, Google Cloud Storage, or streamed via Webhook.

Can I request a sample dataset?

Yes. We provide a sample run of up to 500 products or patterns during the scoping phase so you can validate the schema and data quality before signing a contract.

$ dataflirt scope --new-project --source=lovecrafts.com ready

Tell us what
to extract.
We do the rest.

20-minute scoping call. Pilot dataset within the week. Production within two. Whether you need a daily yarn pricing feed or a complete pattern catalogue export, we scope, build, and operate the pipeline. Tell us what you need.

hello@dataflirt.com · Bengaluru · IST · typical reply < 4h
Related Scrapers

More in textile and fabric

Services

Data Extraction for Every Industry

View All Services →