SYSTEM all green source lincraft.com.au queue 12,408 pages p99 latency 215ms dataflirt.com · scraper/lincraft-com.au
RUN * 14 active pipelines * lincraft.com.au live

Lincraft retail data,
at warehouse scale.

We extract fabric by the metre, yarn specifications, haberdashery catalogues, and store-level inventory from Lincraft. Delivered as clean JSON, CSV, or Parquet to S3, BigQuery, or Snowflake on your cadence.

Products extracted
45.2K /run
Price updates
18.9K /24h
Inventory checks
284K /day
Active pipelines
14
Uptime
99.98%
Data Dictionary

Every field we extract from lincraft.com.au

Structured, schema-consistent data across all major object types — delivered clean, typed, and ready to query.

Complete list of extractable fields for Fabric & Textiles objects from lincraft.com.au. All fields typed and schema-versioned.

skutitlebrandprice_per_metreclub_pricecompositionwidth_cmweight_gsmcare_instructionscolourpattern_typestock_statuscategoryurl
fabric_& textiles
● 200 OK
"sku": "LC-8472910",
"title": "Printed Cotton Poplin Floral",
"price_per_metre": 14.99,
"club_price": 11.99,
"composition": "100% Cotton",
"width_cm": 112,
"colour": "Navy Floral",
"stock_status": "In Stock"
# skutitlebrandprice_per_metreclub_pricecomposition
1
2
3

Complete list of extractable fields for Yarn & Knitting objects from lincraft.com.au. All fields typed and schema-versioned.

skutitlebrandweight_gplyblendneedle_size_mmtensionlength_mpriceclub_pricecolourwaydye_lot_tracking
yarn_& knitting
● 200 OK
"sku": "LC-392811",
"title": "Makr Cotton Blend 8 Ply Yarn",
"brand": "Makr",
"ply": "8 Ply",
"blend": "50% Cotton 50% Acrylic",
"needle_size_mm": "4.00",
"length_m": 120,
"price": 6.0
# skutitlebrandweight_gplyblend
1
2
3

Complete list of extractable fields for Pricing & Inventory objects from lincraft.com.au. All fields typed and schema-versioned.

skubase_priceclub_pricediscount_pctstore_idstore_namepostcodeclick_collect_availablestock_leveldelivery_availablepromotion_texttimestamp
pricing_& inventory
● 200 OK
"sku": "LC-8472910",
"base_price": 14.99,
"club_price": 11.99,
"store_name": "Lincraft Melbourne CBD",
"postcode": "3000",
"click_collect_available": true,
"stock_level": "Low Stock",
"timestamp": "2024-05-12T08:30:00Z"
# skubase_priceclub_pricediscount_pctstore_idstore_name
1
2
3

Complete list of extractable fields for Haberdashery objects from lincraft.com.au. All fields typed and schema-versioned.

skutitlecategorysub_categorybrandpriceclub_pricedimensionsmaterialpack_sizeratingreview_count
haberdashery
● 200 OK
"sku": "LC-119283",
"title": "Birch Dressmaking Scissors",
"category": "Haberdashery",
"sub_category": "Scissors & Cutting",
"brand": "Birch",
"price": 34.95,
"material": "Stainless Steel",
"pack_size": 1
# skutitlecategorysub_categorybrandprice
1
2
3

Complete list of extractable fields for Reviews & Ratings objects from lincraft.com.au. All fields typed and schema-versioned.

review_idskureviewer_namestar_ratingreview_titlereview_bodyreview_dateverified_buyerhelpful_voteslocation
reviews_& ratings
● 200 OK
"review_id": "REV-99281",
"sku": "LC-392811",
"star_rating": 5,
"review_title": "Great yarn for blankets",
"review_body": "Soft and easy to work with. Holds up well in the wash.",
"review_date": "2023-11-04",
"verified_buyer": true,
"helpful_votes": 12
# review_idskureviewer_namestar_ratingreview_titlereview_body
1
2
3

Capabilities

Extract every thread of Lincraft retail data

Our pipeline handles the complexities of craft retail: metric conversions, multi-store inventory polling, variant mapping for colourways, and Club Lincraft pricing tiers.

Fabric & Textile Specifications

Extract precise composition percentages, fabric width in centimetres, GSM weight, and care instructions for all cut-to-length textiles.

Yarn & Knitting Metadata

Capture ply counts, blend ratios, recommended needle sizes, tension gauges, and metreage per ball across all yarn categories.

Club Lincraft Pricing

Simultaneously extract standard retail pricing and Club Lincraft member pricing, calculating exact discount margins per SKU.

Store-Level Inventory Polling

Query Click & Collect availability and stock levels across specific postcodes or store IDs to map regional inventory distribution.

Colourway Variant Mapping

Link parent product listings to child variants, capturing specific images, pricing, and stock status for every colour swatch.

Haberdashery Categorisation

Map the deep category tree of tools, notions, and hardware, maintaining the exact breadcrumb hierarchy from the site.

Review Corpus Extraction

Scrape star ratings, review text, and verified buyer tags across product pages to monitor customer sentiment and quality feedback.

Promotional Tracking

Capture multibuy offers, clearance tags, and percentage-off sale badges active during the crawl window.

Delta Exports

Configure pipelines to emit only records that have changed since the last run, reducing data processing overhead.

// engagement pipeline

From product catalogue to warehouse record

Brief in. Clean data out.

Define Scope
d 0

Specify categories, search terms, or target postcodes for inventory polling. We map the required schema.

Pipeline Build
d 2–4

We configure Scrapy spiders to navigate Lincraft's category trees and Playwright to handle dynamic stock lookups.

Validation & QA
d 4–6

Schema validation ensures fabric widths, yarn plies, and Club prices parse correctly without null-rate spikes.

Delivery
ongoing

Clean JSON, CSV, or Parquet delivered to your S3 bucket or Snowflake instance on a daily or weekly schedule.

Under the hood

Handling the complexities of craft retail data

Lincraft's architecture relies on dynamic pricing and location-based stock checks. Here is how we extract it reliably.

pipeline-monitor · lincraft.com.au · live ● active
// fingerprinting
Identity rotation
TLS fingerprintrandomised
User-agentrotated
IP poolresidential
Challenges blocked0
// pagination
Page coverage
48,291 pages queued running
// observability
Pipeline health
99.9%
uptime
142ms
p99 lat
0.3%
null rate
2
alerts
Dynamic inventory
Postcode-specific stock polling

Click & Collect availability requires simulating location inputs. We use Playwright to inject target postcodes and intercept the resulting API responses, mapping stock levels across multiple stores in a single run.

Variant routing
Colour swatch iteration

Fabric and yarn products often have dozens of colour variants that change stock status and imagery. Our crawlers iterate through every swatch element in the DOM to ensure complete variant coverage.

Club pricing
Dual-tier price extraction

Lincraft displays standard pricing alongside Club Lincraft pricing. We extract both values distinctly, normalising the currency format and calculating the exact member discount percentage.

Data normalisation
Standardising craft metrics

Craft data is messy. We parse unstructured description blocks to extract clean integers for GSM, fabric width, needle size, and metreage, ensuring your downstream database receives typed values.

Change detection
Efficient price and stock diffs

We maintain state across runs. If a yarn colourway hasn't changed price or stock status, we skip emitting it. You receive a clean changelog of inventory movements and price drops.

Applications

Who uses Lincraft retail data

Teams across industries use lincraft.com.au data to build competitive products and smarter operations.

01
Competitor Price Monitoring

Craft and fabric retailers track Lincraft's standard and Club pricing to optimise their own promotional calendars and price matching strategies.

02
Assortment & Range Planning

Merchandising teams analyse category depth across yarn, fabric, and haberdashery to identify gaps in their own product ranges.

03
Supply Chain Intelligence

Suppliers monitor stock-out frequencies on specific SKUs across Lincraft store locations to forecast demand and propose replenishment.

04
Textile Market Analysis

Analysts track the introduction of new fabric compositions and yarn blends to identify emerging consumer craft trends.

05
Brand Monitoring

Wholesale brands track how their products are priced, categorised, and reviewed on Lincraft compared to other retail stockists.

06
Project Costing Engines

Craft applications use pricing and metreage data to calculate accurate project costs for sewing and knitting patterns.

Why DataFlirt

"Lincraft holds Australia's most comprehensive catalogue of fabric compositions, yarn specifications, and haberdashery pricing - critical data for retail intelligence."

Extracting structured craft retail data requires parsing complex variant matrices, tracking store-level inventory across postcodes, and handling Club Lincraft member pricing logic. DataFlirt manages the extraction infrastructure so your team can focus on assortment analysis and price matching.

Technical Spec

Lincraft scraper - technical capabilities

Everything supported by our lincraft.com.au scraper — rendered SPA elements, auth walls, rate-limit evasion and beyond.

JavaScript rendering
Playwright execution for dynamic stock checks and variant loading
Supported
Store-level stock checks
Poll inventory status across specific Australian postcodes
Supported
Club Lincraft public pricing
Extract standard and member pricing tiers simultaneously
Supported
Fabric composition parsing
Extract blend percentages, width, and GSM from descriptions
Supported
Yarn specification extraction
Capture ply, tension, needle size, and length
Supported
Variant mapping
Link colourways and sizes to parent SKUs
Supported
Review pagination
Iterate through all product reviews and ratings
Supported
Change detection
Emit only records with changed prices or stock status
Supported
User account purchase history
Requires individual user credentials to access past orders
Partial
Club Lincraft member points
Requires authenticated login to view specific point balances
Partial
Infrastructure

Infrastructure powering the extraction

Open-source tooling on proven cloud infra — no vendor lock-in, full observability.

ScrapyPlaywrightPython 3.12RedisPostgreSQLApache AirflowAWS LambdaS3CloudWatch2CaptchaCapSolverResidential ProxiesDockerKubernetesGrafanaPrometheus
Scrapy + Playwright Stack

Scrapy handles catalogue traversal and deduplication. Playwright handles JavaScript execution for postcode-based inventory lookups.

Residential Proxy Infrastructure

We route requests through Australian residential IPs to ensure location-based pricing and stock data loads correctly.

Cloud-Native Orchestration

Pipelines run on AWS infrastructure managed by Airflow, ensuring reliable delivery schedules and automated retry logic for timeouts.

Output & Delivery

Your data, your destination

Data delivered to where your team already works — no new tooling required.

JSON
Nested schema containing full variant and store matrices
CSV
Flat file with typed columns for immediate spreadsheet use
XLS
Excel format for merchandising and buying teams
Parquet
Columnar format optimised for BigQuery and Athena
AWS S3
Direct bucket delivery on pipeline completion
Webhook
HTTP POST delivery for real-time inventory alerts
API
REST endpoints to query your extracted Lincraft dataset
PostgreSQL
Direct database upserts with conflict resolution
S3
Direct bucket delivery — compatible with any data lake
// faq

Common questions.

About lincraft.com.au scraping, legality, and pipeline operations.

Ask us directly →
Is scraping Lincraft legal?

Scraping publicly available pricing, product specifications, and store location data is generally permissible. DataFlirt extracts only public, non-authenticated information. We do not extract personal user data or bypass authentication systems. Clients should consult their own legal counsel regarding specific commercial use cases.

How do you handle store-level stock checks?

You provide a list of target postcodes or store IDs. Our Playwright instances simulate location input on the product page and capture the resulting Click & Collect availability and stock status for each specified location.

Can you extract Club Lincraft pricing?

Yes. Club Lincraft prices are displayed publicly on the product pages alongside standard retail prices. We extract both values and can calculate the absolute and percentage discount automatically.

How fresh is the data?

Pipeline frequency is configurable. We support daily, weekly, or ad-hoc runs depending on your requirements. Full catalogue runs typically complete within a few hours.

What is the minimum viable engagement?

We build managed pipelines for ongoing data delivery. Minimum engagements typically start with a defined category scope (e.g., all Yarn or all Fabric) delivered weekly. Contact us for specific volume pricing.

Can I request a sample dataset?

Yes. We offer sample extracts containing up to 500 products across various categories to validate schema compatibility and data quality before formal engagement.

$ dataflirt scope --new-project --source=lincraft.com.au ready

Tell us what
to extract.
We do the rest.

20-minute scoping call. Pilot dataset within the week. Production within two. Stop manually checking fabric prices and yarn stock levels. We build and maintain the extraction pipeline so you receive clean data on schedule.

hello@dataflirt.com · Bengaluru · IST · typical reply < 4h
Related Scrapers

More in textile and fabric

Services

Data Extraction for Every Industry

View All Services →