We extract fabric listings, VIP member pricing, store level stock, and craft supplies from Spotlight. Delivered as clean JSON, CSV, or Parquet to S3, BigQuery, or Snowflake on your cadence.
Structured, schema-consistent data across all major object types — delivered clean, typed, and ready to query.
Complete list of extractable fields for Product Listings objects from spotlightstores.com. All fields typed and schema-versioned.
"sku": "80145293", "title": "Printed Cotton Poplin Fabric", "brand": "Semco", "price": 12.0, "vip_price": 8.4, "currency": "AUD", "unit_of_measure": "metre", "composition": "100% Cotton", "width": "112 cm"
| # | sku | title | brand | category | sub_category | price |
|---|---|---|---|---|---|---|
| 1 | ||||||
| 2 | ||||||
| 3 |
Complete list of extractable fields for Pricing & VIP Offers objects from spotlightstores.com. All fields typed and schema-versioned.
"sku": "80145293", "standard_price": 12.0, "vip_price": 8.4, "discount_pct": 30, "promotion_text": "30% Off All Cotton Poplin", "clearance_flag": false, "price_timestamp": "2026-05-12T09:14:00Z", "region": "AU"
| # | sku | standard_price | vip_price | discount_pct | promotion_text | bargain_guarantee_eligible |
|---|---|---|---|---|---|---|
| 1 | ||||||
| 2 | ||||||
| 3 |
Complete list of extractable fields for Store Inventory objects from spotlightstores.com. All fields typed and schema-versioned.
"sku": "80145293", "store_id": "SPL_042", "store_name": "South Melbourne", "stock_status": "In Stock", "stock_quantity": 45, "click_and_collect_available": true, "last_checked": "2026-05-12T08:30:00Z"
| # | sku | store_id | store_name | state | postcode | stock_status |
|---|---|---|---|---|---|---|
| 1 | ||||||
| 2 | ||||||
| 3 |
Complete list of extractable fields for Craft Projects objects from spotlightstores.com. All fields typed and schema-versioned.
"project_id": "PRJ_9921", "title": "Beginner Tote Bag", "difficulty_level": "Beginner", "estimated_time": "2 Hours", "required_materials": "['Cotton Duck', 'Thread', 'Webbing']", "related_skus": "['802211', '993322']"
| # | project_id | title | difficulty_level | estimated_time | author | required_materials |
|---|---|---|---|---|---|---|
| 1 | ||||||
| 2 | ||||||
| 3 |
Complete list of extractable fields for Reviews & Ratings objects from spotlightstores.com. All fields typed and schema-versioned.
"review_id": "REV_44192", "sku": "80145293", "rating": 5, "review_title": "Great quality cotton", "review_text": "Washes well and easy to sew.", "date_posted": "2025-11-20", "verified_buyer": true
| # | review_id | sku | reviewer_name | rating | review_title | review_text |
|---|---|---|---|---|---|---|
| 1 | ||||||
| 2 | ||||||
| 3 |
Our Spotlight scraper handles every layer of the platform: fabric catalogues, VIP Club member pricing, store inventory, and craft project data with JavaScript rendering and session management built in.
Title, composition, width, care instructions, and unit of measure scraped at SKU level for fabrics, yarns, and craft supplies.
Capture both standard retail price and VIP Club member pricing, including promotional text and discount percentages.
Extract inventory status and Click & Collect availability across 150+ physical store locations in AU, NZ, and Asia.
Map complex variations like yarn dye lots, fabric colours, and blind dimensions into flat, queryable records.
Extract project instructions, material lists, and related SKUs from the Spotlight project hub.
spotlightstores.com operates across AU, NZ, SG, and MY. We extract localised pricing and stock per region.
Monitor clearance categories, Bargain Guarantee eligibility, and limited-time catalogue sales.
Capture base pricing and configuration options for custom blinds, curtains, and shutters.
Run continuous pipelines to monitor restocks on high-demand seasonal fabrics and party supplies.
Brief in. Clean data out.
Provide category URLs, keyword sets, or specific SKUs. We design the extraction schema together.
We configure Scrapy / Playwright crawlers, proxy rotation, and session management for spotlightstores.com.
Schema validation, null-rate checks, price-outlier detection, and sample runs before full launch.
JSON / CSV / Parquet pushed to your S3 bucket, BigQuery dataset, or Snowflake stage on agreed cadence.
Extracting accurate store stock and VIP pricing requires persistent sessions and regional targeting. Here is how we maintain data integrity.
Spotlight uses standard WAF protections. We use residential ISP proxies with realistic browser fingerprints to maintain access and prevent IP bans.
Store stock lookups and variant selectors rely on client-side hydration. We run Playwright to capture dynamic inventory states that simple HTTP clients miss.
VIP pricing extraction requires specific cookie states. We maintain isolated sessions to ensure member prices render correctly during the crawl.
Spotlight routes traffic based on IP location. We use region-specific proxies (AU, NZ, SG, MY) to capture the correct local catalogue and pricing.
Retail DOM structures shift during major sales events. We use multi-layer XPath and CSS fallbacks to prevent pipeline failure.
Retailers track standard and VIP pricing on craft and homewares to maintain price parity and adjust promotions.
Suppliers monitor out-of-stock rates across regional stores to forecast demand and optimise wholesale distribution.
Analysts track new fabric collections, seasonal party supplies, and clearance velocity to identify consumer craft trends.
ML teams ingest craft project instructions and material lists to train generative AI models for DIY communities.
eCommerce competitors ingest daily Spotlight pricing feeds to automatically adjust their own yarn and fabric pricing rules.
Real estate and retail analysts map store-level stock density across AU and NZ to evaluate operational performance.
"Spotlight holds the definitive catalogue for textiles and craft in the APAC region. Accessing their local store inventory and VIP pricing at scale requires dedicated infrastructure."
Extracting data from multi-region retail sites involves complex session management. Capturing accurate VIP pricing and store-specific stock levels requires persistent cookies, geo-targeted residential proxies, and JavaScript rendering for dynamic variant selection. DataFlirt manages this entire pipeline so your team receives clean, ready-to-query tables.
Everything supported by our spotlightstores.com scraper — rendered SPA elements, auth walls, rate-limit evasion and beyond.
Open-source tooling on proven cloud infra — no vendor lock-in, full observability.
Scrapy handles crawl orchestration and deduplication. Playwright handles JavaScript rendering and store locator interactions.
We maintain pools of residential ISP proxies specifically for APAC regions (AU, NZ, SG, MY) to ensure correct local pricing renders.
Pipelines run on AWS Lambda and ECS. Airflow handles scheduling, dependency management, and SLA alerting.
Data delivered to where your team already works — no new tooling required.
About spotlightstores.com scraping, legality, and pipeline operations.
Ask us directly →Scraping publicly available information is generally permissible under applicable law. DataFlirt targets only public product, pricing, and store data. We do not extract personal user data.
Yes. We configure our crawlers with the necessary session states to surface both standard retail pricing and VIP member pricing simultaneously.
Yes. We can iterate through postal codes or specific store IDs to extract local Click & Collect availability and stock status for any SKU.
We cover all major regional domains including Australia, New Zealand, Singapore, and Malaysia, capturing local currency and catalogue variations.
Fabrics and yarns often have dozens of colour and dye-lot variations. We map these parent-child relationships into a normalised schema so every variant has its own clear record.
We can configure pipelines for daily full-catalogue sweeps or higher-frequency intraday runs for specific high-velocity categories or clearance items.
Absolutely. We provide a sample run of up to 500 SKUs as part of the pre-engagement scoping process so you can validate schema fit and data quality.
20-minute scoping call. Pilot dataset within the week. Production within two. Whether you need a one-off fabric catalogue dump or a continuous price-monitoring feed across 150 stores, we scope, build, and operate the pipeline. Tell us what you need.
