SYSTEM all green source davidjones.com.au queue 12,491 pages p99 latency 184ms dataflirt.com · scraper/davidjones-com.au
RUN: 42 active pipelines: davidjones.com.au live

David Jones data,
at warehouse scale.

We extract product listings, pricing signals, designer brand indexes, beauty specifications, and store inventory from David Jones. Delivered as clean JSON, CSV, or Parquet to S3, BigQuery, or Snowflake on your cadence.

Products extracted
412K /run
Price updates
18.4K /24h
Brand catalogues
2,140 /run
Active pipelines
42
Uptime
99.94%
Data Dictionary

Every field we extract from davidjones.com.au

Structured, schema-consistent data across all major object types — delivered clean, typed, and ready to query.

Complete list of extractable fields for Product Listings objects from davidjones.com.au. All fields typed and schema-versioned.

skutitlebrandcategory_pathpricelist_pricecurrencydescriptioncare_instructionsmaterial_compositioncountry_of_originimage_urlsurl
product_listings
● 200 OK
"sku": "24918492",
"title": "Silk Crepe De Chine Blouse",
"brand": "Zimmermann",
"price": 450.0,
"currency": "AUD",
"category_path": "Women > Clothing > Tops",
"material_composition": "100% Silk",
"country_of_origin": "China"
# skutitlebrandcategory_pathpricelist_price
1
2
3

Complete list of extractable fields for Pricing & Promotions objects from davidjones.com.au. All fields typed and schema-versioned.

skucurrent_priceoriginal_pricediscount_percentagediscount_absolutepromotion_textpromotion_badgeclearance_flagprice_timestampcurrency
pricing_& promotions
● 200 OK
"sku": "24918492",
"current_price": 315.0,
"original_price": 450.0,
"discount_percentage": 30,
"promotion_text": "Take an extra 30% off selected styles",
"clearance_flag": false,
"price_timestamp": "2026-05-12T09:14:00Z"
# skucurrent_priceoriginal_pricediscount_percentagediscount_absolutepromotion_text
1
2
3

Complete list of extractable fields for Variants (Size & Colour) objects from davidjones.com.au. All fields typed and schema-versioned.

parent_skuvariant_skucolour_namecolour_hexsize_labelsize_systemin_stockstock_levelvariant_pricevariant_image_url
variants_(size & colour)
● 200 OK
"parent_sku": "24918492",
"variant_sku": "24918492-BLK-02",
"colour_name": "Black",
"size_label": "2",
"in_stock": true,
"stock_level": "Low Stock",
"variant_price": 315.0
# parent_skuvariant_skucolour_namecolour_hexsize_labelsize_system
1
2
3

Complete list of extractable fields for Store Inventory objects from davidjones.com.au. All fields typed and schema-versioned.

skustore_idstore_namestatepostcodeavailability_statusclick_and_collect_eligiblelast_updated
store_inventory
● 200 OK
"sku": "24918492-BLK-02",
"store_id": "DJ-SYD-01",
"store_name": "Elizabeth Street",
"state": "NSW",
"postcode": "2000",
"availability_status": "In Stock",
"click_and_collect_eligible": true
# skustore_idstore_namestatepostcodeavailability_status
1
2
3

Complete list of extractable fields for Beauty Specifications objects from davidjones.com.au. All fields typed and schema-versioned.

skuproduct_typevolume_mlweight_gingredientsskin_typeformulationbenefitsusage_instructions
beauty_specifications
● 200 OK
"sku": "19482711",
"product_type": "Moisturiser",
"volume_ml": 50,
"skin_type": "All Skin Types",
"formulation": "Cream",
"benefits": "Hydration, Anti-aging",
"ingredients": "Aqua, Glycerin, Niacinamide..."
# skuproduct_typevolume_mlweight_gingredientsskin_type
1
2
3

Capabilities

Complete visibility into Australian luxury retail

Our David Jones scraper targets the entire department store catalogue. We handle dynamic variant loading, store-level inventory lookups, and promotional pricing logic to deliver structured retail intelligence.

Designer Catalogue Extraction

Capture titles, descriptions, material compositions, and care instructions across all fashion, beauty, and home categories.

Size & Colour Variant Mapping

Extract all available sizes and colours per product, linking variant SKUs to their parent product with specific pricing.

Promotional Price Tracking

Monitor base prices, markdown prices, clearance flags, and promotional banner text applied to specific items.

Physical Store Inventory

Query stock availability across David Jones physical locations for Click & Collect readiness and local inventory analysis.

Beauty & Cosmetic Data

Extract specialised beauty metadata including ingredient lists, volume metrics, skin type recommendations, and formulation details.

High-Resolution Media

Collect URLs for all product imagery, including variant-specific photos and brand campaign assets.

Category Hierarchy

Map the full breadcrumb trail to classify products accurately within the David Jones department structure.

Brand Indexing

Track assortment sizes and new product introductions across thousands of international and Australian designer brands.

Scheduled Change Detection

Run continuous pipelines at daily or weekly cadences to capture new arrivals, price drops, and out-of-stock events.

// engagement pipeline

From category URL to warehouse record

Brief in. Clean data out.

Define Scope
d 0

Provide category URLs, brand names, or specific SKU lists. We design the extraction schema together.

Pipeline Build
d 2–4

We configure Scrapy and Playwright crawlers, proxy rotation, and session management for davidjones.com.au.

Validation & QA
d 4–6

Schema validation, null-rate checks, and price-outlier detection before full launch.

Delivery
ongoing

JSON, CSV, or Parquet pushed to your S3 bucket, BigQuery dataset, or Snowflake stage on agreed cadence.

Under the hood

How our pipeline handles retail complexity

Modern eCommerce sites use dynamic frontends and edge protection. Here is how we maintain data quality and pipeline uptime.

pipeline-monitor · davidjones.com.au · live ● active
// fingerprinting
Identity rotation
TLS fingerprintrandomised
User-agentrotated
IP poolresidential
Challenges blocked0
// pagination
Page coverage
48,291 pages queued running
// observability
Pipeline health
99.9%
uptime
142ms
p99 lat
0.3%
null rate
2
alerts
Anti-bot layer
Residential proxies and TLS fingerprinting

Retail sites deploy edge protection to block datacenter IPs. Our crawlers use Australian residential proxies with realistic browser fingerprints to blend in with legitimate shopper traffic.

JavaScript rendering
Playwright execution for dynamic content

Product variants, promotional banners, and store inventory widgets load asynchronously. We run full Playwright browser sessions to ensure all client-side data is fully hydrated before extraction.

Variant hydration
Mapping complex size and colour matrices

Apparel SKUs often have dozens of size and colour combinations. Our pipeline iterates through variant selectors to capture stock status and price differences for every possible option.

Store availability
Geo-targeted inventory queries

Extracting store-level stock requires simulating location data. We use geo-specific session headers to query the backend inventory API for accurate physical store availability.

Change detection
Only re-scrape what changes

For the full catalogue, we maintain a hash index of last-seen values. Subsequent runs only push diffs, reducing compute cost and downstream processing load.

Applications

Who uses David Jones data and how

Teams across industries use davidjones.com.au data to build competitive products and smarter operations.

01
Competitor Price Monitoring

Retailers track David Jones promotional calendars and base pricing to optimise their own markdown strategies.

02
Brand MAP Compliance

Designer brands audit the site to ensure their products are priced according to Minimum Advertised Price agreements.

03
Assortment Planning

Merchandising teams analyse category depth, brand representation, and size availability to inform their own buying decisions.

04
Inventory Forecasting

Analysts monitor stock-out rates across key categories to identify supply chain constraints and consumer demand spikes.

05
Market Research

Consultancies aggregate brand presence and category expansion data to evaluate the Australian luxury retail sector.

06
Trend Analysis

Fashion analysts track new arrivals and colour/material distributions to quantify seasonal trends in the local market.

Why DataFlirt

"David Jones holds the definitive catalogue of Australian luxury retail, but extracting that intelligence requires navigating complex dynamic frontends and variant matrices."

Building a scraper for modern eCommerce is simple. Maintaining it is hard. Retailers constantly update their DOM structures, deploy new anti-bot measures, and change promotional logic. DataFlirt manages the infrastructure so your team can focus on merchandising and pricing analysis, not fixing broken selectors.

Technical Spec

David Jones scraper technical capabilities

Everything supported by our davidjones.com.au scraper — rendered SPA elements, auth walls, rate-limit evasion and beyond.

JavaScript rendering
Full Playwright sessions required for variant loading and inventory widgets
Supported
Australian residential proxies
ISP-grade residential IPs from AU pools to bypass edge protection
Supported
Variant mapping
Parent to child SKU relationships with all size and colour combinations
Supported
Store inventory queries
Location-based stock availability across physical department stores
Supported
Beauty ingredient parsing
Extraction of structured cosmetic data from product descriptions
Supported
Change detection (diffs)
Hash-based diff to emit only records with changed fields since last run
Supported
David Jones Rewards pricing
Member-only discounts requiring authenticated loyalty accounts
Partial
Customer purchase history
Historical order data restricted behind individual user login walls
Partial
Infrastructure

Infrastructure powering the retail pipeline

Open-source tooling on proven cloud infra — no vendor lock-in, full observability.

ScrapyPlaywrightPython 3.12RedisPostgreSQLApache AirflowAWS LambdaS3CloudWatch2CaptchaCapSolverResidential ProxiesDockerKubernetesGrafanaPrometheus
Scrapy + Playwright Stack

Scrapy handles crawl orchestration and retry logic. Playwright manages JavaScript rendering and interaction flows for dynamic retail variants.

Residential Proxy Infrastructure

We maintain pools of residential ISP proxies in Australia. Rotation happens per-request to avoid rate limits and edge blocking.

Cloud-Native Orchestration

Pipelines run on AWS ECS. Airflow handles scheduling and dependency management. All state is stored in managed Postgres.

Output & Delivery

Your data, your destination

Data delivered to where your team already works — no new tooling required.

JSON
Newline-delimited or nested format
CSV
Flat file with typed columns
XLS
Excel format for business teams
Parquet
Columnar format for data warehouses
AWS S3
Direct bucket delivery
Webhook
HTTP POST per record
API
REST endpoint for on-demand queries
BigQuery
Streamed directly into your dataset
S3
Direct bucket delivery — compatible with any data lake
// faq

Common questions.

About davidjones.com.au scraping, legality, and pipeline operations.

Ask us directly →
Can you extract all size and colour variants?

Yes. Our pipeline iterates through the variant matrix on each product page, capturing specific SKUs, prices, and stock statuses for every available size and colour combination.

Do you capture promotional pricing?

We extract the base price, current price, discount percentage, and any promotional text or badges applied to the product during the time of the scrape.

How frequently can you update the data?

We support daily or weekly full-catalogue refreshes. For targeted subsets of highly volatile products, we can configure sub-daily tracking pipelines.

Can you check stock in specific physical stores?

Yes. We can query the backend inventory API to extract stock availability statuses for specific David Jones physical locations across Australia.

How do you handle site layout changes?

Our selector strategy uses multiple fallback chains. We monitor for schema drift and null-rate spikes continuously, allowing our engineers to patch extraction logic before it affects your delivery.

Can I request a sample dataset?

We provide a sample run of up to 500 products as part of the pre-engagement scoping process so you can validate the schema and data quality.

$ dataflirt scope --new-project --source=davidjones.com.au ready

Tell us what
to extract.
We do the rest.

20-minute scoping call. Pilot dataset within the week. Production within two. Whether you need a one-off catalogue dump or continuous price monitoring across 400K SKUs, we scope, build, and operate the pipeline. Tell us what you need.

hello@dataflirt.com · Bengaluru · IST · typical reply < 4h
Related Scrapers

More in fashion and apparel

Services

Data Extraction for Every Industry

View All Services →