SYSTEM all green source astleyclarke.com queue 4,192 pages p99 latency 314ms dataflirt.com · scraper/astleyclarke-com
RUN · 14 active pipelines · astleyclarke.com live

Astley Clarke data,
structured for scale.

We extract product catalogues, variant pricing, metal specifications, and stock signals from Astley Clarke. Delivered as clean JSON, CSV, or Parquet to S3 or BigQuery on your cadence.

Products extracted
8,412 /run
Variant updates
24.1K /24h
Stock signals
18.5K /run
Active pipelines
14
Uptime
99.98%
Data Dictionary

Every field we extract from astleyclarke.com

Structured, schema-consistent data across all major object types — delivered clean, typed, and ready to query.

Complete list of extractable fields for Product Listings objects from astleyclarke.com. All fields typed and schema-versioned.

skutitlecategorysub_categorymetal_typegemstonecollection_namepricecurrencydescriptionurl
product_listings
● 200 OK
"sku": "AC-N-18Y-DIA",
"title": "Polaris Diamond Compass Pendant",
"category": "Necklaces",
"metal_type": "18ct Yellow Gold Vermeil",
"gemstone": "Diamond",
"price": 195.0,
"currency": "GBP"
# skutitlecategorysub_categorymetal_typegemstone
1
2
3

Complete list of extractable fields for Variants & Sizing objects from astleyclarke.com. All fields typed and schema-versioned.

variant_skuparent_skuring_sizechain_lengthmetal_variantprice_modifierstock_statusbarcodeweight_grams
variants_& sizing
● 200 OK
"variant_sku": "AC-R-14Y-DIA-L",
"parent_sku": "AC-R-14Y-DIA",
"ring_size": "L (UK)",
"metal_variant": "14ct Solid Gold",
"stock_status": "In Stock",
"price_modifier": 0.0,
"weight_grams": 2.4
# variant_skuparent_skuring_sizechain_lengthmetal_variantprice_modifier
1
2
3

Complete list of extractable fields for Pricing & Stock objects from astleyclarke.com. All fields typed and schema-versioned.

skuretail_pricesale_pricediscount_percentagecurrencyin_stocklow_stock_warningscraped_at
pricing_& stock
● 200 OK
"sku": "AC-B-SS-SAP",
"retail_price": 150.0,
"sale_price": 120.0,
"discount_percentage": 20,
"currency": "GBP",
"in_stock": true,
"low_stock_warning": true
# skuretail_pricesale_pricediscount_percentagecurrencyin_stock
1
2
3

Complete list of extractable fields for Specifications objects from astleyclarke.com. All fields typed and schema-versioned.

skudimensionschain_typeclasp_typecarat_weightgemstone_cutsetting_typehallmarkingwarranty_period
specifications
● 200 OK
"sku": "AC-E-18R-RBY",
"dimensions": "12mm x 10mm",
"carat_weight": "0.25ct",
"gemstone_cut": "Brilliant",
"setting_type": "Bezel",
"hallmarking": "UK Assay Office",
"warranty_period": "2 Years"
# skudimensionschain_typeclasp_typecarat_weightgemstone_cut
1
2
3

Complete list of extractable fields for Media & Merchandising objects from astleyclarke.com. All fields typed and schema-versioned.

skuprimary_image_urlgallery_image_urlsmodel_image_urlsvideo_urlstyling_tipsrelated_skusfrequently_bought_together
media_& merchandising
● 200 OK
"sku": "AC-N-18Y-DIA",
"primary_image_url": "https://astleyclarke.com/media/catalog/product/a/c/ac-n-18y-dia_1.jpg",
"gallery_image_urls": "['url2.jpg', 'url3.jpg']",
"model_image_urls": "['model1.jpg']",
"related_skus": "['AC-E-18Y-DIA', 'AC-R-18Y-DIA']",
"styling_tips": "Layer with shorter chains for a textured look."
# skuprimary_image_urlgallery_image_urlsmodel_image_urlsvideo_urlstyling_tips
1
2
3

Capabilities

Complete Astley Clarke catalogue extraction

Our scraper targets the specific architecture of Astley Clarke: handling variant selections, dynamic pricing overlays, and high-resolution media galleries.

Full Catalogue Extraction

Extract every product across all categories: necklaces, rings, bracelets, and earrings.

Metal & Size Variants

Map parent products to child variants across metal types, ring sizes, and chain lengths.

Real-Time Pricing

Capture retail prices, sale discounts, and promotional pricing across all variants.

Stock Availability

Track in-stock status and low-stock warnings at the SKU level.

Gemstone Specifications

Extract carat weights, cuts, clarity, and setting types for fine jewellery pieces.

High-Resolution Media

Capture URLs for primary product shots, model styling images, and video assets.

Cross-Sell & Styling

Extract 'wear it with' recommendations and related product SKUs.

Category Navigation

Traverse complex category hierarchies and collection pages.

Scheduled Pipelines

Run extractions on daily or weekly cadences to track new arrivals and price changes.

// engagement pipeline

From category URL to warehouse record

Brief in. Clean data out.

Define Scope
d 0

Provide target categories or collections. We map the extraction schema to your requirements.

Pipeline Build
d 2–4

We configure Playwright crawlers to handle variant selection and pagination on astleyclarke.com.

Validation & QA
d 4–6

Schema validation, null-rate checks, and price anomaly detection before full launch.

Delivery
ongoing

JSON / CSV / Parquet pushed to your S3 bucket or BigQuery dataset on agreed cadence.

Under the hood

Handling fine jewellery data extraction

Jewellery ecommerce requires precise variant mapping and media extraction. Here is how we build resilient pipelines for Astley Clarke.

pipeline-monitor · astleyclarke.com · live ● active
// fingerprinting
Identity rotation
TLS fingerprintrandomised
User-agentrotated
IP poolresidential
Challenges blocked0
// pagination
Page coverage
48,291 pages queued running
// observability
Pipeline health
99.9%
uptime
142ms
p99 lat
0.3%
null rate
2
alerts
Variant Mapping
Resolving complex parent-child relationships

A single necklace design may have variants for metal type (vermeil vs solid gold) and chain length. We extract the full matrix, ensuring every SKU has accurate pricing and stock data.

Media Extraction
Capturing high-resolution assets

Jewellery relies heavily on visual detail. We parse the media gallery JSON to extract uncompressed image URLs, bypassing the low-resolution frontend thumbnails.

Dynamic Pricing
Handling promotional overlays

We execute JavaScript to capture final sale prices, promotional discounts, and currency conversions accurately across all product pages.

Category Traversal
Deep pagination and collection mapping

We traverse infinite-scroll and paginated category pages to ensure 100% catalogue coverage, capturing breadcrumb trails for accurate categorisation.

Anti-Bot Layer
Bypassing WAF restrictions

We utilise UK residential proxies and automated TLS fingerprinting to bypass Cloudflare and other edge protections without triggering rate limits.

Applications

Who uses Astley Clarke data

Teams across industries use astleyclarke.com data to build competitive products and smarter operations.

01
Competitor Pricing

Jewellery brands monitor pricing strategies for vermeil and solid gold pieces to maintain competitive positioning.

02
Market Research

Analysts track metal trends, gemstone popularity, and new collection launches in the demi-fine jewellery sector.

03
Assortment Planning

Retailers analyse category depth across rings, necklaces, and earrings to inform their own merchandising strategies.

04
Visual AI Training

Computer vision teams use high-resolution jewellery images and metadata to train product recognition models.

05
Trend Analysis

Fashion forecasters track the introduction of new materials and setting styles over time.

06
MAP Monitoring

Brands monitor third-party stockists to ensure adherence to Minimum Advertised Price policies.

Why DataFlirt

"Astley Clarke holds highly structured data on fine jewellery attributes, but extracting variant-level pricing requires precise DOM traversal and session management."

Extracting jewellery catalogues requires mapping complex parent-child relationships for metal types, chain lengths, and ring sizes. DataFlirt handles the JavaScript rendering and pagination logic so your team receives clean, normalised product records ready for analysis.

Technical Spec

Astley Clarke scraper technical specifications

Everything supported by our astleyclarke.com scraper — rendered SPA elements, auth walls, rate-limit evasion and beyond.

JavaScript rendering
Playwright sessions required for variant selection and dynamic pricing
Supported
Variant mapping
Extracts all combinations of metal type, size, and length
Supported
High-res image extraction
Captures raw image URLs from the gallery JSON
Supported
Stock level tracking
Monitors in-stock status and low-stock indicators per SKU
Supported
Promotional pricing
Captures standard retail price alongside active discounts
Supported
Category pagination
Traverses all pages within collections and categories
Supported
Customer account order history
Requires authenticated sessions behind login wall
Partial
Personalised locket photo uploads
User-generated content within the locket builder tool
Partial
Infrastructure

Infrastructure powering the pipeline

Open-source tooling on proven cloud infra — no vendor lock-in, full observability.

ScrapyPlaywrightPython 3.12RedisPostgreSQLApache AirflowAWS LambdaS3CloudWatch2CaptchaCapSolverResidential ProxiesDockerKubernetesGrafanaPrometheusAPIXLS
Playwright Orchestration

We use headless browsers to interact with variant selectors and trigger dynamic data loads.

UK Proxy Infrastructure

Requests are routed through UK residential IPs to access localized pricing and bypass geo-blocks.

Cloud-Native Delivery

Pipelines run on AWS infrastructure, ensuring scalability and reliable data delivery.

Output & Delivery

Your data, your destination

Data delivered to where your team already works — no new tooling required.

JSON
Nested structures for complex variant relationships
CSV
Flat files for easy import into spreadsheet tools
XLS
Excel format for business analysts
Parquet
Columnar format optimized for analytical queries
AWS S3
Direct delivery to your cloud storage buckets
Webhook
HTTP POST notifications upon pipeline completion
API
RESTful endpoints for programmatic access
BigQuery
Direct insertion into Google Cloud data warehouses
S3
Direct bucket delivery — compatible with any data lake
// faq

Common questions.

About astleyclarke.com scraping, legality, and pipeline operations.

Ask us directly →
Can you extract all metal and size variants?

Yes. We iterate through all available variant combinations on the product page to extract specific pricing and stock data for each SKU.

How often can the pipeline run?

Pipelines can be scheduled daily, weekly, or on a custom cadence depending on your monitoring requirements.

Do you extract high-resolution images?

Yes. We bypass the frontend thumbnails and extract the direct URLs for the high-resolution gallery and model images.

Can you track stock availability?

Yes. We capture the current stock status for each specific variant, including low-stock warnings where available.

What delivery formats are supported?

We deliver data in JSON, CSV, Parquet, and XLS formats, directly to S3, BigQuery, or via Webhook and API.

Do you extract gemstone specifications?

Yes. We extract all structured metadata provided on the product page, including carat weight, cut, clarity, and setting type.

$ dataflirt scope --new-project --source=astleyclarke.com ready

Tell us what
to extract.
We do the rest.

20-minute scoping call. Pilot dataset within the week. Production within two. Whether you need a one-off catalogue dump or continuous price monitoring across all variants, we scope, build, and operate the pipeline.

hello@dataflirt.com · Bengaluru · IST · typical reply < 4h
Related Scrapers

More in jewelry

Services

Data Extraction for Every Industry

View All Services →