SYSTEM all green source szul.com queue 1,482 pages p99 latency 185ms dataflirt.com · scraper/szul-com
RUN · 12 active pipelines · szul.com live

Szul data,
at warehouse scale.

We extract product specifications, diamond grading, metal variants, pricing signals, and reviews from Szul. Delivered as clean JSON, CSV, or Parquet to S3, BigQuery, or Snowflake on your cadence.

Products extracted
14.2K /day
Price updates
42.1K /24h
Review records
18.5K /run
Active pipelines
12
Uptime
99.98%
Data Dictionary

Every field we extract from szul.com

Structured, schema-consistent data across all major object types — delivered clean, typed, and ready to query.

Complete list of extractable fields for Product Listings objects from szul.com. All fields typed and schema-versioned.

skutitlecategorysub_categorymetal_typestone_typecarat_weightpricelist_pricecurrencyin_stockring_sizesdescriptionimage_urlsurl
product_listings
● 200 OK
"sku": "RNG58294-14KW",
"title": "1/2 Carat Diamond Solitaire Ring in 14K White Gold",
"metal_type": "14K White Gold",
"stone_type": "Diamond",
"carat_weight": 0.5,
"price": 499.0,
"list_price": 1299.0,
"in_stock": true
# skutitlecategorysub_categorymetal_typestone_type
1
2
3

Complete list of extractable fields for Pricing & Promotions objects from szul.com. All fields typed and schema-versioned.

skucurrent_pricemsrpdiscount_pctdiscount_absclearance_statuspromo_eligibleshipping_tierprice_timestampcurrency
pricing_& promotions
● 200 OK
"sku": "RNG58294-14KW",
"current_price": 499.0,
"msrp": 1299.0,
"discount_pct": 61.5,
"clearance_status": false,
"promo_eligible": true,
"price_timestamp": "2023-10-24T08:12:00Z"
# skucurrent_pricemsrpdiscount_pctdiscount_absclearance_status
1
2
3

Complete list of extractable fields for Diamond Specifications objects from szul.com. All fields typed and schema-versioned.

skudiamond_counttotal_carat_weightcolour_gradeclarity_gradestone_shapesetting_typetreatmentcertification
diamond_specifications
● 200 OK
"sku": "RNG58294-14KW",
"diamond_count": 1,
"total_carat_weight": 0.5,
"colour_grade": "H-I",
"clarity_grade": "I1-I2",
"stone_shape": "Round",
"setting_type": "Prong"
# skudiamond_counttotal_carat_weightcolour_gradeclarity_gradestone_shape
1
2
3

Complete list of extractable fields for Reviews & Ratings objects from szul.com. All fields typed and schema-versioned.

review_idskureviewer_namestar_ratingreview_titlereview_bodyreview_dateverified_buyerhelpful_votes
reviews_& ratings
● 200 OK
"review_id": "REV-99281",
"sku": "RNG58294-14KW",
"star_rating": 4.5,
"verified_buyer": true,
"review_title": "Beautiful engagement ring",
"review_date": "2023-09-14",
"helpful_votes": 12
# review_idskureviewer_namestar_ratingreview_titlereview_body
1
2
3

Complete list of extractable fields for Category Data objects from szul.com. All fields typed and schema-versioned.

category_idcategory_nameparent_categoryproduct_countbreadcrumbfilter_attributessort_orderscraped_aturl
category_data
● 200 OK
"category_name": "Engagement Rings",
"parent_category": "Rings",
"product_count": 1240,
"breadcrumb": "Home > Rings > Engagement Rings",
"filter_attributes": "['Metal', 'Stone Shape', 'Price']",
"scraped_at": "2023-10-24T08:15:22Z"
# category_idcategory_nameparent_categoryproduct_countbreadcrumbfilter_attributes
1
2
3

Capabilities

Extract the complete Szul jewellery catalogue

Our pipeline captures the complex variant matrices inherent to fine jewellery: metal purities, diamond grading, ring sizing, and dynamic promotional pricing.

Diamond & Gemstone Grading

Extract precise specifications including carat weight, colour grade, clarity grade, cut, and stone shape for every SKU.

Variant Matrix Mapping

Capture the full matrix of ring sizes, metal types (14K, 18K, Platinum), and their associated price deltas.

Discount & Clearance Tracking

Monitor MSRP against current selling price, tracking clearance events and promotional code eligibility.

High-Res Image Extraction

Extract URLs for primary images, alternate angles, and close-up stone details required for visual analysis.

Review Aggregation

Collect customer ratings, verified purchase status, and review text to analyse product sentiment and quality issues.

Stock & Availability

Track inventory status across specific variants, identifying out-of-stock ring sizes or metal combinations.

Category & Taxonomy

Map the full site taxonomy from broad categories down to specific filter combinations and breadcrumbs.

Incremental Updates

Run daily or hourly diffs to capture only the SKUs where price, stock, or promotional status has changed.

Structured Delivery

Receive heavily nested product data normalised into flat CSVs or structured JSON/Parquet files.

// engagement pipeline

From target to warehouse

Brief in. Clean data out.

Define Scope
d 0

Provide categories, search terms, or specific SKU lists. We design the extraction schema together.

Pipeline Build
d 2–4

We configure Scrapy / Playwright crawlers, proxy rotation, and session management for szul.com.

Validation & QA
d 4–6

Schema validation, null-rate checks, and price-outlier detection before full launch.

Delivery
ongoing

JSON / CSV / Parquet pushed to your S3 bucket, BigQuery dataset, or Snowflake stage on agreed cadence.

Under the hood

Handling jewellery eCommerce complexity

Extracting data from Szul requires navigating complex product variations and dynamic pricing logic. Here is our technical approach.

pipeline-monitor · szul.com · live ● active
// fingerprinting
Identity rotation
TLS fingerprintrandomised
User-agentrotated
IP poolresidential
Challenges blocked0
// pagination
Page coverage
48,291 pages queued running
// observability
Pipeline health
99.9%
uptime
142ms
p99 lat
0.3%
null rate
2
alerts
Variant expansion
Flattening complex product matrices

A single ring listing on Szul may have dozens of permutations based on ring size and metal type. Our pipeline traverses these options, emitting a distinct record for each purchasable SKU variant with its specific price and stock status.

Dynamic pricing
Capturing real-time promotions

Jewellery pricing fluctuates with metal markets and constant promotional cycles. We execute JavaScript to ensure we capture the final cart price, including active site-wide discounts and clearance markdowns.

Data normalisation
Standardising diamond specifications

Diamond attributes (colour H-I, clarity I1-I2) are often embedded in unstructured description text. We use regex and NLP to parse these specifications into strict schema fields.

Anti-bot evasion
Residential proxies and fingerprinting

To prevent IP bans during full-catalogue sweeps, we distribute requests across a pool of residential proxies, managing TLS fingerprints and request headers to mimic standard browser behaviour.

Change detection
Efficient state tracking

We maintain a hash of the previous catalogue state. Subsequent crawls only output records where price, stock, or specifications have changed, reducing your downstream processing compute.

Applications

Who uses Szul data

Teams across industries use szul.com data to build competitive products and smarter operations.

01
Competitor Price Monitoring

Jewellery retailers track Szul's pricing across diamond carat tiers and metal types to optimise their own pricing strategies.

02
Market Trend Analysis

Analysts monitor the volume of lab-grown versus natural diamond listings to quantify shifts in consumer demand.

03
Inventory Intelligence

Track clearance velocity and out-of-stock rates across specific ring sizes to model demand curves.

04
Machine Learning Pricing Models

Data science teams ingest historical pricing, carat weight, and clarity data to train automated valuation models.

05
Assortment Planning

Merchandisers analyse category depth and stone type distribution to identify gaps in their own product offerings.

06
Promotional Tracking

Monitor the frequency, depth, and duration of Szul's site-wide discount events and clearance sales.

Why DataFlirt

"Szul holds a highly structured catalogue of diamond and gemstone specifications — but extracting variant-level pricing requires a dedicated pipeline."

Scraping fine jewellery eCommerce requires handling complex variant matrices (ring sizes, metal types) and high-resolution image assets. DataFlirt manages the proxy rotation, JavaScript execution, and schema mapping so your engineers can focus on downstream analysis.

Technical Spec

Szul scraper — technical specifications

Everything supported by our szul.com scraper — rendered SPA elements, auth walls, rate-limit evasion and beyond.

Variant matrix expansion
Maps every combination of ring size and metal type to a unique record
Supported
Diamond specification parsing
Extracts carat, cut, colour, and clarity into structured fields
Supported
High-res image extraction
Captures maximum resolution image URLs for all product angles
Supported
Review pagination
Extracts the full history of customer reviews and ratings
Supported
Clearance tracking
Identifies items explicitly marked for clearance or final sale
Supported
Change detection (diffs)
Hash-based diff: only emit records with changed fields since last run
Supported
User Wishlists
Requires authenticated user session access
Partial
Order History
Gated behind individual customer login
Partial
Infrastructure

Infrastructure powering the pipeline

Open-source tooling on proven cloud infra — no vendor lock-in, full observability.

ScrapyPlaywrightPython 3.12RedisPostgreSQLApache AirflowAWS LambdaS3CloudWatch2CaptchaCapSolverResidential ProxiesDockerKubernetesGrafanaPrometheus
Scrapy + Playwright Stack

Scrapy handles crawl orchestration and deduplication. Playwright handles JavaScript rendering, variant selection, and interaction flows.

Residential Proxy Infrastructure

We maintain pools of residential ISP proxies. Rotation happens per-request to prevent IP-based rate limiting during full catalogue sweeps.

Cloud-Native Orchestration

Pipelines run on AWS Lambda and ECS. Airflow handles scheduling, dependency management, and SLA alerting.

Output & Delivery

Your data, your destination

Data delivered to where your team already works — no new tooling required.

JSON
Newline-delimited or nested — schema versioned per run
CSV
Flat file with typed columns — Excel/Sheets compatible
XLS
Excel format for business analyst workflows
Parquet
Columnar format for BigQuery, Snowflake, Athena
AWS S3
Direct bucket delivery — compatible with any data lake
Webhook
HTTP POST per record for real-time downstream processing
API
REST endpoint for querying specific SKU data
PostgreSQL
Upsert into your existing schema with conflict resolution
S3
Direct bucket delivery — compatible with any data lake
// faq

Common questions.

About szul.com scraping, legality, and pipeline operations.

Ask us directly →
Can you extract data for every ring size variant?

Yes. Our pipeline iterates through the available size dropdowns or parses the underlying JSON configuration to extract the specific price and availability for every ring size and metal combination.

How do you handle unstructured diamond specifications?

We use custom regex patterns and parsing logic to extract standard diamond metrics (carat weight, colour, clarity) from product titles and HTML description blocks, normalising them into strict schema fields.

How frequently can you update pricing data?

We can configure pipelines to run daily for the entire catalogue, or at higher frequencies (e.g., hourly) for a specific subset of high-priority SKUs.

Do you extract product images?

We extract the direct URLs to the highest resolution images available on the product page, including primary images, alternate angles, and lifestyle shots.

Can you track when an item goes on clearance?

Yes. We capture clearance flags, original MSRP, current selling price, and the calculated discount percentage for every SKU.

Is historical pricing data available?

We begin tracking historical pricing from the moment your pipeline is commissioned. Every run produces a timestamped snapshot, allowing you to build a time-series database of price changes over time.

$ dataflirt scope --new-project --source=szul.com ready

Tell us what
to extract.
We do the rest.

20-minute scoping call. Pilot dataset within the week. Production within two. Whether you need a one-off catalogue extract or continuous price monitoring across thousands of jewellery SKUs — we scope, build, and operate the pipeline. Tell us what you need.

hello@dataflirt.com · Bengaluru · IST · typical reply < 4h
Related Scrapers

More in jewelry

Services

Data Extraction for Every Industry

View All Services →