SYSTEM all green source libertylondon.com queue 12,491 pages p99 latency 184ms dataflirt.com · scraper/libertylondon-com
RUN · 41 active pipelines · libertylondon.com live

Liberty London data,
extracted at scale.

We extract luxury beauty catalogues, fragrance notes, shade variations, pricing signals, and inventory status from Liberty London. Delivered as clean JSON, CSV, or Parquet to S3, BigQuery, or Snowflake on your cadence.

Products extracted
34,812 /day
Price updates
89,104 /24h
Variant records
142K /run
Active pipelines
41
Uptime
99.98%
Data Dictionary

Every field we extract from libertylondon.com

Structured, schema-consistent data across all major object types — delivered clean, typed, and ready to query.

Complete list of extractable fields for Product Listings objects from libertylondon.com. All fields typed and schema-versioned.

skutitlebrandcategorysub_categorypricecurrencydescriptioningredientshow_to_usesize_volumeurl
product_listings
● 200 OK
"sku": "100023491",
"title": "Baccarat Rouge 540 Eau de Parfum 70ml",
"brand": "Maison Francis Kurkdjian",
"category": "Beauty",
"price": 245.0,
"currency": "GBP",
"size_volume": "70ml",
"url": "https://www.libertylondon.com/uk/baccarat-rouge-540-eau-de-parfum-70ml.html"
# skutitlebrandcategorysub_categoryprice
1
2
3

Complete list of extractable fields for Pricing & Availability objects from libertylondon.com. All fields typed and schema-versioned.

skucurrent_priceoriginal_pricediscount_pctin_stockstock_levelbeauty_drop_eligibledelivery_restrictionsscraped_at
pricing_& availability
● 200 OK
"sku": "100023491",
"current_price": 245.0,
"original_price": 245.0,
"discount_pct": 0,
"in_stock": true,
"beauty_drop_eligible": true,
"delivery_restrictions": "['UK Only for Flammables']",
"scraped_at": "2026-05-12T09:14:00Z"
# skucurrent_priceoriginal_pricediscount_pctin_stockstock_level
1
2
3

Complete list of extractable fields for Variations objects from libertylondon.com. All fields typed and schema-versioned.

parent_skuvariant_skuvariant_typevariant_valuecolour_hexpricein_stockimage_url
variations
● 200 OK
"parent_sku": "100054321",
"variant_sku": "100054321-01",
"variant_type": "Shade",
"variant_value": "Pillow Talk",
"colour_hex": "#D4A59A",
"price": 27.0,
"in_stock": true,
"image_url": "https://media.libertylondon.com/image/upload/v1/pillow-talk.jpg"
# parent_skuvariant_skuvariant_typevariant_valuecolour_hexprice
1
2
3

Complete list of extractable fields for Fragrance Profiles objects from libertylondon.com. All fields typed and schema-versioned.

skubrandtitlefragrance_familytop_notesheart_notesbase_notesperfumer
fragrance_profiles
● 200 OK
"sku": "100023491",
"brand": "Maison Francis Kurkdjian",
"title": "Baccarat Rouge 540 Eau de Parfum",
"fragrance_family": "Woody Floral",
"top_notes": "['Jasmine', 'Saffron']",
"heart_notes": "['Cedarwood']",
"base_notes": "['Ambergris']"
# skubrandtitlefragrance_familytop_notesheart_notes
1
2
3

Complete list of extractable fields for Customer Reviews objects from libertylondon.com. All fields typed and schema-versioned.

review_idskuauthorratingtitlebodydateverified_buyer
customer_reviews
● 200 OK
"review_id": "REV-849201",
"sku": "100023491",
"author": "Sarah M.",
"rating": 5,
"title": "Signature scent",
"body": "Absolutely incredible longevity and projection.",
"date": "2026-04-18",
"verified_buyer": true
# review_idskuauthorratingtitlebody
1
2
3

Capabilities

Extract every layer of the Liberty beauty catalogue

Our infrastructure handles dynamic shade rendering, luxury brand category structures, and strict anti-bot measures to deliver normalised retail intelligence.

Full Beauty Catalogue Extraction

Extract titles, descriptions, how-to-use instructions, and rich media assets across skincare, makeup, and fragrance categories.

Shade and Size Mapping

Capture complex parent-child relationships for makeup shades and perfume volumes, including colour hex codes and variant-specific pricing.

Ingredient Formulation Parsing

Extract and structure full ingredient lists to monitor chemical compliance, clean beauty trends, and formulation updates.

Fragrance Note Extraction

Parse unstructured descriptions into structured top, heart, and base notes alongside fragrance family classifications.

Real-Time Inventory Tracking

Monitor stock availability at the variant level to detect low-stock signals and out-of-stock rates for high-demand luxury items.

Liberty Beauty Drop Signals

Identify products eligible for the Liberty Beauty Drop subscription programme and exclusive member edits.

Pricing and Promotion Monitoring

Track base prices, promotional discounts, and seasonal sale events across multiple regional storefronts.

Delivery Restriction Flags

Capture shipping constraints for hazardous materials like aerosols and alcohol-based fragrances.

Automated Review Mining

Extract paginated customer reviews, star ratings, and verified buyer badges to analyse sentiment and product efficacy.

// engagement pipeline

From luxury catalogue to warehouse record

Brief in. Clean data out.

Define Scope
d 0

Provide target brands, categories, or specific product lines. We design the extraction schema together.

Pipeline Build
d 2–4

We configure Scrapy and Playwright crawlers, proxy rotation, session management, and anti-bot circumvention for libertylondon.com.

Validation & QA
d 4–6

Schema validation, null-rate checks, price-outlier detection, and variant mapping verification before full launch.

Delivery
ongoing

JSON, CSV, or Parquet pushed to your S3 bucket, BigQuery dataset, or Snowflake stage on agreed cadence.

Under the hood

Navigating luxury retail extraction

High-end retailers deploy strict bot protection and complex front-end frameworks. Here is how we maintain pipeline stability.

pipeline-monitor · libertylondon.com · live ● active
// fingerprinting
Identity rotation
TLS fingerprintrandomised
User-agentrotated
IP poolresidential
Challenges blocked0
// pagination
Page coverage
48,291 pages queued running
// observability
Pipeline health
99.9%
uptime
142ms
p99 lat
0.3%
null rate
2
alerts
Anti-bot layer
Residential proxy rotation and fingerprinting

Luxury eCommerce platforms use advanced CDN edge protection. Our crawlers use UK residential ISP proxies with realistic browser fingerprints and full cookie session management to bypass IP reputation blocks.

Dynamic rendering
Playwright execution for shade swatches

Product pages rely heavily on JavaScript for variant selection and inventory checks. We run full Playwright browser sessions to trigger lazy-loads and hydrate dynamic price widgets.

Schema stability
Resilient selectors for bespoke UI

Liberty London updates its frontend for seasonal campaigns. Our selector strategy uses fallback chains combining CSS selectors, XPath, and JSON-LD structured data to prevent pipeline breakage.

Change detection
Only re-scrape what changes

We maintain a hash index of last-seen values per SKU. Subsequent runs only push diffs, reducing compute cost and downstream processing load for your data engineering team.

Monitoring
24/7 pipeline health tracking

Every run emits structured logs. We alert on null-rate spikes, price anomalies, and coverage drops. SLA uptime is contractual.

Applications

Who uses Liberty London data and how

Teams across industries use libertylondon.com data to build competitive products and smarter operations.

01
Luxury Brand Competitor Analysis

Beauty brands monitor competitor assortment, pricing strategies, and exclusive product launches within the luxury department store tier.

02
Assortment and Gap Analysis

Retail buyers analyse brand coverage and category depth to identify whitespace opportunities in premium skincare and fragrance.

03
Pricing and Promotion Intelligence

Pricing teams track seasonal sales, discount depths, and exclusive Beauty Drop pricing to optimise their own promotional calendars.

04
Beauty Trend Forecasting

Market analysts track new arrivals, out-of-stock velocity, and review volume to quantify emerging trends in clean beauty and niche perfumery.

05
Ingredient Compliance Monitoring

Regulatory teams extract full INCI ingredient lists to audit product compliance against regional cosmetic regulations.

06
Grey Market Detection

Brands monitor authorised retailer pricing to detect MAP violations and identify unauthorised distribution channels.

Why DataFlirt

"Liberty London curates the world's most sought-after luxury beauty brands, but parsing their dynamic catalogue requires serious infrastructure."

Extracting high-end retail data involves navigating strict anti-bot measures, complex shade variant structures, and highly customised front-end frameworks. DataFlirt handles the proxies, JavaScript rendering, and schema maintenance so your team receives normalised records ready for analysis.

Technical Spec

Liberty London scraper technical capabilities

Everything supported by our libertylondon.com scraper — rendered SPA elements, auth walls, rate-limit evasion and beyond.

JavaScript rendering
Full Playwright sessions required for shade selection and dynamic inventory
Supported
CAPTCHA bypass
Automated solver integration for CDN edge protection challenges
Supported
Residential proxy rotation
ISP-grade residential IPs from UK pools rotated per request
Supported
Variant mapping
Parent to child SKU relationships for shades and volumes
Supported
Ingredient parsing
Extraction of full INCI lists from product description tabs
Supported
Review extraction
Pagination through all customer reviews and ratings per product
Supported
Change detection
Hash-based diff to emit only records with changed fields
Supported
Webhook delivery
HTTP POST per record or batch for downstream ingestion
Supported
Beauty Drop member pricing
Exclusive subscription pricing requires authenticated account access
Partial
User purchase history
Private customer order history is gated behind authentication walls
Partial
Infrastructure

Infrastructure powering the extraction

Open-source tooling on proven cloud infra — no vendor lock-in, full observability.

ScrapyPlaywrightPython 3.12RedisPostgreSQLApache AirflowAWS LambdaS3CloudWatch2CaptchaCapSolverResidential ProxiesDockerKubernetesGrafanaPrometheus
Scrapy and Playwright Stack

Scrapy handles crawl orchestration, deduplication, and retry logic. Playwright manages JavaScript rendering, cookie sessions, and interaction flows for complex variant selectors.

Residential Proxy Infrastructure

We maintain pools of residential ISP proxies across UK regions. Rotation happens per-request with sticky sessions where required to bypass strict retail CDN bot protection.

Cloud-Native Orchestration

Pipelines run on AWS Lambda and ECS. Airflow handles scheduling, dependency management, and SLA alerting. All state is stored in managed PostgreSQL.

Output & Delivery

Your data, your destination

Data delivered to where your team already works — no new tooling required.

JSON
Newline-delimited or nested schema versioned per run
CSV
Flat file with typed columns for flat variant records
XLS
Excel compatible exports for merchandising teams
Parquet
Columnar format for BigQuery, Snowflake, Athena
AWS S3
Direct bucket delivery compatible with any data lake
Webhook
HTTP POST per record for real-time downstream processing
API
REST endpoints to query extracted catalogue data on demand
BigQuery
Streamed directly into your dataset with schema auto-detect
Snowflake
Stage and COPY INTO workflow for incremental updates
PostgreSQL
Upsert into your existing schema with conflict resolution
S3
Direct bucket delivery — compatible with any data lake
// faq

Common questions.

About libertylondon.com scraping, legality, and pipeline operations.

Ask us directly →
Is scraping Liberty London legal?

Scraping publicly available information is generally permissible under applicable law. DataFlirt targets only public, non-authenticated product, pricing, and review data. We do not extract personal data or circumvent authentication walls. Clients should review the retailer's ToS and consult legal counsel for specific use cases.

How do you handle anti-bot systems on luxury retail sites?

We use UK residential ISP proxies, full Playwright browser sessions with realistic fingerprints, and request timing modelled on human behaviour. We monitor for 403/CAPTCHA rate spikes in real time and trigger pool rotation automatically.

How do you extract data for makeup shades and perfume sizes?

Our crawlers map parent-child relationships by executing the JavaScript required to select each variant. This ensures we capture the specific price, stock status, and colour hex code for every individual shade or size.

How fresh is the inventory and pricing data?

Full catalogue refreshes at daily cadence complete within a 4-6 hour window. For specific high-priority SKUs, we can configure hourly pipelines to track fast-moving stock and flash promotions.

Can you extract full ingredient lists?

Yes. We parse the product description and details tabs to extract full INCI ingredient lists, formatting them as structured arrays for easy compliance auditing and formulation analysis.

What is the minimum viable engagement?

Our smallest packages start at a defined brand list or category subset with weekly delivery. For full-site extraction or custom schema requirements, we price based on volume and delivery frequency.

Can I request a sample dataset before committing?

Absolutely. We provide a sample run of up to 500 SKUs as part of the pre-engagement scoping process so you can validate schema fit, variant mapping accuracy, and data quality.

$ dataflirt scope --new-project --source=libertylondon.com ready

Tell us what
to extract.
We do the rest.

20-minute scoping call. Pilot dataset within the week. Production within two. Whether you need a one-off brand catalogue dump or a continuous price-monitoring feed across thousands of luxury SKUs, we scope, build, and operate the pipeline. Tell us what you need.

hello@dataflirt.com · Bengaluru · IST · typical reply < 4h
Related Scrapers

More in beauty and skincare

Services

Data Extraction for Every Industry

View All Services →