SYSTEM all green source cultbeauty.co.uk queue 3,192 pages p99 latency 185ms dataflirt.com · scraper/cultbeauty-co.uk
RUN · 18 active pipelines · cultbeauty.co.uk live

Cult Beauty data,
normalised for analysis.

We extract brand catalogues, shade matrices, ingredient profiles, pricing, and reviews from Cult Beauty. Delivered as clean JSON, CSV, or Parquet to S3, BigQuery, or Snowflake on your schedule.

Products extracted
31,402 /run
Price updates
89,145 /24h
Review records
214K /run
Active pipelines
18
Uptime
99.98%
Data Dictionary

Every field we extract from cultbeauty.co.uk

Structured, schema-consistent data across all major object types — delivered clean, typed, and ready to query.

Complete list of extractable fields for Product Listings objects from cultbeauty.co.uk. All fields typed and schema-versioned.

product_idurlnamebrandcategorysub_categoryprice_gbplist_price_gbpin_stockcult_consciousaverage_ratingreview_countdescriptionhow_to_use
product_listings
● 200 OK
"product_id": "123984",
"brand": "Paula's Choice",
"name": "Skin Perfecting 2% BHA Liquid Exfoliant",
"price_gbp": 35.0,
"in_stock": true,
"cult_conscious": true,
"average_rating": 4.8,
"review_count": 1452
# product_idurlnamebrandcategorysub_category
1
2
3

Complete list of extractable fields for Ingredients & Formulations objects from cultbeauty.co.uk. All fields typed and schema-versioned.

product_idbrandnameingredients_raw_textkey_ingredientsvegancruelty_freefragrance_freesulfate_freesilicone_free
ingredients_& formulations
● 200 OK
"product_id": "123984",
"brand": "Paula's Choice",
"vegan": true,
"cruelty_free": true,
"fragrance_free": true,
"key_ingredients": "['Salicylic Acid', 'Green Tea Extract']",
"ingredients_raw_text": "Aqua, Methylpropanediol, Butylene Glycol, Salicylic Acid, Polysorbate 20, Camellia Oleifera Leaf Extract, Sodium Hydroxide, Tetrasodium EDTA."
# product_idbrandnameingredients_raw_textkey_ingredientsvegan
1
2
3

Complete list of extractable fields for Shades & Variants objects from cultbeauty.co.uk. All fields typed and schema-versioned.

parent_idvariant_idbrandproduct_nameshade_nameshade_familysize_mlprice_gbpin_stockimage_url
shades_& variants
● 200 OK
"variant_id": "884721",
"parent_id": "884700",
"brand": "Charlotte Tilbury",
"product_name": "Airbrush Flawless Foundation",
"shade_name": "4 Neutral",
"shade_family": "Fair",
"price_gbp": 39.0,
"in_stock": true
# parent_idvariant_idbrandproduct_nameshade_nameshade_family
1
2
3

Complete list of extractable fields for Reviews & Ratings objects from cultbeauty.co.uk. All fields typed and schema-versioned.

review_idproduct_idauthor_nameratingreview_titlereview_bodyskin_typeskin_concernage_rangeverified_buyerhelpful_votesdate_posted
reviews_& ratings
● 200 OK
"review_id": "rev_993821",
"product_id": "123984",
"rating": 5,
"skin_type": "Combination",
"skin_concern": "Acne/Blemishes",
"verified_buyer": true,
"helpful_votes": 14,
"date_posted": "2026-03-14"
# review_idproduct_idauthor_nameratingreview_titlereview_body
1
2
3

Complete list of extractable fields for Brand Catalogues objects from cultbeauty.co.uk. All fields typed and schema-versioned.

brand_idbrand_namebrand_urltotal_productsdescriptioncategories_coveredprice_minprice_maxnew_arrivals_countbestseller_product_id
brand_catalogues
● 200 OK
"brand_name": "The Ordinary",
"brand_url": "https://www.cultbeauty.co.uk/brands/the-ordinary.list",
"total_products": 64,
"price_min": 4.5,
"price_max": 28.0,
"categories_covered": "['Skincare', 'Haircare', 'Makeup']",
"new_arrivals_count": 2
# brand_idbrand_namebrand_urltotal_productsdescriptioncategories_covered
1
2
3

Capabilities

Cosmetics data extraction, engineered for accuracy

Cult Beauty's frontend relies on dynamic variant loading and regional pricing modules. Our pipeline handles the JavaScript rendering and THG infrastructure routing to extract clean, structured product data.

Complex Variant Mapping

Extract individual SKUs for foundations and concealers. We map every shade name, colour family, and size back to the parent product.

Ingredient Parsing

Capture raw ingredient lists and structured tags like 'Cult Conscious', vegan, cruelty-free, and key active compounds.

Regional Pricing Capture

Extract GBP, USD, or EUR pricing based on target geography, including RRP, current price, and applied promotional discounts.

Stock & Waitlist Tracking

Monitor inventory status at the variant level. Identify out-of-stock items, waitlist availability, and discontinued SKUs.

Review & Profile Extraction

Scrape user reviews including specific metadata like reviewer skin type, skin tone, age range, and primary skin concerns.

Taxonomy & Categorisation

Maintain Cult Beauty's exact category tree (e.g., Skincare > Exfoliators > Liquid Exfoliants) for accurate competitor mapping.

Brand Level Aggregation

Track total SKU counts, new product launches, and brand-level promotions across the entire 300+ brand directory.

Promotional Badging

Capture 'New', 'Trending', 'Exclusive', and 'Free Gift' badges applied to product cards in search results.

Delta Extraction

Hash-based change detection ensures you only process records where price, stock, or formulation has changed since the last run.

// engagement pipeline

From target list to warehouse record

Brief in. Clean data out.

Define Scope
d 0

Provide target brands, categories, or the entire catalogue. We design the extraction schema for shades and ingredients.

Pipeline Build
d 2–4

We configure Scrapy / Playwright crawlers, proxy rotation, and anti-bot circumvention for THG's edge network.

Validation & QA
d 4–6

Schema validation, null-rate checks on ingredient lists, and variant consistency checks before full launch.

Delivery
ongoing

JSON / CSV / Parquet pushed to your S3 bucket, BigQuery dataset, or Snowflake stage on agreed cadence.

Under the hood

Navigating the Cult Beauty architecture

Extracting from THG-hosted platforms requires handling strict edge security and dynamic frontend frameworks. Here is how we maintain stable pipelines.

pipeline-monitor · cultbeauty.co.uk · live ● active
// fingerprinting
Identity rotation
TLS fingerprintrandomised
User-agentrotated
IP poolresidential
Challenges blocked0
// pagination
Page coverage
48,291 pages queued running
// observability
Pipeline health
99.9%
uptime
142ms
p99 lat
0.3%
null rate
2
alerts
Edge security
Bypassing THG anti-bot protection

Cult Beauty operates on The Hut Group (THG) infrastructure, which employs aggressive edge filtering. We utilise residential UK proxies and TLS fingerprint spoofing to maintain high success rates without triggering blocklists.

Dynamic rendering
Hydrating shade matrices via Playwright

Cosmetic products often have 40+ shades loaded asynchronously. Standard HTTP requests miss this data. We run headless Playwright sessions to execute JavaScript and capture the complete variant matrix.

Geo-pricing
Consistent regional context

Pricing shifts based on IP location and session cookies. Our crawlers inject strict locale headers and maintain sticky sessions to ensure pricing data is strictly isolated to your target geography (e.g., GBP vs USD).

Data structuring
Normalising cosmetic metadata

Ingredient lists and usage instructions are often unstructured HTML blobs. We apply regex and NLP parsing during the pipeline phase to separate active ingredients from base formulations and boolean tags.

Change detection
Efficient delta updates

We maintain state for the entire 30K+ product catalogue. Subsequent runs only emit data when a price changes, a shade goes out of stock, or a new product is added — drastically reducing your ingest costs.

Applications

Who uses Cult Beauty data — and how

Teams across industries use cultbeauty.co.uk data to build competitive products and smarter operations.

01
Competitor Price Tracking

Beauty retailers monitor Cult Beauty's pricing, discount strategies, and promotional cadences to optimise their own margins.

02
Brand & Assortment Analysis

D2C brands track category saturation, identifying gaps in shade ranges or formulation types across competing brands.

03
Ingredient Trend Forecasting

Formulators and product developers scrape ingredient lists to track the rise of specific actives (e.g., Peptides, Niacinamide) over time.

04
MAP Violation Monitoring

Premium beauty brands audit Cult Beauty to ensure their products are not being sold below Minimum Advertised Price agreements.

05
Consumer Sentiment Analysis

Marketing teams extract reviews correlated with skin types and age ranges to understand product efficacy and common complaints.

06
Supply Chain Intelligence

Analysts track out-of-stock rates across specific brands to estimate sales velocity and identify potential supply chain disruptions.

Why DataFlirt

"Cult Beauty holds the definitive catalogue of premium skincare and cosmetics — but tracking shade availability and ingredient shifts requires dedicated infrastructure."

Cosmetics data is uniquely complex. Single products contain dozens of shade variants, constantly changing ingredient lists, and geo-specific pricing. DataFlirt handles the JavaScript rendering and anti-bot circumvention required to extract this cleanly, so your team can focus on market analysis.

Technical Spec

Cult Beauty scraper — technical capabilities

Everything supported by our cultbeauty.co.uk scraper — rendered SPA elements, auth walls, rate-limit evasion and beyond.

JavaScript rendering
Full Playwright sessions required for shade selection and dynamic pricing
Supported
THG anti-bot bypass
Residential proxy rotation and TLS spoofing to navigate edge security
Supported
Variant extraction
Captures all child SKUs, shade names, and sizes per parent product
Supported
Ingredient parsing
Extracts raw text and identifies key highlighted ingredients
Supported
Review pagination
Traverses all review pages and extracts user skin profile metadata
Supported
Geo-specific pricing
Supports UK (GBP), US (USD), and EU (EUR) pricing via localised sessions
Supported
Change detection
Hash-based diffing to emit only updated prices or stock statuses
Supported
Webhook delivery
HTTP POST per record for real-time out-of-stock alerting
Supported
Cult Status points
Loyalty tier points and user reward history (requires authentication)
Partial
User order history
Past purchases and subscription management (requires authentication)
Partial
Infrastructure

Infrastructure powering the extraction

Open-source tooling on proven cloud infra — no vendor lock-in, full observability.

ScrapyPlaywrightPython 3.12RedisPostgreSQLApache AirflowAWS LambdaS3CloudWatch2CaptchaCapSolverResidential ProxiesDockerKubernetesGrafanaPrometheus
Scrapy + Playwright Stack

Scrapy handles crawl orchestration and deduplication. Playwright handles JavaScript rendering, ensuring all asynchronous shade data is captured accurately.

Residential Proxy Infrastructure

We maintain pools of residential ISP proxies across UK and US regions. Rotation happens per-request to bypass THG's strict edge filtering without IP bans.

Cloud-Native Orchestration

Pipelines run on AWS Lambda and ECS. Airflow handles scheduling, dependency management, and SLA alerting. All state is stored securely in managed Postgres.

Output & Delivery

Your data, your destination

Data delivered to where your team already works — no new tooling required.

JSON
Newline-delimited or nested — ideal for complex variant structures
CSV
Flat file with typed columns — ready for Excel or Pandas
XLS
Standard Excel format for business analysts
Parquet
Columnar format optimised for BigQuery and Snowflake
AWS S3
Direct bucket delivery on your specified cadence
Webhook
HTTP POST per record for real-time stock alerts
API
REST endpoint to query your extracted datasets
BigQuery
Streamed directly into your GCP environment
S3
Direct bucket delivery — compatible with any data lake
// faq

Common questions.

About cultbeauty.co.uk scraping, legality, and pipeline operations.

Ask us directly →
Is it legal to scrape Cult Beauty?

Scraping publicly available product, pricing, and review data is generally permissible. DataFlirt targets only public, non-authenticated endpoints. We do not extract personal user data or bypass login walls to access order histories. Clients should consult their legal counsel regarding specific commercial use cases.

How do you handle THG's anti-bot protection?

Cult Beauty is hosted on The Hut Group (THG) infrastructure, which uses advanced bot mitigation. We deploy UK-based residential proxies, TLS fingerprint spoofing, and realistic request timing to ensure our crawlers are indistinguishable from legitimate consumer traffic.

Can you extract all shades for a foundation or concealer?

Yes. Our pipeline maps the parent-child relationship for all variants. We extract the shade name, shade family, specific SKU price, and stock status for every available option on the product page.

Do you parse the ingredient lists?

Yes. We extract the raw ingredient text block and also capture structured metadata like 'Key Ingredients', vegan status, and 'Cult Conscious' tags provided by the platform.

How frequently can you update pricing and stock data?

For targeted ASIN/SKU lists, we can configure hourly runs. For full catalogue refreshes (approx. 30,000 products), we recommend a daily cadence to balance data freshness with infrastructure efficiency.

Can I get pricing in USD instead of GBP?

Yes. We can configure the pipeline to use US residential proxies and specific locale headers to extract the exact pricing displayed to US consumers.

What is the minimum engagement for a custom pipeline?

We start with targeted brand lists or specific category extractions. Contact our engineering team with your required data points and volume, and we will provide a scoped SLA and pricing model.

$ dataflirt scope --new-project --source=cultbeauty.co.uk ready

Tell us what
to extract.
We do the rest.

20-minute scoping call. Pilot dataset within the week. Production within two. Whether you need daily price tracking across top brands or a one-off extraction of ingredient profiles — we build and maintain the infrastructure. Tell us your requirements.

hello@dataflirt.com · Bengaluru · IST · typical reply < 4h
Related Scrapers

More in beauty and skincare

Services

Data Extraction for Every Industry

View All Services →