SYSTEM all green source lookfantastic.com queue 12,844 pages p99 latency 184ms dataflirt.com · scraper/lookfantastic-com
RUN * 87 active pipelines * lookfantastic.com live

Lookfantastic data,
at warehouse scale.

We extract beauty catalogues, ingredient profiles, pricing signals, and brand intelligence from Lookfantastic. Delivered as clean JSON, CSV, or Parquet to S3, BigQuery, or Snowflake on your cadence.

Products extracted
184K /day
Price updates
412K /24h
Review records
1.2M /run
Active pipelines
87
Uptime
99.98%
Data Dictionary

Every field we extract from lookfantastic.com

Structured, schema-consistent data across all major object types — delivered clean, typed, and ready to query.

Complete list of extractable fields for Product Listings objects from lookfantastic.com. All fields typed and schema-versioned.

product_idurltitlebrandcategorysub_categorypricerrpin_stockingredientsdescriptiondirectionsvolume_ml
product_listings
● 200 OK
"product_id": "11234567",
"title": "The Ordinary Niacinamide 10% + Zinc 1% 30ml",
"brand": "The Ordinary",
"price": 5.0,
"rrp": 5.5,
"in_stock": true,
"volume_ml": 30
# product_idurltitlebrandcategorysub_category
1
2
3

Complete list of extractable fields for Pricing & Offers objects from lookfantastic.com. All fields typed and schema-versioned.

product_idcurrent_pricerrpdiscount_pctpromo_code_eligiblesubscription_priceprice_timestampcurrencymulti_buy_offer
pricing_& offers
● 200 OK
"product_id": "11234567",
"current_price": 5.0,
"rrp": 5.5,
"discount_pct": 9,
"promo_code_eligible": false,
"price_timestamp": "2024-11-12T08:12:00Z",
"currency": "GBP"
# product_idcurrent_pricerrpdiscount_pctpromo_code_eligiblesubscription_price
1
2
3

Complete list of extractable fields for Ingredients & Formulations objects from lookfantastic.com. All fields typed and schema-versioned.

product_idingredient_listkey_ingredientsfree_fromvegancruelty_freeactive_compoundsformulation_typeskin_type_suitability
ingredients_& formulations
● 200 OK
"product_id": "11234567",
"key_ingredients": "['Niacinamide', 'Zinc PCA']",
"vegan": true,
"cruelty_free": true,
"formulation_type": "Serum",
"skin_type_suitability": "['Blemish-prone', 'Oily']"
# product_idingredient_listkey_ingredientsfree_fromvegancruelty_free
1
2
3

Complete list of extractable fields for Reviews & Ratings objects from lookfantastic.com. All fields typed and schema-versioned.

review_idproduct_idratingtitlebodyauthordateverified_purchasehelpful_votes
reviews_& ratings
● 200 OK
"review_id": "REV9876543",
"product_id": "11234567",
"rating": 5,
"title": "Holy grail serum",
"body": "Cleared my skin in two weeks. Will repurchase.",
"author": "Sarah M.",
"date": "2024-10-01",
"verified_purchase": true
# review_idproduct_idratingtitlebodyauthor
1
2
3

Complete list of extractable fields for Brand Data objects from lookfantastic.com. All fields typed and schema-versioned.

brand_namebrand_urlproduct_countavg_pricetop_categoriesbrand_descriptionlogo_urlactive_promotionsnew_arrivals_count
brand_data
● 200 OK
"brand_name": "The Ordinary",
"product_count": 142,
"avg_price": 8.5,
"top_categories": "['Skincare', 'Serums']",
"active_promotions": "['3 for 2 on Skincare']",
"logo_url": "https://example.com/logo.jpg"
# brand_namebrand_urlproduct_countavg_pricetop_categoriesbrand_description
1
2
3

Capabilities

Everything you need from Lookfantastic, nothing you do not

Our Lookfantastic scraper handles every layer of the platform: product listings, ingredient profiles, dynamic pricing, and brand intelligence, with JavaScript rendering and anti-bot circumvention built in.

Full Product Extraction

Title, brand, description, directions, and volume metrics extracted at the item level with parent-child variant mapping for shades and sizes.

Real-Time Price Tracking

Capture RRP, current price, promotional codes, and multi-buy offers timestamped per crawl.

Ingredient Parsing

Extract raw ingredient lists and highlight key active compounds, vegan status, and cruelty-free claims.

Review & Rating Mining

Full review text, star ratings, helpful vote counts, and verified purchase flags paginated across all review pages.

Variant Mapping

Map cosmetic shades, sizes, and bundle configurations to parent products accurately.

Stock Availability

Monitor out of stock status and restock patterns across the entire catalogue.

Promotional Tracking

Capture sitewide sales, multi-buy offers, and exclusive discount codes applied at checkout.

Brand Catalogues

Scrape entire brand pages to track product assortment, new arrivals, and category dominance.

Scheduled Modes

Run one-off bulk exports or configure continuous pipelines at daily or real-time cadences with change-detection diffing.

// engagement pipeline

From URL list to warehouse record

Brief in. Clean data out.

Define Scope
d 0

Provide brand URLs, category links, or keyword sets. We design the extraction schema together.

Pipeline Build
d 2–4

We configure Scrapy / Playwright crawlers, proxy rotation, session management, and CAPTCHA handling for lookfantastic.com.

Validation & QA
d 4–6

Schema validation, null-rate checks, price-outlier detection, and sample reviews before full launch.

Delivery
ongoing

JSON / CSV / Parquet pushed to your S3 bucket, BigQuery dataset, or Snowflake stage on agreed cadence.

Under the hood

How our Lookfantastic pipeline handles the hard parts

Lookfantastic employs strict scraping countermeasures. Here is how we stay resilient and why teams choose managed infrastructure over DIY.

pipeline-monitor · lookfantastic.com · live ● active
// fingerprinting
Identity rotation
TLS fingerprintrandomised
User-agentrotated
IP poolresidential
Challenges blocked0
// pagination
Page coverage
48,291 pages queued running
// observability
Pipeline health
99.9%
uptime
142ms
p99 lat
0.3%
null rate
2
alerts
Anti-bot layer
Residential proxy rotation and fingerprint spoofing

Lookfantastic bot detection operates on TLS fingerprints and IP reputation. Our crawlers use residential ISP proxies with realistic browser fingerprints, trained on real user behaviour patterns.

JavaScript rendering
Full Playwright execution for dynamic content

Lookfantastic product pages and shade selectors are heavily JavaScript-rendered. We run full Playwright browser sessions with JavaScript execution to capture data that headless HTTP clients miss entirely.

Schema stability
Resilient selectors with fallback chains

Lookfantastic changes its DOM structure frequently. Our selector strategy uses multiple fallback chains per field so a layout change does not break your data pipeline overnight.

Change detection
Only re-scrape what has changed

For large beauty catalogues, we maintain a hash index of last-seen values per field. Subsequent runs only push diffs, reducing compute cost and downstream processing load.

Monitoring & alerting
24/7 pipeline health with anomaly detection

Every run emits structured logs to our observability stack. We alert on null-rate spikes, price outliers, and coverage drops, and respond before you notice.

Applications

Who uses Lookfantastic data and how

Teams across industries use lookfantastic.com data to build competitive products and smarter operations.

01
Price Intelligence

Beauty brands and retailers monitor competitor pricing, promotional windows, and discount codes to protect margin.

02
Ingredient Analysis

Cosmetic formulators track trending active compounds like Niacinamide or Retinol across top-selling products.

03
Brand MAP Monitoring

Brands audit third-party sellers for MAP violations and unauthorised discounting.

04
Assortment Planning

Retail buyers analyse category gaps in skincare and haircare to identify whitespace and investment opportunities.

05
AI Training Data

Machine learning teams use ingredient and review datasets to train cosmetic recommendation engines.

06
Demand Forecasting

Supply chain teams correlate review velocity and stock depth indicators with sales trends to improve procurement models.

Why DataFlirt

"Lookfantastic holds the definitive dataset for global beauty pricing and ingredient formulations, but extracting it requires a dedicated infrastructure."

Most teams underestimate the investment required. Reliable Lookfantastic scraping requires residential proxies, full JavaScript rendering for shade selectors, CAPTCHA handling, daily selector maintenance, and anomaly monitoring. DataFlirt absorbs that complexity so your engineers can focus on the analysis, not the infrastructure.

Technical Spec

Lookfantastic scraper technical capabilities

Everything supported by our lookfantastic.com scraper — rendered SPA elements, auth walls, rate-limit evasion and beyond.

JavaScript rendering
Full Playwright sessions required for shade selectors and dynamic price updates
Supported
CAPTCHA bypass
Automated 2Captcha and CapSolver integration
Supported
Residential proxy rotation
ISP-grade residential IPs from UK and EU pools rotated per request
Supported
Variant and shade mapping
Parent to child relationships for all cosmetic colour options and sizes
Supported
Ingredient list parsing
Extraction of raw ingredient text and structured active compounds
Supported
Review pagination
Full review corpus including all star-filter pages
Supported
Change detection
Hash-based diff to only emit records with changed fields since last run
Supported
Webhook delivery
HTTP POST per record or batch for real-time workflows
Supported
Lookfantastic Beauty Box subscriber data
Requires individual user authentication and active subscription
Partial
User account purchase history
Gated data requires account credentials
Partial
Infrastructure

Infrastructure powering the Lookfantastic pipeline

Open-source tooling on proven cloud infra — no vendor lock-in, full observability.

ScrapyPlaywrightPython 3.12RedisPostgreSQLApache AirflowAWS LambdaS3CloudWatch2CaptchaCapSolverResidential ProxiesDockerKubernetesGrafanaPrometheus
Scrapy + Playwright Stack

Scrapy handles crawl orchestration, deduplication, and retry logic. Playwright handles JavaScript rendering, cookie sessions, and interaction flows for shade selectors.

Residential Proxy Infrastructure

We maintain pools of residential ISP proxies across UK and EU regions. Rotation happens per-request with sticky sessions where required to bypass regional pricing blocks.

Cloud-Native Orchestration

Pipelines run on AWS Lambda and ECS. Airflow handles scheduling, dependency management, and SLA alerting. All state stored in managed Postgres.

Output & Delivery

Your data, your destination

Data delivered to where your team already works — no new tooling required.

JSON
Newline-delimited or nested, schema versioned per run
CSV
Flat file with typed columns, Excel compatible
XLS
Spreadsheet format for non-technical teams
Parquet
Columnar format for BigQuery, Snowflake, Athena
AWS S3
Direct bucket delivery, compatible with any data lake
Webhook
HTTP POST per record for real-time downstream processing
API
RESTful endpoints to query extracted data on demand
BigQuery
Streamed directly into your dataset with schema auto-detect
Snowflake
Stage and COPY INTO workflow, incremental or full-replace
Postgres
Upsert into your existing schema with conflict resolution
S3
Direct bucket delivery — compatible with any data lake
// faq

Common questions.

About lookfantastic.com scraping, legality, and pipeline operations.

Ask us directly →
Is scraping Lookfantastic legal?

Scraping publicly available information from Lookfantastic is generally permissible under applicable law. DataFlirt targets only public, non-authenticated product, pricing, and review data. We do not extract personal data or circumvent authentication walls.

How do you handle Lookfantastic anti-bot systems?

We use residential ISP proxies, full Playwright browser sessions with realistic fingerprints, and request timing modelled on human behaviour. Our selectors have multi-layer fallback chains so DOM changes do not break the pipeline.

Can you extract all shades for a makeup product?

Yes. We map all child variants, including shades, sizes, and bundle options, to the parent product, capturing the specific price and stock status for each variant.

Do you extract ingredient lists?

Yes. We extract the full raw ingredient text and can parse it to flag key active compounds, allergens, and brand claims like vegan or cruelty-free.

How fresh is the pricing data?

Real-time streaming pipelines achieve sub-60-minute latency for price and availability signals on a defined product set. Full catalogue refreshes complete within a 6 to 12 hour window.

What is the minimum viable engagement?

Our smallest packages start at a defined product list with weekly delivery. For larger catalogues or custom schema requirements, we price based on volume and delivery frequency.

Do you support Lookfantastic review scraping?

Yes, including full pagination across all star-filter views. Each review record includes rating, title, body, helpful votes, and verified purchase flags.

Can I request a sample dataset before committing?

Absolutely. We provide a sample run of up to 500 products as part of the pre-engagement scoping process so you can validate schema fit and data quality.

$ dataflirt scope --new-project --source=lookfantastic.com ready

Tell us what
to extract.
We do the rest.

20-minute scoping call. Pilot dataset within the week. Production within two. Whether you need a one-off catalogue dump or a continuous price-monitoring feed across 150K beauty products, we scope, build, and operate the pipeline. Tell us what you need.

hello@dataflirt.com · Bengaluru · IST · typical reply < 4h
Related Scrapers

More in beauty and skincare

Services

Data Extraction for Every Industry

View All Services →