SYSTEM all green source lyko.com queue 12,841 pages p99 latency 184ms dataflirt.com · scraper/lyko-com
RUN - 37 active pipelines - lyko.com live

Lyko data,
at warehouse scale.

We extract product specifications, INCI ingredient lists, localised pricing, stock depth, and Lyko Social reviews. Delivered as clean JSON, CSV, or Parquet to S3, BigQuery, or Snowflake on your cadence.

Products extracted
142K /day
Stock updates
890K /24h
Social reviews
34K /run
Active pipelines
37
Uptime
99.98%
Data Dictionary

Every field we extract from lyko.com

Structured, schema-consistent data across all major object types — delivered clean, typed, and ready to query.

Complete list of extractable fields for Product Data objects from lyko.com. All fields typed and schema-versioned.

product_ideannamebrandcategory_pathpricecurrencyvolume_mlstock_statusratingreview_countimage_url
product_data
● 200 OK
"product_id": "1048-293-01",
"ean": "7350082520015",
"name": "Luminous Colour Hair Masque",
"brand": "Maria Nila",
"price": 349.0,
"currency": "SEK",
"volume_ml": 250,
"stock_status": "in_stock"
# product_ideannamebrandcategory_pathprice
1
2
3

Complete list of extractable fields for Pricing & Stock objects from lyko.com. All fields typed and schema-versioned.

product_idprice_currentprice_originaldiscount_pctcurrencyregionin_stockstock_qtycampaign_nameprice_timestamp
pricing_& stock
● 200 OK
"product_id": "1048-293-01",
"price_current": 279.0,
"price_original": 349.0,
"discount_pct": 20,
"currency": "SEK",
"region": "SE",
"in_stock": true,
"campaign_name": "Summer Haircare 20%"
# product_idprice_currentprice_originaldiscount_pctcurrencyregion
1
2
3

Complete list of extractable fields for Lyko Social objects from lyko.com. All fields typed and schema-versioned.

review_idproduct_idauthor_usernameratingreview_textlikes_countcomments_countverified_buyerimage_urlscreated_at
lyko_social
● 200 OK
"review_id": "rev-849201",
"product_id": "1048-293-01",
"author_username": "beauty_junkie_92",
"rating": 5,
"review_text": "Keeps my coloured hair vibrant for weeks. Smells amazing.",
"likes_count": 42,
"verified_buyer": true,
"created_at": "2026-03-14T10:22:00Z"
# review_idproduct_idauthor_usernameratingreview_textlikes_count
1
2
3

Complete list of extractable fields for Ingredients objects from lyko.com. All fields typed and schema-versioned.

product_idinci_listvegan_flagcruelty_freesulfate_freeparaben_freeactive_ingredientsskin_type_matchhair_type_match
ingredients
● 200 OK
"product_id": "1048-293-01",
"vegan_flag": true,
"cruelty_free": true,
"sulfate_free": true,
"active_ingredients": "['Pomegranate Extract', 'Colour Guard Complex']",
"inci_list": "Aqua, Cetearyl Alcohol, Polyglyceryl-3 Polyricinoleate...",
"hair_type_match": "['Coloured', 'Dry']"
# product_idinci_listvegan_flagcruelty_freesulfate_freeparaben_free
1
2
3

Complete list of extractable fields for Brand Taxonomy objects from lyko.com. All fields typed and schema-versioned.

brand_idbrand_namebrand_slugorigin_countryproduct_counttop_seller_flagnew_arrival_flagcategory_coverage
brand_taxonomy
● 200 OK
"brand_id": "br-492",
"brand_name": "Maria Nila",
"brand_slug": "maria-nila",
"origin_country": "Sweden",
"product_count": 142,
"top_seller_flag": true,
"new_arrival_flag": false,
"category_coverage": "['Haircare', 'Styling']"
# brand_idbrand_namebrand_slugorigin_countryproduct_counttop_seller_flag
1
2
3

Capabilities

Extract the complete Nordic beauty catalogue

Our Lyko scraper handles localized routing, Next.js hydration payloads, and dynamic stock endpoints to deliver accurate cosmetic data across all EU markets.

Product & Variant Mapping

Extract base products and all associated variants, mapping shade names, hex codes, and volume sizes to their specific EANs.

INCI Ingredient Parsing

Capture full ingredient lists and parse active components, vegan certifications, and allergen warnings directly from product specifications.

Geo-Localised Pricing

Route requests through regional proxies to capture accurate pricing in SEK, NOK, DKK, and EUR across Lyko's localized domains.

Dynamic Stock Tracking

Monitor inventory levels and out-of-stock indicators in real time to feed demand forecasting models.

Lyko Social Extraction

Mine user-generated content from Lyko Social, including ratings, text reviews, user uploads, and engagement metrics.

Campaign & Promotion Data

Track active discounts, multi-buy offers, and seasonal campaigns applied to specific brands or categories.

Next.js Payload Interception

Bypass fragile DOM parsing by intercepting and extracting structured JSON data directly from Next.js hydration states.

Brand Taxonomy Mapping

Extract complete category trees and brand hierarchies to understand assortment depth and category coverage.

Scheduled Change Detection

Run continuous pipelines that only emit records when price, stock, or campaign status changes.

High-Res Asset Extraction

Capture CDN URLs for primary product images, swatch colours, and user-submitted review photos.

// engagement pipeline

From target category to warehouse record

Brief in. Clean data out.

Define Scope
d 0

Provide target brands, categories, or specific product URLs. We design the schema together.

Pipeline Build
d 2–4

We configure Playwright crawlers, regional proxy routing, and payload interception for lyko.com.

Validation & QA
d 4–6

Schema validation, null-rate checks on ingredients, and currency verification before full launch.

Delivery
ongoing

JSON / CSV / Parquet pushed to your S3 bucket, BigQuery dataset, or Snowflake stage on agreed cadence.

Under the hood

Handling Lyko's frontend infrastructure

Extracting data from modern SPA architectures requires specialized techniques. Here is how we bypass DOM limitations.

pipeline-monitor · lyko.com · live ● active
// fingerprinting
Identity rotation
TLS fingerprintrandomised
User-agentrotated
IP poolresidential
Challenges blocked0
// pagination
Page coverage
48,291 pages queued running
// observability
Pipeline health
99.9%
uptime
142ms
p99 lat
0.3%
null rate
2
alerts
Payload interception
Reading Next.js hydration states

Lyko uses a React-based frontend. Instead of scraping the rendered HTML, our crawlers intercept the underlying JSON payloads, ensuring 100% accurate data extraction without selector breakage.

Regional routing
Market-specific session management

Pricing and stock vary by country. We maintain localized sessions using Nordic residential proxies and specific cookie configurations to extract accurate regional data.

Anti-bot layer
Residential proxy rotation

We distribute requests across high-quality ISP proxies to blend in with legitimate consumer traffic, bypassing rate limits and automated bot detection systems.

Change detection
Only re-scrape what changes

For daily stock and price monitoring, we maintain a hash index of last-seen values. Subsequent runs only push diffs, reducing downstream processing load.

Monitoring & alerting
Strict schema validation

Every run validates critical fields like EANs and prices. We alert on null-rate spikes or missing ingredient matrices immediately.

Applications

Who uses Lyko data - and how

Teams across industries use lyko.com data to build competitive products and smarter operations.

01
Competitor Price Monitoring

Beauty retailers monitor Lyko's pricing and promotional campaigns to adjust their own pricing strategies dynamically.

02
Ingredient Trend Analysis

Cosmetic manufacturers analyse INCI lists across top-selling products to identify trending active ingredients.

03
Assortment Planning

Brands track category depth and new arrivals to identify whitespace opportunities in the Nordic beauty market.

04
Brand Sentiment Analysis

Marketing teams mine Lyko Social reviews to measure consumer sentiment and product efficacy feedback.

05
MAP & Grey Market Monitoring

Premium brands audit pricing to ensure compliance with Minimum Advertised Price agreements.

06
Demand Forecasting

Supply chain analysts track stock-out frequencies and review velocity to predict product demand cycles.

Why DataFlirt

"Lyko holds the most structured beauty and cosmetics dataset in the Nordics - but extracting accurate ingredient matrices and localized pricing requires specialized infrastructure."

Most teams underestimate the complexity of scraping modern Next.js applications. Reliable Lyko extraction requires intercepting hydration payloads, managing regional cookies for accurate currency, and routing requests through Nordic residential proxies to avoid rate limits. DataFlirt absorbs this infrastructure overhead so you can focus on analysis.

Technical Spec

Lyko scraper - technical capabilities

Everything supported by our lyko.com scraper — rendered SPA elements, auth walls, rate-limit evasion and beyond.

Next.js payload extraction
Direct extraction of structured JSON from hydration states
Supported
Multi-region pricing
Support for SE, NO, FI, DK, and EU domain variants
Supported
Lyko Social extraction
Full capture of community posts, comments, and likes
Supported
Ingredient parsing
Structured extraction of INCI lists and active compounds
Supported
Residential proxy rotation
Nordic ISP-grade proxies to ensure accurate localization
Supported
Variant/shade mapping
Links parent products to all available color and size variants
Supported
Change detection (diffs)
Hash-based diffs for stock and price updates
Supported
Webhook delivery
HTTP POST per record for real-time processing
Supported
Club Lyko points
Gated loyalty program data requires user authentication
Partial
Private purchase history
User order history is strictly authenticated and private
Partial
User wishlists
Personal saved items and favorites are gated
Partial
Infrastructure

Infrastructure powering the Lyko pipeline

Open-source tooling on proven cloud infra — no vendor lock-in, full observability.

ScrapyPlaywrightPython 3.12RedisPostgreSQLApache AirflowAWS LambdaS3CloudWatch2CaptchaCapSolverResidential ProxiesDockerKubernetesGrafanaPrometheus
Scrapy + Playwright Stack

Scrapy handles orchestration and retry logic. Playwright handles localized cookie sessions and Next.js payload interception.

Residential Proxy Infrastructure

We maintain pools of residential ISP proxies across Nordic regions. Rotation happens per-request with sticky sessions for localized pricing.

Cloud-Native Orchestration

Pipelines run on AWS Lambda and ECS. Airflow handles scheduling, dependency management, and SLA alerting. State stored in Postgres.

Output & Delivery

Your data, your destination

Data delivered to where your team already works — no new tooling required.

JSON
Newline-delimited or nested - schema versioned per run
CSV
Flat file with typed columns - Excel/Sheets compatible
XLS
Excel format for direct business analyst consumption
Parquet
Columnar format for BigQuery, Snowflake, Athena
AWS S3
Direct bucket delivery - compatible with any data lake
Webhook
HTTP POST per record for real-time downstream processing
API
REST endpoint to query your extracted datasets
BigQuery
Streamed directly into your dataset with schema auto-detect
S3
Direct bucket delivery — compatible with any data lake
// faq

Common questions.

About lyko.com scraping, legality, and pipeline operations.

Ask us directly →
Is scraping Lyko legal?

Scraping publicly available information from Lyko is generally permissible under applicable law. DataFlirt targets only public product, pricing, and social data. We do not extract personal data, circumvent authentication walls, or violate GDPR. Clients should consult legal counsel for specific use cases.

How do you handle localized pricing across Nordic countries?

We use regional residential proxies and specific session cookies to route requests as if they originate from Sweden, Norway, Finland, or Denmark. This ensures the pricing, currency, and stock data match the exact regional storefront.

Can you extract Lyko Social reviews and images?

Yes. We extract the full text, star ratings, author metadata, like counts, and CDN URLs for user-uploaded images from the Lyko Social community platform.

How fresh is the stock and price data?

For targeted product lists, we can run hourly pipelines to capture flash sales and stock-outs. Full catalogue refreshes typically run on a daily cadence.

Do you extract full ingredient lists?

Yes. We capture the complete INCI ingredient text block and also parse out structured flags for vegan, cruelty-free, and specific active compounds when available in the product specifications.

What is the minimum viable engagement?

Our smallest packages start at a defined brand list or category subset with weekly delivery. For full-site extraction across multiple regions, we price based on compute volume and delivery frequency.

Can I request a sample dataset?

Yes. We provide a sample run of up to 500 products as part of the pre-engagement scoping process, allowing you to validate schema fit and currency accuracy before signing.

$ dataflirt scope --new-project --source=lyko.com ready

Tell us what
to extract.
We do the rest.

20-minute scoping call. Pilot dataset within the week. Production within two. Whether you need a one-off catalogue dump or continuous price-monitoring across Nordic markets - we scope, build, and operate the pipeline. Tell us what you need.

hello@dataflirt.com · Bengaluru · IST · typical reply < 4h
Related Scrapers

More in beauty and skincare

Services

Data Extraction for Every Industry

View All Services →