SYSTEM all green source nyxcosmetics.com queue 4,182 URLs p99 latency 185ms dataflirt.com · scraper/nyxcosmetics-com
RUN · 14 active pipelines · nyxcosmetics.com live

NYX Cosmetics data,
structured for scale.

We extract makeup catalogues, shade variations, ingredient lists, pricing signals, and customer reviews from nyxcosmetics.com. Delivered as clean JSON, CSV, or Parquet to S3, BigQuery, or Snowflake on your cadence.

Products extracted
2,841 /run
Shade variations
14,392 /run
Review records
312K /month
Active pipelines
14
Uptime
99.98%
Data Dictionary

Every field we extract from nyxcosmetics.com

Structured, schema-consistent data across all major object types — delivered clean, typed, and ready to query.

Complete list of extractable fields for Product Catalogue objects from nyxcosmetics.com. All fields typed and schema-versioned.

product_idnamecategorysub_categoryurldescriptionbase_pricecurrencyvegan_flagcruelty_free_flagbest_seller_badgenew_arrival_badge
product_catalogue
● 200 OK
"product_id": "NYX_800897192",
"name": "Fat Oil Lip Drip",
"category": "Lips",
"sub_category": "Lip Gloss",
"base_price": 9.0,
"currency": "USD",
"vegan_flag": true,
"cruelty_free_flag": true
# product_idnamecategorysub_categoryurldescription
1
2
3

Complete list of extractable fields for Shade Matrix objects from nyxcosmetics.com. All fields typed and schema-versioned.

product_idshade_nameshade_hex_codeskuupcstock_statuspriceswatch_image_urlmodel_image_url
shade_matrix
● 200 OK
"product_id": "NYX_800897192",
"shade_name": "Missed Call",
"shade_hex_code": "#FFB6C1",
"sku": "800897192534",
"stock_status": "IN_STOCK",
"price": 9.0,
"swatch_image_url": "https://nyxcosmetics.com/dw/image/v2/swatch_missed_call.jpg"
# product_idshade_nameshade_hex_codeskuupcstock_status
1
2
3

Complete list of extractable fields for Ingredients & Specs objects from nyxcosmetics.com. All fields typed and schema-versioned.

product_idingredients_texthow_to_applybenefitsfinish_typecoverage_typeformat_typenet_weight
ingredients_& specs
● 200 OK
"product_id": "NYX_800897192",
"finish_type": "Glossy",
"coverage_type": "Sheer",
"format_type": "Liquid",
"net_weight": "4.8 ml",
"benefits": "Hydrating, Non-sticky, High shine",
"ingredients_text": "POLYISOBUTENE, HYDROGENATED POLYISOBUTENE, PENTAERYTHRITYL TETRAISOSTEARATE..."
# product_idingredients_texthow_to_applybenefitsfinish_typecoverage_type
1
2
3

Complete list of extractable fields for Reviews & Ratings objects from nyxcosmetics.com. All fields typed and schema-versioned.

review_idproduct_idreviewer_nameratingreview_titlereview_textskin_typeeye_colourage_rangehelpful_votesdate_posted
reviews_& ratings
● 200 OK
"review_id": "REV_9928173",
"product_id": "NYX_800897192",
"rating": 5,
"review_title": "Best lip oil ever",
"skin_type": "Combination",
"eye_colour": "Brown",
"age_range": "18-24",
"date_posted": "2026-02-14"
# review_idproduct_idreviewer_nameratingreview_titlereview_text
1
2
3

Complete list of extractable fields for Pricing & Promos objects from nyxcosmetics.com. All fields typed and schema-versioned.

product_idskubase_pricesale_pricediscount_pctpromo_textloyalty_points_valuecurrencytimestamp
pricing_& promos
● 200 OK
"product_id": "NYX_800897192",
"sku": "800897192534",
"base_price": 9.0,
"sale_price": 7.2,
"discount_pct": 20,
"promo_text": "20% Off Sitewide",
"currency": "USD",
"timestamp": "2026-05-12T10:05:00Z"
# product_idskubase_pricesale_pricediscount_pctpromo_text
1
2
3

Capabilities

Extract every shade, ingredient, and price signal

NYX Cosmetics relies heavily on dynamic front-end frameworks to display its massive shade matrices. Our pipeline parses the underlying state objects and APIs to deliver structured beauty data without missing a single SKU.

Complete Shade Extraction

Map every parent product to its child shade variations, capturing SKU, UPC, shade name, hex codes, and swatch image URLs.

SKU-Level Stock Tracking

Monitor inventory availability at the variant level. Know exactly which shades are out of stock or backordered.

Ingredient & Benefit Parsing

Extract full ingredient lists, vegan certifications, cruelty-free badges, and product benefit claims for compliance and analysis.

Review & Trait Mining

Capture customer reviews including demographic traits like skin type, eye colour, and age range to correlate sentiment with buyer profiles.

Dynamic Pricing & Promos

Track base prices, sale prices, sitewide discount banners, and loyalty point values across the entire catalogue.

Taxonomy & Categorisation

Preserve the exact site hierarchy from main categories down to niche sub-categories like 'Lip Plumpers' or 'Setting Sprays'.

Asset URL Harvesting

Extract high-resolution product images, shade swatches, and model application shots for your internal PIM or asset library.

Geo-Targeted Crawling

Use region-specific residential proxies to capture localised pricing and availability for different NYX regional storefronts.

Incremental Updates

Run daily diffs to track new product drops, discontinued shades, and price changes without re-processing the entire site.

// engagement pipeline

From URL list to warehouse record

Brief in. Clean data out.

Define Scope
d 0

Specify categories, specific product URLs, or full-site extraction. We map the required fields and frequency.

Pipeline Build
d 2–4

We configure Scrapy extractors, handle API pagination for reviews, and manage residential proxy rotation.

Validation & QA
d 4–6

Automated tests ensure shade matrices align with parent products and ingredient lists are fully parsed.

Delivery
ongoing

Clean JSON, CSV, or Parquet delivered to your S3 bucket, BigQuery, or Snowflake stage.

Under the hood

Overcoming beauty site extraction challenges

Cosmetics sites present unique data structures. Here is how we handle the complexity of nyxcosmetics.com.

pipeline-monitor · nyxcosmetics.com · live ● active
// fingerprinting
Identity rotation
TLS fingerprintrandomised
User-agentrotated
IP poolresidential
Challenges blocked0
// pagination
Page coverage
48,291 pages queued running
// observability
Pipeline health
99.9%
uptime
142ms
p99 lat
0.3%
null rate
2
alerts
Shade matrices
Parsing complex front-end state

A single NYX foundation can have 45 shades. Standard HTML scraping misses the variant data. We intercept the JSON state objects embedded in the page to extract the full matrix of SKUs, hex codes, and stock statuses.

Review pagination
Direct API extraction

Reviews on nyxcosmetics.com are loaded dynamically via third-party providers. We bypass the DOM and query the underlying review APIs directly, extracting the full historical corpus including user traits like skin type and eye colour.

Geo-blocking
Residential proxy rotation

Accessing the US storefront from external data centres often results in redirects or blocks. We route all requests through US-based residential ISP proxies to ensure consistent access to accurate pricing and inventory.

Dynamic inventory
Real-time stock indicators

Stock status frequently updates via asynchronous calls after the initial page load. Our Playwright integration waits for network idle states to ensure we capture the true availability of every shade.

Schema normalisation
Structuring unstructured descriptions

Product benefits and 'how to apply' instructions are often mixed in raw HTML blocks. We use custom parsers to clean and separate this text into distinct, queryable database columns.

Applications

Who uses NYX Cosmetics data

Teams across industries use nyxcosmetics.com data to build competitive products and smarter operations.

01
Assortment Planning

Retailers and competing brands analyse shade ranges and category depth to identify gaps in their own product lines.

02
Competitor Pricing Intelligence

Track base prices and promotional discounting strategies across face, lip, and eye categories to optimise pricing models.

03
Ingredient Analysis

R&D teams extract ingredient lists to track the adoption of specific compounds, vegan formulations, and cruelty-free claims.

04
Sentiment & Trait Correlation

Marketing teams mine review data to understand product performance across different skin types and age demographics.

05
Trend Forecasting

Monitor 'New Arrival' and 'Best Seller' badges combined with stockout rates to identify trending formats and colours.

06
MAP Monitoring

Ensure third-party retailers are adhering to Minimum Advertised Price policies by comparing their prices against the direct-to-consumer site.

Why DataFlirt

"Beauty data is highly dimensional. A single lipstick has 40 shades, each with its own inventory status, UPC, and swatch image."

Extracting from nyxcosmetics.com requires parsing complex front-end state objects to map parent products to their extensive shade variations. DataFlirt handles the JavaScript execution, proxy management, and schema normalisation so your data engineers receive clean, queryable beauty datasets instead of raw HTML dumps.

Technical Spec

NYX Cosmetics scraper specifications

Everything supported by our nyxcosmetics.com scraper — rendered SPA elements, auth walls, rate-limit evasion and beyond.

JavaScript rendering
Playwright integration for dynamic state and asynchronous data loading
Supported
Shade variant mapping
Extracts all child SKUs, hex codes, and prices under a parent product ID
Supported
Ingredient parsing
Separates ingredient lists from general product descriptions
Supported
Review API extraction
Directly queries the underlying review provider for complete pagination
Supported
Residential proxy rotation
Bypasses geo-blocks to access region-specific NYX storefronts
Supported
Incremental syncs
Hash-based diffing to track price and stock changes daily
Supported
Virtual Try-On AR models
Extraction of 3D facial mapping assets and AR camera filters
Partial
Makeup Crew loyalty accounts
Extraction of user-specific points, purchase history, and gated rewards
Partial
Infrastructure

Infrastructure powering the pipeline

Open-source tooling on proven cloud infra — no vendor lock-in, full observability.

ScrapyPlaywrightPython 3.12RedisPostgreSQLApache AirflowAWS LambdaS3CloudWatch2CaptchaCapSolverResidential ProxiesDockerKubernetesGrafanaPrometheus
Scrapy + Playwright Stack

Scrapy handles crawl orchestration and deduplication. Playwright handles JavaScript rendering, state object extraction, and API interception.

Residential Proxy Infrastructure

We maintain pools of residential ISP proxies to ensure consistent access and bypass regional redirects.

Cloud-Native Orchestration

Pipelines run on AWS Lambda and ECS. Airflow handles scheduling, dependency management, and SLA alerting.

Output & Delivery

Your data, your destination

Data delivered to where your team already works — no new tooling required.

JSON
Nested structures ideal for parent-child shade relationships
CSV
Flat files with normalised columns for immediate analysis
Parquet
Columnar format optimised for BigQuery and Snowflake
AWS S3
Direct bucket delivery compatible with any modern data lake
Webhook
HTTP POST per record for real-time stockout alerts
API
REST endpoints to query your extracted dataset on demand
XLS
Excel-ready exports for merchandising and marketing teams
PostgreSQL
Direct database upserts with conflict resolution
S3
Direct bucket delivery — compatible with any data lake
// faq

Common questions.

About nyxcosmetics.com scraping, legality, and pipeline operations.

Ask us directly →
Is scraping nyxcosmetics.com legal?

Scraping publicly available product catalogues, prices, and reviews is generally permissible under applicable law. DataFlirt targets only public, non-authenticated data. We do not bypass login walls or extract personal customer information.

How do you handle the massive shade variations?

We do not rely on clicking through the UI. Our scrapers parse the underlying JSON state objects embedded in the page source, extracting the complete matrix of SKUs, hex codes, stock statuses, and prices instantly.

Can you track out-of-stock statuses per shade?

Yes. Inventory status is captured at the SKU/variant level, not just the parent product level. You will know exactly which shades are unavailable.

Do you extract customer reviews and demographic traits?

Yes. We extract the full review corpus including star ratings, text, and user-submitted traits like skin type, eye colour, and age range by querying the underlying review provider APIs directly.

Can we get high-resolution swatch images?

Yes. The pipeline extracts the absolute URLs for product shots, shade swatches, and model application images. We can deliver the URLs or download the assets directly to your S3 bucket.

How fresh is the pricing and promo data?

Pipelines can be configured to run daily or at specific hourly intervals to capture flash sales, site-wide promo banner text, and dynamic price adjustments.

Can you extract data from different regional storefronts?

Yes. By routing requests through region-specific residential proxies, we can extract localised catalogues, pricing, and availability for different international NYX domains.

$ dataflirt scope --new-project --source=nyxcosmetics.com ready

Tell us what
to extract.
We do the rest.

20-minute scoping call. Pilot dataset within the week. Production within two. From single category tracking to daily full-site shade and price extraction — we build and operate the infrastructure. Tell us your data requirements.

hello@dataflirt.com · Bengaluru · IST · typical reply < 4h
Related Scrapers

More in beauty and skincare

Services

Data Extraction for Every Industry

View All Services →