We extract cosmetic listings, shade variations, ingredient lists, pricing, and customer reviews from Urban Decay. Delivered as clean JSON, CSV, or Parquet to S3, BigQuery, or Snowflake on your schedule.
Structured, schema-consistent data across all major object types — delivered clean, typed, and ready to query.
Complete list of extractable fields for Product Listings objects from urbandecay.com. All fields typed and schema-versioned.
"product_id": "UD9821", "name": "All Nighter Waterproof Setting Spray", "category": "Face", "price": 36.0, "currency": "USD", "vegan_badge": true, "cruelty_free": true
| # | product_id | name | category | sub_category | price | currency |
|---|---|---|---|---|---|---|
| 1 | ||||||
| 2 | ||||||
| 3 |
Complete list of extractable fields for Shade Variations objects from urbandecay.com. All fields typed and schema-versioned.
"shade_id": "SHD-24N", "shade_name": "24NN", "hex_code": "#D4A373", "finish": "Matte", "inventory_status": "In Stock", "price": 40.0, "image_url": "https://example.com/image.jpg"
| # | shade_id | product_id | shade_name | hex_code | finish | inventory_status |
|---|---|---|---|---|---|---|
| 1 | ||||||
| 2 | ||||||
| 3 |
Complete list of extractable fields for Ingredients & Specs objects from urbandecay.com. All fields typed and schema-versioned.
"product_id": "UD9821", "key_ingredients": "['Hyaluronic Acid', 'Vitamin C']", "formula_type": "Liquid", "skin_type": "All Skin Types", "coverage": "Full", "finish": "Natural", "warnings": "Avoid contact with eyes"
| # | product_id | ingredients_list | key_ingredients | formula_type | skin_type | coverage |
|---|---|---|---|---|---|---|
| 1 | ||||||
| 2 | ||||||
| 3 |
Complete list of extractable fields for Reviews & Ratings objects from urbandecay.com. All fields typed and schema-versioned.
"review_id": "REV-99214", "rating": 5, "title": "Holy Grail Product", "body": "This setting spray lasts through extreme heat.", "date": "2023-08-14", "verified_buyer": true, "skin_type": "Combination"
| # | review_id | product_id | reviewer_name | rating | title | body |
|---|---|---|---|---|---|---|
| 1 | ||||||
| 2 | ||||||
| 3 |
Complete list of extractable fields for Pricing & Promos objects from urbandecay.com. All fields typed and schema-versioned.
"product_id": "UD9821", "base_price": 36.0, "sale_price": 28.8, "discount_pct": 20, "promo_badge": "Summer Sale", "beauty_squad_eligible": true, "stock_status": "In Stock"
| # | product_id | base_price | sale_price | discount_pct | promo_badge | beauty_squad_eligible |
|---|---|---|---|---|---|---|
| 1 | ||||||
| 2 | ||||||
| 3 |
Our scraper handles the complexities of cosmetic eCommerce: dynamic shade selectors, paginated reviews, and complex formulation data.
Extract product names, descriptions, categories, and sub-categories across the entire Urban Decay site.
Map parent products to dozens of shade SKUs, capturing hex codes, finish types, and individual swatch URLs.
Extract full INCI lists and key active ingredients for formulation analysis and compliance tracking.
Monitor out-of-stock statuses at the individual shade level to track demand and supply chain gaps.
Capture star ratings, review text, and user traits like skin type and eye colour for detailed sentiment analysis.
Track base prices, sale prices, and discount badges to monitor promotional strategies.
Extract high-resolution product images and swatch galleries for visual merchandising analysis.
Track cruelty-free, vegan, and other formulation certifications across the product line.
Run daily or weekly pipelines to detect price changes and inventory fluctuations.
Brief in. Clean data out.
Specify categories, specific product lines, or the entire catalogue. We design the schema to match your analytical needs.
We configure crawlers to handle Urban Decay's dynamic shade selectors and pagination, ensuring complete data capture.
We test the extraction logic against complex parent-child shade relationships and validate data types.
Structured data is delivered to your designated endpoint or storage bucket on your required schedule.
Extracting beauty data requires navigating complex variant structures and dynamic frontend frameworks. Here is how we manage it.
We utilise residential proxies and realistic browser fingerprints to navigate rate limits and WAF protections without disruption.
Urban Decay uses dynamic JavaScript to load shade data and swatches. We use full browser rendering to capture every variant.
We maintain the relational structure between a parent product and its dozens of individual shade variations and stock states.
Our pipelines hash previous runs and only deliver data when a price changes or a specific shade goes out of stock.
We monitor extraction success rates and schema changes, ensuring your data flow remains uninterrupted.
Beauty brands track Urban Decay's pricing and promotional cadences to adjust their own retail strategies.
Retailers analyse shade ranges and product categories to identify market gaps and assortment opportunities.
Formulators track active ingredients and INCI lists to understand trending formulations in the cosmetics market.
Marketing teams mine review text and ratings to understand consumer preferences regarding wear time and finish.
Analysts track out-of-stock rates across specific shades to estimate demand velocity.
Brands monitor the shift towards vegan and cruelty-free claims to align their own product development.
"Urban Decay's catalogue contains critical formulation data, shade matrices, and consumer sentiment that beauty brands need to stay competitive."
Extracting cosmetic data requires handling complex parent-child shade variations, dynamic inventory states, and paginated review modules. DataFlirt manages the proxy rotation, JavaScript execution, and schema maintenance so your data science team can focus on formulation trends and market gaps.
Everything supported by our urbandecay.com scraper — rendered SPA elements, auth walls, rate-limit evasion and beyond.
Open-source tooling on proven cloud infra — no vendor lock-in, full observability.
Scrapy manages orchestration and deduplication, while Playwright handles JavaScript rendering for dynamic shade selectors.
We utilise residential ISP proxies to route requests naturally, avoiding WAF blocks and rate limits.
Pipelines run on AWS infrastructure, managed by Apache Airflow for reliable scheduling and dependency resolution.
Data delivered to where your team already works — no new tooling required.
About urbandecay.com scraping, legality, and pipeline operations.
Ask us directly →Scraping publicly available product and review data is generally permissible. We do not bypass authentication walls or extract personally identifiable information.
We use JavaScript rendering to interact with the shade selector on the product page, capturing the unique data, price, and inventory status for every variant.
Yes. We extract the full INCI lists and key highlighted ingredients from the product detail pages.
We can schedule pipelines to run daily or at custom intervals to capture out-of-stock statuses as they update on the site.
Yes. When reviewers provide their skin type, eye colour, or age range, we extract those fields alongside the review text and rating.
Yes. We provide sample extracts during the scoping phase to ensure the schema meets your requirements before deployment.
20-minute scoping call. Pilot dataset within the week. Production within two. From single category tracking to full catalogue monitoring, we build and maintain the infrastructure. Contact us to define your schema.
