SYSTEM all green source scentbird.com queue 8,412 URLs p99 latency 185ms dataflirt.com · scraper/scentbird-com
RUN - 42 active pipelines - scentbird.com live

Scentbird data,
at warehouse scale.

We extract fragrance catalogues, scent profiles, brand portfolios, and review corpora from Scentbird. Delivered as clean JSON, CSV, or Parquet to S3, BigQuery, or Snowflake on your cadence.

Fragrances extracted
9,241 /run
Brand profiles
843 /run
Review records
1.2M /month
Active pipelines
42
Uptime
99.98%
Data Dictionary

Every field we extract from scentbird.com

Structured, schema-consistent data across all major object types — delivered clean, typed, and ready to query.

Complete list of extractable fields for Fragrance Catalogue objects from scentbird.com. All fields typed and schema-versioned.

fragrance_idnamebrand_namegender_targetdescriptionmain_accordsratingreview_countfull_pricesubscription_eligibleimage_urlurl
fragrance_catalogue
● 200 OK
"fragrance_id": "sb_94821",
"name": "Santal 33",
"brand_name": "Le Labo",
"gender_target": "Unisex",
"rating": 4.6,
"review_count": 14205,
"full_price": 230.0,
"subscription_eligible": true
# fragrance_idnamebrand_namegender_targetdescriptionmain_accords
1
2
3

Complete list of extractable fields for Scent Notes objects from scentbird.com. All fields typed and schema-versioned.

fragrance_idtop_notesmiddle_notesbase_notesscent_familyseason_tagsoccasion_tagscomplexity_scoreintensitylongevity
scent_notes
● 200 OK
"fragrance_id": "sb_94821",
"top_notes": "['Violet', 'Cardamom']",
"middle_notes": "['Iris', 'Ambrox']",
"base_notes": "['Cedarwood', 'Leather', 'Sandalwood']",
"scent_family": "Woody",
"season_tags": "['Fall', 'Winter']"
# fragrance_idtop_notesmiddle_notesbase_notesscent_familyseason_tags
1
2
3

Complete list of extractable fields for Brand Profiles objects from scentbird.com. All fields typed and schema-versioned.

brand_idnamedescriptioncountry_of_originfounded_yearfragrance_countaverage_ratingpopular_scentswebsite_urllogo_url
brand_profiles
● 200 OK
"brand_id": "br_104",
"name": "Le Labo",
"country_of_origin": "USA",
"founded_year": 2006,
"fragrance_count": 19,
"average_rating": 4.5
# brand_idnamedescriptioncountry_of_originfounded_yearfragrance_count
1
2
3

Complete list of extractable fields for User Reviews objects from scentbird.com. All fields typed and schema-versioned.

review_idfragrance_iduser_idstar_ratingreview_textlongevity_ratingsillage_ratingdate_postedhelpful_votesverified_subscriber
user_reviews
● 200 OK
"review_id": "rv_8849201",
"fragrance_id": "sb_94821",
"star_rating": 5,
"review_text": "Signature scent. Lasts 10+ hours on skin.",
"longevity_rating": "Long Lasting",
"sillage_rating": "Strong"
# review_idfragrance_iduser_idstar_ratingreview_textlongevity_rating
1
2
3

Complete list of extractable fields for Recommendations objects from scentbird.com. All fields typed and schema-versioned.

source_fragrance_idsimilar_fragrance_idsmatching_notesalgorithm_scoreusers_also_likedalternative_brandsprice_tier_matchseason_matchscent_family_match
recommendations
● 200 OK
"source_fragrance_id": "sb_94821",
"similar_fragrance_ids": "['sb_1102', 'sb_4491']",
"algorithm_score": 0.92,
"users_also_liked": "['Maison Margiela Jazz Club', 'Byredo Gypsy Water']",
"alternative_brands": "['Maison Margiela', 'Byredo']",
"scent_family_match": "Woody"
# source_fragrance_idsimilar_fragrance_idsmatching_notesalgorithm_scoreusers_also_likedalternative_brands
1
2
3

Capabilities

Extract the complete fragrance taxonomy

Our Scentbird scraper parses complex scent profiles, brand metadata, and user reviews, handling dynamic React rendering and infinite scroll pagination automatically.

Full Catalogue Extraction

Extract every perfume and cologne listing, including title, brand, description, and high-resolution bottle imagery.

Scent Profile Breakdown

Parse top, middle, and base notes alongside scent family classifications and complexity scores for precise taxonomy mapping.

Brand Portfolio Mapping

Aggregate fragrance counts, average ratings, and historical metadata for every brand listed on the platform.

Review & Rating Mining

Capture user reviews with specific metrics for longevity and sillage, paginated across thousands of entries.

Pricing Tiers

Track subscription eligibility, premium upcharges, and full retail bottle pricing across the catalogue.

Similar Scents Graph

Extract recommendation algorithms and 'users also liked' data to build competitor similarity graphs.

Seasonal & Occasion Tags

Collect metadata on recommended seasons (Fall, Summer) and occasions (Date Night, Office) for each fragrance.

Scheduled Diffs

Run continuous pipelines to track new fragrance additions, rating changes, and review volume velocity.

High-Speed Execution

Optimised Playwright routines handle React hydration quickly, ensuring fast turnaround for complete catalogue sweeps.

// engagement pipeline

From catalogue URL to structured taxonomy

Brief in. Clean data out.

Define Scope
d 0

Specify target brands, scent families, or full catalogue extraction requirements. We map the schema.

Pipeline Build
d 2–4

We configure crawlers to handle Scentbird's SPA architecture, pagination, and anti-bot protections.

Validation & QA
d 4–6

Data is checked for schema compliance, note taxonomy completeness, and review pagination depth.

Delivery
ongoing

Clean JSON, CSV, or Parquet records are pushed to your warehouse on your specified schedule.

Under the hood

Overcoming Scentbird's extraction hurdles

Modern SPAs require sophisticated rendering and proxy strategies. Here is how we maintain reliable pipelines.

pipeline-monitor · scentbird.com · live ● active
// fingerprinting
Identity rotation
TLS fingerprintrandomised
User-agentrotated
IP poolresidential
Challenges blocked0
// pagination
Page coverage
48,291 pages queued running
// observability
Pipeline health
99.9%
uptime
142ms
p99 lat
0.3%
null rate
2
alerts
JavaScript rendering
Handling React hydration

Scentbird relies heavily on client-side rendering. We use Playwright to execute JavaScript, wait for network idle states, and capture data only after scent notes and pricing widgets fully hydrate.

Infinite scroll
Deep pagination logic

User reviews and category pages use infinite scroll rather than standard pagination. Our crawlers simulate human scrolling behaviour to trigger XHR requests, capturing the complete review corpus without missing records.

Anti-bot layer
Residential proxy rotation

To avoid rate limits and IP bans, we route requests through residential proxy pools, rotating IPs and spoofing TLS fingerprints to mimic legitimate consumer traffic.

Schema stability
Resilient DOM selectors

Frontend frameworks generate dynamic class names. We rely on XPath structural patterns and intercepted API responses rather than brittle CSS selectors, ensuring pipelines survive UI updates.

Change detection
Delta extraction

For ongoing monitoring, we hash fragrance records and only deliver diffs, highlighting new reviews, rating shifts, or catalogue additions without redundant data transfer.

Applications

Who uses Scentbird data - and how

Teams across industries use scentbird.com data to build competitive products and smarter operations.

01
Competitor Analysis

Fragrance houses monitor Scentbird curation to benchmark brand visibility, pricing, and consumer ratings against competitors.

02
Trend Forecasting

Market researchers analyse the velocity of specific scent notes (e.g., Oud, Vanilla) to predict upcoming seasonal fragrance trends.

03
AI Scent Recommendation

Machine learning teams use structured top/mid/base note taxonomies and user rating correlations to train predictive scent recommendation engines.

04
Pricing Strategy

Retailers track subscription upcharges versus full retail bottle prices to optimise their own direct-to-consumer pricing models.

05
Consumer Sentiment

Brands mine review text and specific longevity/sillage ratings to understand product performance and reformulate underperforming scents.

06
Market Research

Analysts compare the review volume and rating trajectories of niche indie brands versus established designer houses.

Why DataFlirt

"Scentbird holds the most structured taxonomy of fragrance notes and consumer scent preferences on the web - but querying it requires dedicated extraction infrastructure."

Extracting Scentbird's catalogue demands handling heavy JavaScript payloads, infinite scroll review pagination, and dynamic pricing models. DataFlirt manages the residential proxies and DOM parsing, delivering clean fragrance graphs directly to your warehouse so your team can focus on trend analysis.

Technical Spec

Scentbird scraper - technical capabilities

Everything supported by our scentbird.com scraper — rendered SPA elements, auth walls, rate-limit evasion and beyond.

JavaScript rendering
Playwright execution required for React hydration and dynamic widgets
Supported
Residential proxy rotation
Geographically distributed residential IPs to bypass rate limiting
Supported
Scent note taxonomy mapping
Structured extraction of top, middle, and base note arrays
Supported
Review pagination
Infinite scroll execution to capture full historical review corpora
Supported
Similar scent graphs
Extraction of recommendation arrays and cross-brand mappings
Supported
Change detection (diffs)
Hash-based diffing to emit only new reviews or catalogue updates
Supported
Webhook delivery
HTTP POST delivery for immediate ingestion of new records
Supported
User-specific subscription queues
Extraction of individual user queues requires authenticated session access
Partial
Personalised AI scent recommendations
Account-specific quiz results and tailored algorithm outputs
Partial
Infrastructure

Infrastructure powering the Scentbird pipeline

Open-source tooling on proven cloud infra — no vendor lock-in, full observability.

ScrapyPlaywrightPython 3.12RedisPostgreSQLApache AirflowAWS LambdaS3CloudWatch2CaptchaCapSolverResidential ProxiesDockerKubernetesGrafanaPrometheus
Scrapy + Playwright Stack

Scrapy handles crawl orchestration and deduplication, while Playwright manages JavaScript rendering and infinite scroll interactions required by Scentbird's frontend.

Residential Proxy Infrastructure

We route requests through high-quality residential proxy pools, rotating IPs per request to mimic genuine consumer traffic and bypass bot detection.

Cloud-Native Orchestration

Pipelines are deployed on Kubernetes and AWS Lambda, orchestrated by Apache Airflow for strict scheduling, dependency management, and SLA compliance.

Output & Delivery

Your data, your destination

Data delivered to where your team already works — no new tooling required.

JSON
Nested structures ideal for complex scent note arrays
CSV
Flat tabular data for immediate analyst consumption
XLS
Excel format for business stakeholder review
Parquet
Columnar storage optimised for BigQuery and Snowflake
AWS S3
Direct delivery to your cloud storage buckets
Webhook
Real-time HTTP POST delivery per record
API
Queryable REST endpoints for pipeline status and data retrieval
PostgreSQL
Direct database upserts with schema conflict resolution
BigQuery
Streamed directly into Google Cloud data warehouses
Snowflake
Automated stage and copy routines for Snowflake ingestion
S3
Direct bucket delivery — compatible with any data lake
// faq

Common questions.

About scentbird.com scraping, legality, and pipeline operations.

Ask us directly →
Is scraping Scentbird legal?

Scraping publicly accessible catalogue and review data is generally permissible. DataFlirt extracts only unauthenticated, public information. We do not bypass login walls to extract personal subscriber data or private queues. Clients must consult their legal counsel regarding specific data usage.

How do you handle Scentbird's JavaScript rendering?

We utilise Playwright to execute a headless browser environment, allowing React components to hydrate fully before we extract the DOM or intercept the underlying JSON API responses.

Can you extract all historical reviews for a fragrance?

Yes. Our crawlers handle the infinite scroll pagination logic to load and extract the complete history of reviews, including specific ratings for longevity and sillage.

Do you extract the specific scent notes?

Yes. We capture the structured taxonomy of top, middle, and base notes, along with scent family classifications and recommended seasons.

What is the minimum engagement for a Scentbird pipeline?

We typically scope engagements starting with full catalogue extraction (all brands and fragrances) delivered on a weekly or monthly cadence. Contact us for volume-based pricing.

Can I request a sample dataset?

Yes. We can provide a sample extraction of 50-100 fragrances, including their associated notes and a subset of reviews, to validate schema compliance before contract signature.

$ dataflirt scope --new-project --source=scentbird.com ready

Tell us what
to extract.
We do the rest.

20-minute scoping call. Pilot dataset within the week. Production within two. Whether you need a one-off catalogue dump or continuous tracking of fragrance trends and reviews - we handle the infrastructure. Tell us your requirements.

hello@dataflirt.com · Bengaluru · IST · typical reply < 4h
Related Scrapers

More in beauty and skincare

Services

Data Extraction for Every Industry

View All Services →