SYSTEM all green source thewhiskyexchange.com queue 12,409 pages p99 latency 218ms dataflirt.com · scraper/thewhiskyexchange-com
RUN · 14 active pipelines · thewhiskyexchange.com live

Spirits data,
at warehouse scale.

We extract product listings, tasting profiles, ABV metrics, vintage data, and pricing from The Whisky Exchange. Delivered as clean JSON, CSV, or Parquet to S3, BigQuery, or Snowflake on your cadence.

Bottles extracted
18.2K /run
Price updates
42.1K /24h
Tasting notes
14.5K /run
Active pipelines
14
Uptime
99.98%
Data Dictionary

Every field we extract from thewhiskyexchange.com

Structured, schema-consistent data across all major object types — delivered clean, typed, and ready to query.

Complete list of extractable fields for Product Listings objects from thewhiskyexchange.com. All fields typed and schema-versioned.

skunamedistilleryregionageabvvolume_clpricestock_statusurl
product_listings
● 200 OK
"sku": "014389",
"name": "Lagavulin 16 Year Old",
"distillery": "Lagavulin",
"region": "Islay",
"age": 16,
"abv": 43.0,
"volume_cl": 70,
"price": 82.95,
"stock_status": "In Stock"
# skunamedistilleryregionageabv
1
2
3

Complete list of extractable fields for Tasting Notes objects from thewhiskyexchange.com. All fields typed and schema-versioned.

skunosepalatefinishcharacter_tagsreviewerscoredate
tasting_notes
● 200 OK
"sku": "014389",
"nose": "Intensely flavoured, peat smoke with iodine and seaweed and a rich, deep sweetness.",
"palate": "Dry peat smoke fills the palate with a gentle but strong sweetness, followed by sea and salt with touches of wood.",
"finish": "A long, elegant peat-filled finish with lots of salt and seaweed.",
"character_tags": "['Peaty', 'Smoky', 'Maritime', 'Rich']",
"reviewer": "The Whisky Exchange",
"score": 92
# skunosepalatefinishcharacter_tagsreviewer
1
2
3

Complete list of extractable fields for Pricing & Stock objects from thewhiskyexchange.com. All fields typed and schema-versioned.

skuprice_gbpprice_ex_vatcurrencytax_statusdelivery_restrictionsin_stockstock_qty
pricing_& stock
● 200 OK
"sku": "014389",
"price_gbp": 82.95,
"price_ex_vat": 69.13,
"currency": "GBP",
"tax_status": "Inc. VAT",
"delivery_restrictions": "['US', 'CA']",
"in_stock": true,
"stock_qty": 142
# skuprice_gbpprice_ex_vatcurrencytax_statusdelivery_restrictions
1
2
3

Complete list of extractable fields for Cask & Vintage objects from thewhiskyexchange.com. All fields typed and schema-versioned.

skuvintage_yearbottling_yearcask_typecask_numbernumber_of_bottlesbottlerseries
cask_& vintage
● 200 OK
"sku": "108492",
"vintage_year": 1990,
"bottling_year": 2021,
"cask_type": "Sherry Butt",
"cask_number": "4812",
"number_of_bottles": 512,
"bottler": "Signatory Vintage",
"series": "Cask Strength Collection"
# skuvintage_yearbottling_yearcask_typecask_numbernumber_of_bottles
1
2
3

Complete list of extractable fields for Reviews & Ratings objects from thewhiskyexchange.com. All fields typed and schema-versioned.

review_idskuauthorratingdatetitlebodyhelpful_votes
reviews_& ratings
● 200 OK
"review_id": "REV-98412",
"sku": "014389",
"author": "PeatLover88",
"rating": 5,
"date": "2023-11-14",
"title": "A classic Islay malt",
"body": "Never disappoints. The benchmark for peated whisky.",
"helpful_votes": 24
# review_idskuauthorratingdatetitle
1
2
3

Capabilities

Everything you need from The Whisky Exchange

Our scraper navigates age gates, extracts complex flavour profiles, maps distillery hierarchies, and tracks inventory for rare investment-grade bottles.

Full Bottle Specifications

Extract ABV, volume, region, distillery, bottler, and age statements across all spirit categories.

Tasting Note Extraction

Parse structured tasting notes separating nose, palate, and finish, alongside character tags and flavour profiles.

Pricing & Tax Data

Capture ex-VAT and inc-VAT pricing, tracking currency conversions and regional tax adjustments.

Old & Rare Tracking

Monitor vintage years, bottling dates, cask numbers, and limited edition bottle counts for investment analysis.

Flavour Profiling

Extract character tags, style categories, and official flavour maps used for recommendation engines.

Stock Monitoring

Track in-stock flags, low stock warnings, and availability changes across high-demand releases.

Review Mining

Scrape star ratings, user tasting notes, and review dates across the entire customer feedback corpus.

Age Gate Bypass

Automated session handling and cookie injection to reliably pass 18+ verification prompts.

Delivery Restrictions

Map shipping constraints and regional delivery blocks per SKU to understand market availability.

// engagement pipeline

From distillery list to warehouse record

Brief in. Clean data out.

Define Scope
d 0

Provide target categories, distilleries, or specific SKUs. We map the extraction schema to your requirements.

Pipeline Build
d 2–4

We configure Scrapy crawlers, handle age-gate cookies, and set up residential proxies for thewhiskyexchange.com.

Validation & QA
d 4–6

Schema validation, price-outlier detection, and tasting note completeness checks before full launch.

Delivery
ongoing

JSON, CSV, or Parquet pushed to your S3 bucket, BigQuery dataset, or Snowflake stage on agreed cadence.

Under the hood

How our TWE pipeline handles the hard parts

Spirits eCommerce requires navigating age gates, regional pricing, and strict bot protection. Here is how we maintain reliable extraction.

pipeline-monitor · thewhiskyexchange.com · live ● active
// fingerprinting
Identity rotation
TLS fingerprintrandomised
User-agentrotated
IP poolresidential
Challenges blocked0
// pagination
Page coverage
48,291 pages queued running
// observability
Pipeline health
99.9%
uptime
142ms
p99 lat
0.3%
null rate
2
alerts
Age verification walls
Automated cookie injection

The Whisky Exchange mandates age verification before displaying catalogue data. Our pipeline automatically handles session initiation and cookie injection to bypass the 18+ gateway without triggering bot flags.

Regional pricing & VAT
Session geolocating

Pricing changes based on user location and VAT status. We configure crawler sessions with specific regional headers and cookies to extract exact ex-VAT or inc-VAT prices based on your target market.

Dynamic stock levels
High-frequency polling

Rare bottles and limited releases sell out in minutes. We support high-frequency polling for specific SKUs to track stock availability and price changes in near real-time.

Complex taxonomy
Mapping regions and distilleries

Spirits categorisation is deeply hierarchical. Our schema maps the exact relationship between parent regions, sub-regions, distilleries, and independent bottlers to maintain data integrity.

Anti-bot systems
Residential proxies and fingerprinting

We utilise UK-based residential proxies and precise browser fingerprinting to navigate rate limits and bot protection, ensuring uninterrupted data flow from the catalogue.

Applications

Who uses spirits data - and how

Teams across industries use thewhiskyexchange.com data to build competitive products and smarter operations.

01
Beverage Market Research

Analysts track emerging trends in cask finishes, age statements, and regional popularity to inform product development.

02
Investment Tracking

Collectors and funds monitor pricing curves and stock depth for old and rare bottles to calculate asset appreciation.

03
Competitor Price Monitoring

Retailers track pricing parity, discount strategies, and shipping constraints to optimise their own merchandising.

04
Flavour AI Models

Machine learning teams use structured tasting notes and character tags to train NLP models for recommendation engines.

05
Inventory Forecasting

Supply chain teams use stock availability signals across major retailers to predict supply shortages for specific distilleries.

06
Brand Monitoring

Distilleries audit their representation, pricing consistency, and customer review sentiment across third-party retail platforms.

Why DataFlirt

"The Whisky Exchange holds the definitive global catalogue of spirits and tasting profiles - but extracting structured flavour data requires a purpose-built pipeline."

Most teams fail at scraping spirits platforms because they trip over age gates, regional tax toggles, and strict bot protection. DataFlirt manages the residential proxies, session cookies, and schema mapping so your engineers can focus on the analysis - not the infrastructure.

Technical Spec

TWE scraper - technical capabilities

Everything supported by our thewhiskyexchange.com scraper — rendered SPA elements, auth walls, rate-limit evasion and beyond.

Age gate bypass
Automated session handling for 18+ verification walls
Supported
Ex-VAT pricing extraction
Capture both inclusive and exclusive tax pricing structures
Supported
Flavour profile mapping
Extraction of character tags and structured tasting notes
Supported
Residential proxy rotation
UK-based ISP proxies to navigate rate limiting
Supported
Change detection
Hash-based diffing to emit only updated prices or stock
Supported
Review pagination
Extraction of all customer reviews across paginated endpoints
Supported
Customer purchase history
Historical order data gated behind user authentication
Partial
Private auction bids
Live bidding data requiring a verified auction account
Partial
Infrastructure

Infrastructure powering the pipeline

Open-source tooling on proven cloud infra — no vendor lock-in, full observability.

ScrapyPlaywrightPython 3.12RedisPostgreSQLApache AirflowAWS LambdaS3CloudWatch2CaptchaCapSolverResidential ProxiesDockerKubernetesGrafanaPrometheus
Scrapy + Playwright Stack

Scrapy handles crawl orchestration, deduplication, and retry logic. Playwright manages JavaScript rendering, age-gate cookies, and interaction flows.

Residential Proxy Infrastructure

We maintain pools of residential ISP proxies. Rotation happens per-request with sticky sessions for consistent regional pricing extraction.

Cloud-Native Orchestration

Pipelines run on AWS Lambda and ECS. Airflow handles scheduling, dependency management, and SLA alerting. All state stored in managed Postgres.

Output & Delivery

Your data, your destination

Data delivered to where your team already works — no new tooling required.

JSON
Newline-delimited or nested - schema versioned per run
CSV
Flat file with typed columns - Excel compatible
XLS
Standard spreadsheet format for business teams
Parquet
Columnar format for BigQuery, Snowflake, Athena
AWS S3
Direct bucket delivery - compatible with any data lake
Webhook
HTTP POST per record for real-time downstream processing
API
REST endpoints to query extracted dataset programmatically
Postgres
Upsert into your existing schema with conflict resolution
S3
Direct bucket delivery — compatible with any data lake
// faq

Common questions.

About thewhiskyexchange.com scraping, legality, and pipeline operations.

Ask us directly →
Is scraping The Whisky Exchange legal?

Scraping publicly available pricing, stock, and product specification data is generally permissible. DataFlirt targets only public, non-authenticated catalogue data. We do not extract personal user data or circumvent authentication walls.

How do you handle the age verification popup?

Our crawlers are configured to automatically inject the required consent cookies at the start of every session, bypassing the 18+ prompt without manual intervention.

Can you extract prices without VAT?

Yes. We configure the crawler sessions to select specific regional delivery settings, allowing us to capture exact ex-VAT pricing alongside standard inc-VAT retail prices.

Do you scrape the Old & Rare section?

Yes. The pipeline covers all categories, including limited editions, vintage releases, and the Old & Rare catalogue, extracting specific cask numbers and bottling dates.

How structured are the tasting notes?

We parse the raw text into structured JSON fields, separating nose, palate, and finish descriptions, and extract categorical character tags for easier database querying.

What is the delivery frequency?

Pipelines can be configured for daily catalogue refreshes, or high-frequency hourly polling for specific high-demand SKUs to track stock availability.

$ dataflirt scope --new-project --source=thewhiskyexchange.com ready

Tell us what
to extract.
We do the rest.

20-minute scoping call. Pilot dataset within the week. Production within two. Whether you need a complete catalogue export or continuous price monitoring across rare vintages - we scope, build, and operate the pipeline. Tell us what you need.

hello@dataflirt.com · Bengaluru · IST · typical reply < 4h
Related Scrapers

More in food drink and kitchen

Services

Data Extraction for Every Industry

View All Services →