SYSTEM all green source whisky.de queue 12,408 pages p99 latency 185ms dataflirt.com · scraper/whisky-de
RUN · 14 active pipelines · whisky.de live

Whisky.de data,
structured for analysis.

We extract bottle catalogues, pricing signals, tasting profiles, and community ratings from Whisky.de. Delivered as clean JSON, CSV, or Parquet to S3, BigQuery, or Snowflake on your cadence.

Bottles extracted
14.2K /run
Price updates
4.8K /24h
Tasting notes
42.1K /run
Forum posts
1.2M /month
Uptime
99.98%
Data Dictionary

Every field we extract from whisky.de

Structured, schema-consistent data across all major object types — delivered clean, typed, and ready to query.

Complete list of extractable fields for Bottle Metadata objects from whisky.de. All fields typed and schema-versioned.

bottle_idnamedistilleryregioncountryagevintagebottling_dateabvvolume_mlcask_typechill_filteredcolouredimage_urlpage_url
bottle_metadata
● 200 OK
"bottle_id": "W-LAGAV16",
"name": "Lagavulin 16 Jahre",
"distillery": "Lagavulin",
"region": "Islay",
"age": 16,
"abv": 43.0,
"cask_type": "Ex-Bourbon & Sherry",
"chill_filtered": true
# bottle_idnamedistilleryregioncountryage
1
2
3

Complete list of extractable fields for Pricing & Stock objects from whisky.de. All fields typed and schema-versioned.

bottle_idcurrent_pricecurrencybase_price_per_literin_stockstock_status_textdelivery_timediscount_pctclub_price_eligiblescraped_at
pricing_& stock
● 200 OK
"bottle_id": "W-LAGAV16",
"current_price": 79.9,
"currency": "EUR",
"base_price_per_liter": 114.14,
"in_stock": true,
"delivery_time": "1-3 days",
"club_price_eligible": true,
"scraped_at": "2026-05-12T09:14:00Z"
# bottle_idcurrent_pricecurrencybase_price_per_literin_stockstock_status_text
1
2
3

Complete list of extractable fields for Tasting Notes objects from whisky.de. All fields typed and schema-versioned.

bottle_idaroma_texttaste_textfinish_textmanufacturer_notescommunity_notesflavour_tagsvideo_tasting_urlreviewer_name
tasting_notes
● 200 OK
"bottle_id": "W-LAGAV16",
"aroma_text": "Intense peat smoke with iodine and seaweed.",
"taste_text": "Rich, deep sweetness with heavy peat and maritime notes.",
"finish_text": "Long, elegant, peat-filled finish.",
"flavour_tags": "['Smoke', 'Peat', 'Sherry', 'Maritime']",
"video_tasting_url": "https://www.youtube.com/watch?v=..."
# bottle_idaroma_texttaste_textfinish_textmanufacturer_notescommunity_notes
1
2
3

Complete list of extractable fields for Community Ratings objects from whisky.de. All fields typed and schema-versioned.

bottle_idaverage_ratingrating_countrating_distributiontop_positive_reviewtop_critical_reviewuser_idreview_dateverified_purchase
community_ratings
● 200 OK
"bottle_id": "W-LAGAV16",
"average_rating": 4.8,
"rating_count": 1245,
"rating_distribution": "{"5": 980, "4": 210, "3": 40, "2": 10, "1": 5}",
"review_date": "2026-04-18",
"verified_purchase": true
# bottle_idaverage_ratingrating_countrating_distributiontop_positive_reviewtop_critical_review
1
2
3

Complete list of extractable fields for Forum Discussions objects from whisky.de. All fields typed and schema-versioned.

thread_idforum_categorythread_titleauthor_usernamepost_datepost_contentview_countreply_countquote_idthread_url
forum_discussions
● 200 OK
"thread_id": "T-89214",
"forum_category": "Neuheiten",
"thread_title": "Ardbeg Committee Release 2026",
"author_username": "PeatLover88",
"post_date": "2026-05-11T14:22:00Z",
"reply_count": 42,
"view_count": 1589
# thread_idforum_categorythread_titleauthor_usernamepost_datepost_content
1
2
3

Capabilities

Everything you need from Whisky.de

Our Whisky.de scraper handles every layer of the platform: bottle catalogues, dynamic pricing, tasting notes, and the community forum. Built with JavaScript rendering and session management.

Bottle Specification Extraction

Distillery, age, ABV, cask types, and chill filtration status scraped at the bottle level with exact metadata mapping.

Real-Time Price Tracking

Monitor EUR pricing, club member discounts, and base price per litre. Timestamped per crawl.

Tasting Note Parsing

Separate aroma, taste, and finish descriptions from manufacturer and community sources.

Stock Availability Monitoring

Track in-stock status and estimated delivery windows for limited allocations.

Flavour Profile Mapping

Extract radar chart equivalents and categorical flavour tags for every listed bottle.

Community Forum Scraping

Extract threads, replies, and user sentiments from the active Whisky.de forum.

Video Metadata Capture

Extract links and metadata for embedded Horst Lüning tasting videos.

Rating & Review Aggregation

Compile average star ratings, review counts, and individual user reviews.

Scheduled Diff Exports

Continuous pipelines at daily cadences emitting only changed records.

// engagement pipeline

From target list to warehouse record

Brief in. Clean data out.

Define Scope
d 0

Provide target distilleries, regions, or forum boards. We design the extraction schema together.

Pipeline Build
d 2–4

We configure Scrapy crawlers, proxy rotation, and session management for whisky.de.

Validation & QA
d 4–6

Schema validation, null-rate checks, and price-outlier detection before full launch.

Delivery
ongoing

JSON / CSV / Parquet pushed to your S3 bucket or BigQuery dataset on agreed cadence.

Under the hood

How our Whisky.de pipeline handles the hard parts

Extracting reliable data from niche retailers requires specific technical approaches. Here is how we maintain data integrity.

pipeline-monitor · whisky.de · live ● active
// fingerprinting
Identity rotation
TLS fingerprintrandomised
User-agentrotated
IP poolresidential
Challenges blocked0
// pagination
Page coverage
48,291 pages queued running
// observability
Pipeline health
99.9%
uptime
142ms
p99 lat
0.3%
null rate
2
alerts
Anti-bot layer
Localised residential proxies

We use German residential proxies to bypass regional blocking and rate limits, ensuring uninterrupted access to pricing and stock data.

Data Normalisation
German Language Parsing

We normalise German terminology like Fassstärke to standard data types, ensuring your downstream analytics receive clean, structured data.

JavaScript rendering
Dynamic Stock Widgets

We use Playwright execution to capture lazy-loaded inventory statuses and club pricing that headless HTTP clients miss entirely.

Change detection
Only re-scrape what has changed

For large catalogues, we maintain a hash index of last-seen values per field. Subsequent runs only push diffs, maintaining a clean changelog for pricing and stock.

Monitoring & alerting
24/7 pipeline health tracking

Every run emits structured logs to our observability stack. We alert on null-rate spikes and schema drift, fixing issues before you notice.

Applications

Who uses Whisky.de data

Teams across industries use whisky.de data to build competitive products and smarter operations.

01
Competitor Price Monitoring

Retailers track Whisky.de pricing to adjust their own margins and promotional strategies.

02
Market Trend Analysis

Identify rising interest in specific cask finishes or distilleries via forum activity and review velocity.

03
Inventory Forecasting

Monitor stock depletion rates on limited releases to estimate allocation sizes across the market.

04
Recommendation Engine Training

Use tasting notes and flavour tags to train ML-based whisky recommendation models.

05
Secondary Market Valuation

Correlate retail availability and forum hype with secondary market auction prices.

06
Brand Sentiment Tracking

Distilleries monitor forum discussions and reviews to gauge reception of new bottlings.

Why DataFlirt

"Whisky.de holds the most comprehensive German language database of whisky specifications, tasting notes, and community sentiment. Extracting it requires dedicated infrastructure."

Most teams underestimate the investment required. Reliable scraping requires German residential proxies, full JavaScript rendering for dynamic pricing, and daily selector maintenance. DataFlirt absorbs that complexity so your engineers can focus on the analysis, not the infrastructure.

Technical Spec

Whisky.de scraper technical capabilities

Everything supported by our whisky.de scraper — rendered SPA elements, auth walls, rate-limit evasion and beyond.

JavaScript rendering
Playwright sessions for dynamic stock and club pricing
Supported
German IP proxies
Localised residential IPs to bypass regional rate limits
Supported
Change detection (diffs)
Hash-based diff: only emit records with changed fields
Supported
Forum thread pagination
Full extraction of multi-page community discussions
Supported
Tasting video URLs
Extraction of embedded YouTube video IDs and metadata
Supported
Flavour tag normalisation
Mapping German flavour descriptors to English equivalents
Supported
Webhook delivery
HTTP POST per record for real-time stock alerts
Supported
Club Member Exclusive Forum
Private forum boards requiring paid Club membership
Partial
User Purchase History
Historical order data gated behind user authentication
Partial
Infrastructure

Infrastructure powering the Whisky.de pipeline

Open-source tooling on proven cloud infra — no vendor lock-in, full observability.

ScrapyPlaywrightPython 3.12RedisPostgreSQLApache AirflowAWS LambdaS3CloudWatch2CaptchaCapSolverResidential ProxiesDockerKubernetesGrafanaPrometheusBigQuerySnowflake
Scrapy + Playwright Stack

Scrapy handles crawl orchestration and deduplication. Playwright handles JavaScript rendering for dynamic pricing widgets.

Localised Proxy Infrastructure

We maintain pools of German residential ISP proxies. Rotation happens per-request to bypass regional rate limiting.

Cloud-Native Orchestration

Pipelines run on AWS Lambda and ECS. Airflow handles scheduling, dependency management, and SLA alerting.

Output & Delivery

Your data, your destination

Data delivered to where your team already works — no new tooling required.

JSON
Newline-delimited or nested schema
CSV
Flat file with typed columns
XLS
Excel compatible format for analysts
Parquet
Columnar format for data warehouses
AWS S3
Direct bucket delivery
Webhook
HTTP POST per record for stock alerts
API
REST endpoint for on-demand queries
BigQuery
Streamed directly into your dataset
S3
Direct bucket delivery — compatible with any data lake
// faq

Common questions.

About whisky.de scraping, legality, and pipeline operations.

Ask us directly →
Is scraping Whisky.de legal?

Scraping publicly available information is generally permissible. DataFlirt targets only public, non-authenticated product, pricing, and review data. We do not extract personal data or circumvent authentication walls.

How do you handle regional blocking?

We use German residential proxies to ensure our requests originate from local IPs, preventing regional rate limits and blocks.

Can you translate the German tasting notes?

We extract raw German text to preserve accuracy. Translation pipelines can be added as a post-processing step if required.

How fast can you detect stock changes for limited releases?

Pipelines can run at sub-60-minute intervals for specific bottle URLs, triggering webhooks immediately upon state changes.

Do you extract forum posts?

Yes, we extract public boards, thread contents, and user metadata to capture community sentiment.

What happens if Whisky.de changes its site layout?

Our selectors use multi-layer fallback chains. We monitor for schema drift and fix breakages within our SLA.

$ dataflirt scope --new-project --source=whisky.de ready

Tell us what
to extract.
We do the rest.

20-minute scoping call. Pilot dataset within the week. Production within two. Whether you need a one-off catalogue dump or continuous stock monitoring across thousands of bottles, we scope, build, and operate the pipeline. Tell us what you need.

hello@dataflirt.com · Bengaluru · IST · typical reply < 4h
Related Scrapers

More in food drink and kitchen

Services

Data Extraction for Every Industry

View All Services →