SYSTEM all green source diffordsguide.com queue 8,142 pages p99 latency 184ms dataflirt.com · scraper/diffordsguide-com
RUN · 42 active pipelines · diffordsguide.com live

Diffordsguide data,
at warehouse scale.

We extract cocktail recipes, ingredient specifications, spirit ratings, tasting notes, and bar reviews from Diffordsguide. Delivered as clean JSON, CSV, or Parquet to S3, BigQuery, or Snowflake on your cadence.

Recipes extracted
5,612 /run
Spirits indexed
14,291 /run
Ingredients mapped
3,405 /run
Active pipelines
42
Uptime
99.98%
Data Dictionary

Every field we extract from diffordsguide.com

Structured, schema-consistent data across all major object types — delivered clean, typed, and ready to query.

Complete list of extractable fields for Cocktail Recipes objects from diffordsguide.com. All fields typed and schema-versioned.

recipe_urlcocktail_namediffords_ratingglass_typegarnish_instructionsmethod_instructionsingredients_listnutritional_caloriesestimated_abvcreator_name
cocktail_recipes
● 200 OK
"cocktail_name": "Margarita (Difford's Recipe)",
"diffords_rating": 5.0,
"glass_type": "Coupe",
"estimated_abv": 24.5,
"nutritional_calories": 165,
"creator_name": "Simon Difford"
# recipe_urlcocktail_namediffords_ratingglass_typegarnish_instructionsmethod_instructions
1
2
3

Complete list of extractable fields for Ingredient Matrices objects from diffordsguide.com. All fields typed and schema-versioned.

ingredient_namemeasure_mlmeasure_ozmeasure_shotsingredient_categoryis_optionalbrand_recommendationsubstitute_options
ingredient_matrices
● 200 OK
"ingredient_name": "Blanco Tequila",
"measure_ml": 45.0,
"measure_oz": 1.5,
"ingredient_category": "Spirits",
"is_optional": false,
"brand_recommendation": "Patron Silver"
# ingredient_namemeasure_mlmeasure_ozmeasure_shotsingredient_categoryis_optional
1
2
3

Complete list of extractable fields for Spirit Reviews objects from diffordsguide.com. All fields typed and schema-versioned.

spirit_namecategorysub_categorydiffords_scoreproducer_nameabv_percentagetasting_aromatasting_tastetasting_aftertastereview_date
spirit_reviews
● 200 OK
"spirit_name": "Campari Bitter",
"category": "Liqueurs",
"diffords_score": "5+/5",
"abv_percentage": 25.0,
"tasting_aroma": "Intense orange zest and quinine",
"producer_name": "Campari Group"
# spirit_namecategorysub_categorydiffords_scoreproducer_nameabv_percentage
1
2
3

Complete list of extractable fields for Bar Directory objects from diffordsguide.com. All fields typed and schema-versioned.

bar_namecitycountryaddressdiffords_ratingreview_textopening_hourswebsite_urlphone_numberbar_features
bar_directory
● 200 OK
"bar_name": "The Connaught Bar",
"city": "London",
"country": "UK",
"diffords_rating": 5.0,
"phone_number": "+44 20 7499 7070",
"bar_features": "['Hotel Bar', 'Cocktails', 'Luxury']"
# bar_namecitycountryaddressdiffords_ratingreview_text
1
2
3

Complete list of extractable fields for Articles & Features objects from diffordsguide.com. All fields typed and schema-versioned.

article_urltitleauthorpublish_datecategorytagsbody_texthero_image_urlrelated_spirits
articles_& features
● 200 OK
"title": "A Guide to Vermouth",
"author": "Simon Difford",
"publish_date": "2023-04-12",
"category": "Education",
"tags": "['Vermouth', 'Aperitif', 'Wine']",
"hero_image_url": "https://example.com/vermouth.jpg"
# article_urltitleauthorpublish_datecategorytags
1
2
3

Capabilities

Extract the taxonomy of modern mixology

Our Diffordsguide scraper handles the complexities of beverage data: age-gate circumvention, nested ingredient matrices, measurement normalisation, and relational mapping between spirits and recipes.

Full Recipe Extraction

Extract cocktail names, ratings, glass types, garnishes, and step-by-step methods mapped directly to ingredient lists.

Measurement Normalisation

Capture and standardise ingredient measures across ml, oz, and shots for exact volumetric calculations.

Spirit Rating Mining

Extract the authoritative Difford's score out of 5, alongside category classifications and producer intelligence.

Tasting Note Parsing

Separate tasting notes into structured aroma, taste, and aftertaste fields for NLP analysis and sentiment tracking.

Bar Directory Scraping

Compile global bar intelligence including locations, reviews, opening hours, and contact details.

Age-Gate Circumvention

Automated session management to pass 18+ verification checks without triggering bot detection.

Nutritional Data Capture

Extract estimated calories and ABV percentages calculated per cocktail recipe.

Category Traversal

Deep crawl across all spirit sub-categories, from obscure amaros to mainstream gins.

Scheduled + Streaming Modes

Run one-off bulk exports or configure continuous pipelines to track new recipes and spirit reviews.

// engagement pipeline

From ingredient list to warehouse record

Brief in. Clean data out.

Define Scope
d 0

Provide target categories, spirit lists, or bar locations. We design the extraction schema together.

Pipeline Build
d 2–4

We configure Scrapy / Playwright crawlers, proxy rotation, session management, and age-gate handling.

Validation & QA
d 4–6

Schema validation, null-rate checks, measurement standardisation, and sample records before full launch.

Delivery
ongoing

JSON / CSV / Parquet pushed to your S3 bucket, BigQuery dataset, or Snowflake stage on agreed cadence.

Under the hood

How our Diffordsguide pipeline handles the hard parts

Extracting beverage data requires structured parsing of unstructured text. Here is how we ensure data quality.

pipeline-monitor · diffordsguide.com · live ● active
// fingerprinting
Identity rotation
TLS fingerprintrandomised
User-agentrotated
IP poolresidential
Challenges blocked0
// pagination
Page coverage
48,291 pages queued running
// observability
Pipeline health
99.9%
uptime
142ms
p99 lat
0.3%
null rate
2
alerts
Access management
Automated age-gate clearance

Alcohol-related sites require age verification. Our crawlers manage cookie sessions and automated interactions to clear age gates persistently without triggering rate limits.

Data structuring
Measurement normalisation

Cocktail recipes use mixed metrics (ml, oz, dashes, drops). We parse these strings into structured numeric arrays, standardising output to your preferred volumetric unit.

Entity resolution
Ingredient-to-spirit mapping

Recipes often list generic ingredients (e.g., 'London Dry Gin') alongside specific brand recommendations. We extract both, maintaining relational integrity between the recipe and the spirit database.

Schema stability
Resilient selectors

We use multiple fallback chains per field so minor layout changes in tasting notes or recipe grids do not break your data pipeline overnight.

Monitoring & alerting
24/7 pipeline health

Every run emits structured logs. We alert on null-rate spikes, missing measurements, and coverage drops, responding before you notice.

Applications

Who uses Diffordsguide data and how

Teams across industries use diffordsguide.com data to build competitive products and smarter operations.

01
Beverage Brand Intelligence

Spirit brands track their Difford's scores, tasting notes, and competitor positioning across specific liquor categories.

02
Menu Development & Costing

Hospitality groups ingest recipe matrices to calculate pour costs, standardise menus, and optimise inventory.

03
Inventory & Distribution

Distributors map trending ingredients in top-rated cocktails to forecast demand for obscure spirits and liqueurs.

04
Market Research

Analysts track the emergence of new cocktail categories and spirit ratings to identify consumer trend shifts.

05
AI Training Data

ML teams use the structured recipe corpus to train generative models for mixology and flavour pairing.

06
Competitor Analysis

Beverage consultants track bar directory ratings and features to benchmark hospitality standards globally.

Why DataFlirt

"Diffordsguide holds the definitive taxonomy of modern mixology and spirits, but extracting nested ingredient matrices requires purpose-built infrastructure."

Most teams underestimate the investment required: reliable Diffordsguide scraping requires age-gate circumvention, complex measurement parsing, and relational mapping between spirits and recipes. DataFlirt absorbs that complexity so your engineers can focus on the analysis.

Technical Spec

Diffordsguide scraper technical capabilities

Everything supported by our diffordsguide.com scraper — rendered SPA elements, auth walls, rate-limit evasion and beyond.

Age-gate bypass
Automated cookie injection and interaction to clear 18+ verification walls
Supported
Measurement normalisation
Parse mixed volumetric strings (oz, ml, dashes) into structured numeric fields
Supported
Ingredient-to-spirit mapping
Maintain relational links between generic recipe ingredients and specific brand reviews
Supported
Full tasting note extraction
Split tasting notes into distinct aroma, taste, and aftertaste datapoints
Supported
Bar directory pagination
Crawl across all geographic regions to compile complete venue lists
Supported
Change detection (diffs)
Only emit records with changed fields since last run
Supported
Webhook delivery
HTTP POST per record or batch for downstream processing
Supported
JavaScript rendering
Full Playwright sessions for dynamic content loading
Supported
User cabinet/inventory data
Gated data tied to individual user accounts is not extracted
Partial
Private cocktail book collections
Custom recipe collections saved by users require authentication
Partial
Infrastructure

Infrastructure powering the Diffordsguide pipeline

Open-source tooling on proven cloud infra — no vendor lock-in, full observability.

ScrapyPlaywrightPython 3.12RedisPostgreSQLApache AirflowAWS LambdaS3CloudWatch2CaptchaCapSolverResidential ProxiesDockerKubernetesGrafanaPrometheus
Scrapy + Playwright Stack

Scrapy handles crawl orchestration and retry logic. Playwright handles JavaScript rendering, cookie sessions, and age-gate interaction flows.

Residential Proxy Infrastructure

We maintain pools of residential ISP proxies. Rotation happens per-request with sticky sessions to maintain age-gate clearance.

Cloud-Native Orchestration

Pipelines run on AWS Lambda and ECS. Airflow handles scheduling, dependency management, and SLA alerting.

Output & Delivery

Your data, your destination

Data delivered to where your team already works — no new tooling required.

JSON
Newline-delimited or nested schema
CSV
Flat file with typed columns
XLS
Excel compatible format for analysts
Parquet
Columnar format for data warehouses
AWS S3
Direct bucket delivery
Webhook
HTTP POST per record
API
REST endpoints for data retrieval
BigQuery
Streamed directly into your dataset
Snowflake
Stage and COPY INTO workflow
Postgres
Upsert into your existing schema
S3
Direct bucket delivery — compatible with any data lake
// faq

Common questions.

About diffordsguide.com scraping, legality, and pipeline operations.

Ask us directly →
Is scraping Diffordsguide legal?

Scraping publicly available information is generally permissible. DataFlirt targets only public, non-authenticated recipe, spirit, and bar data. We do not extract personal user data or circumvent authentication walls.

How do you handle the age gate?

We automate the cookie acceptance and age verification interaction using Playwright, maintaining sticky sessions to prevent repeated prompts and rate limiting.

How fresh is the data?

Full catalogue refreshes at weekly or monthly cadences complete within a 6-12 hour window. Delta updates for new recipes can be scheduled daily.

How do you handle complex measurements in recipes?

We deploy custom parsing logic to translate mixed strings (e.g., '1 1/2 oz', '2 dashes') into clean numeric values mapped to standard units (ml or oz) for accurate database querying.

Can you extract the Difford's score for spirits?

Yes. We extract the exact rating out of 5, including modifiers like '5+', alongside the full text of the tasting notes broken down by aroma, taste, and aftertaste.

What is the minimum viable engagement?

Our smallest packages start at a defined category extraction (e.g., all gin reviews or all classic cocktails) with weekly delivery. Contact us with your use case for a scoped quote.

$ dataflirt scope --new-project --source=diffordsguide.com ready

Tell us what
to extract.
We do the rest.

20-minute scoping call. Pilot dataset within the week. Production within two. Whether you need a complete cocktail recipe database or continuous spirit rating updates, we scope, build, and operate the pipeline. Tell us what you need.

hello@dataflirt.com · Bengaluru · IST · typical reply < 4h
Related Scrapers

More in food drink and kitchen

Services

Data Extraction for Every Industry

View All Services →