SYSTEM all green source wine-searcher.com queue 12,948 URLs p99 latency 214ms dataflirt.com · scraper/wine-searcher-com
RUN · 61 active pipelines · wine-searcher.com live

Global wine data,
at warehouse scale.

We extract global merchant inventory, pricing trends, critic scores, and vintage data from Wine-Searcher. Delivered as clean JSON, CSV, or Parquet to S3 or BigQuery on your schedule.

Wines extracted
812K /day
Price updates
3.4M /24h
Merchant records
41K /run
Active pipelines
61
Uptime
99.98%
Data Dictionary

Every field we extract from wine-searcher.com

Structured, schema-consistent data across all major object types — delivered clean, typed, and ready to query.

Complete list of extractable fields for Wine Profiles objects from wine-searcher.com. All fields typed and schema-versioned.

wine_idnameproducerregioncountryappellationgrape_blendwine_typecritic_score_avguser_rating_avg
wine_profiles
● 200 OK
"wine_id": "12345",
"name": "Chateau Margaux",
"producer": "Chateau Margaux",
"region": "Bordeaux",
"country": "France",
"wine_type": "Red",
"critic_score_avg": 96
# wine_idnameproducerregioncountryappellation
1
2
3

Complete list of extractable fields for Pricing & Offers objects from wine-searcher.com. All fields typed and schema-versioned.

offer_idwine_idvintagemerchant_namemerchant_countrymerchant_statepricecurrencybottle_sizein_stocktax_status
pricing_& offers
● 200 OK
"vintage": "2015",
"merchant_name": "Total Wine",
"price": 750.0,
"currency": "USD",
"bottle_size": "750ml",
"in_stock": true,
"tax_status": "ex-tax"
# offer_idwine_idvintagemerchant_namemerchant_countrymerchant_state
1
2
3

Complete list of extractable fields for Critic Scores objects from wine-searcher.com. All fields typed and schema-versioned.

wine_idvintagecritic_namescorereview_datetasting_notesdrinking_windowpublication
critic_scores
● 200 OK
"critic_name": "Robert Parker",
"score": 98,
"review_date": "2018-04-15",
"tasting_notes": "Full bodied and rich...",
"drinking_window": "2025-2050",
"publication": "Wine Advocate"
# wine_idvintagecritic_namescorereview_datetasting_notes
1
2
3

Complete list of extractable fields for Market Data objects from wine-searcher.com. All fields typed and schema-versioned.

wine_idsearch_ranksearch_rank_changeaverage_priceprice_change_1yrprice_change_5yravailability_trenddemand_percentile
market_data
● 200 OK
"search_rank": 12,
"average_price": 820.5,
"price_change_1yr": 5.4,
"price_change_5yr": 22.1,
"availability_trend": "stable",
"demand_percentile": 99
# wine_idsearch_ranksearch_rank_changeaverage_priceprice_change_1yrprice_change_5yr
1
2
3

Complete list of extractable fields for Merchant Profiles objects from wine-searcher.com. All fields typed and schema-versioned.

merchant_idmerchant_namewebsite_urlcontact_emailcontact_phoneaddresscountrytotal_wines_listedmerchant_ratingshipping_policy
merchant_profiles
● 200 OK
"merchant_name": "Berry Bros & Rudd",
"country": "UK",
"total_wines_listed": 4521,
"merchant_rating": 4.8,
"website_url": "bbr.com",
"shipping_policy": "Global shipping available"
# merchant_idmerchant_namewebsite_urlcontact_emailcontact_phoneaddress
1
2
3

Capabilities

Complete wine market visibility

Our Wine-Searcher scraper navigates complex regional IP rules, tax state variations, and pagination limits to deliver normalised pricing and inventory data across global merchants.

Global Merchant Aggregation

Extract inventory and pricing across tens of thousands of merchants globally, capturing local market variations.

Historical Price Tracking

Monitor pricing trends over time across different vintages and bottle formats to identify market movements.

Critic Score Extraction

Capture ratings from Jancis Robinson, Robert Parker, Wine Spectator, and other major critics linked directly to specific vintages.

Vintage Specific Data

Isolate pricing and scores by specific vintage years, including NV tracking for Champagne and fortified wines.

Tax Normalisation

Standardise prices across in-bond, ex-tax, and duty-paid listings for accurate cross-border comparison.

Currency Conversion Tracking

Monitor local currency listings and map them against historical exchange rates for financial modelling.

Market Demand Metrics

Extract search rank and popularity trends to gauge secondary market liquidity and consumer interest.

Appellation Mapping

Map wines to correct AOC, DOC, or AVA regions and extract their primary grape blend compositions.

Spirits & Beer Coverage

Extract data for whisky, bourbon, rum, and craft beer listings alongside the fine wine catalogue.

// engagement pipeline

From target list to warehouse record

Brief in. Clean data out.

Define Scope
d 0

Provide target producers, regions, or merchant lists. We design the extraction schema together.

Pipeline Build
d 2–4

We configure Playwright crawlers, CAPTCHA solvers, and proxy rotation specifically for wine-searcher.com.

Validation & QA
d 4–6

Schema validation, outlier detection on pricing, and null-rate checks before full launch.

Delivery
ongoing

JSON, CSV, or Parquet pushed to your S3 bucket or data warehouse on your defined cadence.

Under the hood

How our pipeline handles the hard parts

Extracting wine data requires navigating strict regional limits and unstandardised merchant formats. Here is how we maintain data integrity.

pipeline-monitor · wine-searcher.com · live ● active
// fingerprinting
Identity rotation
TLS fingerprintrandomised
User-agentrotated
IP poolresidential
Challenges blocked0
// pagination
Page coverage
48,291 pages queued running
// observability
Pipeline health
99.9%
uptime
142ms
p99 lat
0.3%
null rate
2
alerts
Anti-bot layer
Residential proxy rotation and fingerprint spoofing

Wine-Searcher employs strict rate limiting and Cloudflare bot protection. We use residential ISP proxies with realistic browser fingerprints and randomised request timing to maintain high extraction throughput.

Geographic pricing
Region-specific proxy targeting

Wine pricing and availability change based on the user IP location. We route requests through region-specific proxies to capture localised merchant offers and tax regulations accurately.

Format standardisation
Structured volume and tax mapping

Merchants list prices in different currencies, bottle sizes, and tax states. Our pipeline normalises these fields into a unified schema for direct comparison across borders.

Pagination limits
Search parameter matrixing

Results per search query are capped. We mathematically matrix search parameters across regions, vintages, and price bands to extract the full long-tail catalogue without hitting pagination limits.

Change detection
Only re-scrape what has changed

For large catalogues, we maintain a hash index of last-seen values per field. Subsequent runs only push diffs, reducing compute cost and downstream processing load.

Applications

Who uses wine market data

Teams across industries use wine-searcher.com data to build competitive products and smarter operations.

01
Fine Wine Investment

Funds and collectors track market prices, liquidity metrics, and critic scores to identify undervalued vintages.

02
Merchant Intelligence

Retailers monitor competitor pricing, stock availability, and shipping policies to adjust their own inventory strategies.

03
Hospitality Procurement

Restaurant groups track wholesale and retail pricing trends to optimise their wine list margins.

04
Brand Protection

Producers monitor global retail channels to ensure grey-market stock is not undercutting official distributors.

05
Market Research

Analysts track search ranks and demand percentiles to forecast emerging regions and varietals.

06
Insurance & Valuation

Insurers use aggregated historical pricing data to accurately value private cellars and commercial inventories.

Why DataFlirt

"Wine-Searcher holds the definitive dataset for global wine pricing, but extracting normalised, cross-currency merchant data requires serious infrastructure."

Most teams underestimate the complexity of scraping wine data: strict rate limits, regional IP variations, unstandardised merchant listings, and complex tax states. DataFlirt handles the proxy rotation and schema normalisation so your analysts can focus on market trends, not broken web scrapers.

Technical Spec

Wine-Searcher scraper technical capabilities

Everything supported by our wine-searcher.com scraper — rendered SPA elements, auth walls, rate-limit evasion and beyond.

JavaScript rendering
Full Playwright sessions required for dynamic pricing tables
Supported
CAPTCHA bypass
Automated Cloudflare Turnstile circumvention via CapSolver
Supported
Residential proxy rotation
ISP-grade IPs from US / UK / HK / FR pools
Supported
Tax state normalisation
Separation of ex-tax, duty-paid, and in-bond pricing
Supported
Volume standardisation
Conversion of diverse bottle formats to standard 750ml equivalents
Supported
Historical price charts
Extraction of time-series data from market trend graphs
Supported
Change detection (diffs)
Hash-based diff to emit only changed records since last run
Supported
Webhook delivery
HTTP POST per record for real-time alerts
Supported
Wine-Searcher PRO data
Access to PRO-exclusive merchant listings and historical data requiring a paid subscription
Partial
Merchant Dashboard analytics
Internal click-through rates and impression data for specific merchants
Partial
Infrastructure

Infrastructure powering the pipeline

Open-source tooling on proven cloud infra — no vendor lock-in, full observability.

ScrapyPlaywrightPython 3.12RedisPostgreSQLApache AirflowAWS LambdaS3CloudWatch2CaptchaCapSolverResidential ProxiesDockerKubernetesGrafanaPrometheus
Scrapy + Playwright Stack

Scrapy handles crawl orchestration and deduplication. Playwright handles JavaScript rendering and Cloudflare challenge execution.

Geographic Proxy Infrastructure

We maintain pools of residential ISP proxies across key wine markets. Rotation happens per-request to capture localised pricing.

Cloud-Native Orchestration

Pipelines run on AWS Lambda and ECS. Airflow handles scheduling, dependency management, and SLA alerting. State stored in managed Postgres.

Output & Delivery

Your data, your destination

Data delivered to where your team already works — no new tooling required.

JSON
Newline-delimited or nested schema versioned per run
CSV
Flat file with typed columns for immediate analysis
XLS
Excel-compatible exports for analyst teams
Parquet
Columnar format for data warehouses
AWS S3
Direct bucket delivery compatible with any data lake
Webhook
HTTP POST per record for real-time downstream processing
API
REST endpoints for querying latest extraction state
BigQuery
Streamed directly into your dataset
S3
Direct bucket delivery — compatible with any data lake
// faq

Common questions.

About wine-searcher.com scraping, legality, and pipeline operations.

Ask us directly →
Is scraping Wine-Searcher legal?

Scraping publicly available information is generally permissible under applicable law. DataFlirt targets only public, non-authenticated wine pricing and merchant data. We do not extract personal data or circumvent authentication walls. Clients should review terms of service and consult legal counsel for specific use cases.

How do you handle regional pricing differences?

We route our extraction requests through region-specific residential proxies. This ensures we capture the exact pricing, tax status, and availability that a local buyer would see in that specific market.

Can you extract historical price trends?

Yes. We extract historical time-series data from the public market trend charts available on wine profile pages, allowing you to track appreciation over 1-year and 5-year horizons.

How fresh is the inventory data?

Pipelines can be configured to run daily, weekly, or monthly. For highly liquid investment-grade wines, we can configure sub-daily tracking on specific merchant URLs.

Do you normalise bottle sizes and tax states?

Yes. Our pipeline standardises varying bottle formats into standard 750ml equivalents where requested, and clearly separates in-bond, ex-tax, and duty-paid pricing into distinct schema fields.

Can I request a sample dataset?

Absolutely. We provide a sample run of specific producers or regions during the scoping process so you can validate schema fit and data quality before committing to a production pipeline.

$ dataflirt scope --new-project --source=wine-searcher.com ready

Tell us what
to extract.
We do the rest.

20-minute scoping call. Pilot dataset within the week. Production within two. Whether you need a daily feed of top Bordeaux pricing or a full catalogue extraction of global merchants, we scope, build, and operate the pipeline. Tell us what you need.

hello@dataflirt.com · Bengaluru · IST · typical reply < 4h
Related Scrapers

More in food drink and kitchen

Services

Data Extraction for Every Industry

View All Services →