SYSTEM all green source wine.com queue 14,921 pages p99 latency 218ms dataflirt.com · scraper/wine-com
RUN - 42 active pipelines - wine.com live

Wine.com data,
at warehouse scale.

We extract wine catalogues, professional scores, tasting notes, winery profiles, and regional appellation data. Delivered as clean JSON, CSV, or Parquet to S3, BigQuery, or Snowflake on your cadence.

Wines extracted
138K /run
Pro ratings
412K /run
Price updates
89K /24h
Active pipelines
42
Uptime
99.98%
Data Dictionary

Every field we extract from wine.com

Structured, schema-consistent data across all major object types — delivered clean, typed, and ready to query.

Complete list of extractable fields for Wine Listings objects from wine.com. All fields typed and schema-versioned.

wine_idnamevintagevarietalregionappellationwinerypricevolume_mlabv_pctrating_avgurl
wine_listings
● 200 OK
"wine_id": "W194827",
"name": "Caymus Napa Valley Cabernet Sauvignon",
"vintage": 2021,
"varietal": "Cabernet Sauvignon",
"region": "California",
"appellation": "Napa Valley",
"price": 89.99,
"abv_pct": 14.5
# wine_idnamevintagevarietalregionappellation
1
2
3

Complete list of extractable fields for Professional Ratings objects from wine.com. All fields typed and schema-versioned.

wine_idreviewerscorereview_textreview_datepublicationdrinking_windowtasting_notes
professional_ratings
● 200 OK
"wine_id": "W194827",
"reviewer": "James Suckling",
"score": 94,
"review_text": "A rich and layered cabernet with dark berries, chocolate and hints of vanilla.",
"publication": "JamesSuckling.com",
"drinking_window": "2024-2035"
# wine_idreviewerscorereview_textreview_datepublication
1
2
3

Complete list of extractable fields for Pricing & Inventory objects from wine.com. All fields typed and schema-versioned.

wine_idbase_pricesale_pricediscount_pctstewardship_pricein_stockstock_limitshipping_surchargestate_pricing
pricing_& inventory
● 200 OK
"wine_id": "W194827",
"base_price": 95.0,
"sale_price": 89.99,
"discount_pct": 5,
"stewardship_price": 89.99,
"in_stock": true,
"stock_limit": 12
# wine_idbase_pricesale_pricediscount_pctstewardship_pricein_stock
1
2
3

Complete list of extractable fields for Winery Details objects from wine.com. All fields typed and schema-versioned.

winery_idwinery_namelocationdescriptionfounded_yearwinemakerwebsitetotal_wines_listed
winery_details
● 200 OK
"winery_id": "WIN482",
"winery_name": "Caymus Vineyards",
"location": "Rutherford, California",
"founded_year": 1972,
"winemaker": "Chuck Wagner",
"total_wines_listed": 18
# winery_idwinery_namelocationdescriptionfounded_yearwinemaker
1
2
3

Complete list of extractable fields for User Reviews objects from wine.com. All fields typed and schema-versioned.

review_idwine_iduser_namestar_ratingreview_titlereview_bodyreview_datehelpful_votes
user_reviews
● 200 OK
"review_id": "REV92817",
"wine_id": "W194827",
"user_name": "CabLover99",
"star_rating": 5,
"review_title": "Consistently excellent",
"review_date": "2023-11-14",
"helpful_votes": 24
# review_idwine_iduser_namestar_ratingreview_titlereview_body
1
2
3

Capabilities

Everything you need from Wine.com - nothing you do not

Our Wine.com scraper handles dynamic search filters, pagination, and regional pricing variations with full JavaScript rendering and proxy rotation built in.

Wine Catalogue Extraction

Extract varietal, vintage, region, ABV, volume, and winery details across the entire catalogue.

Professional Score Aggregation

Capture structured ratings and text from Wine Spectator, Robert Parker, James Suckling, and Wilfred Wong.

Tasting Notes & Profiles

Extract flavour profiles, food pairings, and winemaker notes for detailed product analysis.

Real-Time Price Tracking

Monitor base price, sale price, discounts, and StewardShip membership pricing variations.

Regional Appellation Data

Map country, region, and sub-region hierarchies accurately for every listed bottle.

Winery Intelligence

Extract winemaker details, estate history, and full portfolio listings per producer.

Inventory Monitoring

Track stock status, low stock alerts, and purchase limits timestamped per crawl.

User Review Mining

Extract star ratings, review text, and helpful votes paginated across all user feedback.

State-Specific Pricing

Capture pricing and availability variations based on target delivery state via session cookies.

// engagement pipeline

From wine list to warehouse record

Brief in. Clean data out.

Define Scope
d 0

Provide varietal lists, regions, or URLs. We design the extraction schema together.

Pipeline Build
d 2–4

We configure Scrapy / Playwright crawlers, proxy rotation, and session management for wine.com.

Validation & QA
d 4–6

Schema validation, null-rate checks, and data sampling before full launch.

Delivery
ongoing

JSON / CSV / Parquet pushed to your S3 bucket, BigQuery dataset, or Snowflake stage on agreed cadence.

Under the hood

How our Wine.com pipeline handles the hard parts

Wine.com uses dynamic inventory, state-based pricing, and aggressive bot mitigation. Here is how we maintain data continuity.

pipeline-monitor · wine.com · live ● active
// fingerprinting
Identity rotation
TLS fingerprintrandomised
User-agentrotated
IP poolresidential
Challenges blocked0
// pagination
Page coverage
48,291 pages queued running
// observability
Pipeline health
99.9%
uptime
142ms
p99 lat
0.3%
null rate
2
alerts
State-based routing
Cookie management for state-specific inventory

Wine.com alters pricing and availability based on the shipping destination. Our crawlers manage state-specific session cookies to extract accurate regional pricing matrices.

Dynamic filters
Handling infinite scroll and AJAX filters

The catalogue relies heavily on AJAX-driven filters. We execute full Playwright sessions to trigger lazy-loading and ensure complete extraction of paginated results.

Anti-bot layer
Residential proxy rotation

We utilise residential ISP proxies with realistic browser fingerprints and randomised request timing to bypass aggressive rate limits and IP bans.

Data normalisation
Structuring professional ratings

Professional reviews are often embedded in unstructured text blocks. Our pipeline parses and normalises these into strict schema fields for reviewer, score, and tasting notes.

Change detection
Only re-scrape what has changed

For large catalogues, we maintain a hash index of last-seen values per field. Subsequent runs only push diffs, reducing compute cost and downstream processing load.

Applications

Who uses Wine.com data - and how

Teams across industries use wine.com data to build competitive products and smarter operations.

01
Price Intelligence

Retailers monitor competitor pricing, discount strategies, and shipping thresholds to maintain market parity.

02
Inventory Forecasting

Distributors track stock depletion rates and out-of-stock signals to optimise supply chain operations.

03
Market Research

Analysts identify trending varietals, emerging regions, and consumer preferences based on review velocity.

04
Recommendation Engines

Applications train machine learning models on tasting notes, professional scores, and food pairings.

05
Investment Tracking

Collectors monitor vintage scores and price appreciation across premium appellations.

06
Brand Monitoring

Wineries track retail presence, promotional compliance, and user sentiment across their portfolio.

Why DataFlirt

"Wine.com holds the definitive digital cellar - combining professional scores, tasting notes, and retail pricing in one highly structured dataset."

Extracting data from Wine.com requires managing state-specific cookies, parsing unstructured tasting notes, and bypassing aggressive rate limits. DataFlirt absorbs that complexity so your engineers can focus on analysis, not infrastructure maintenance.

Technical Spec

Wine.com scraper - technical capabilities

Everything supported by our wine.com scraper — rendered SPA elements, auth walls, rate-limit evasion and beyond.

JavaScript rendering
Full Playwright sessions required for dynamic inventory and AJAX filters
Supported
State-specific pricing
Session cookie management for accurate regional pricing extraction
Supported
Professional score extraction
Normalised ratings from Wine Spectator, Robert Parker, and others
Supported
Vintage history tracking
Track price and rating changes across historical vintages
Supported
Change detection (diffs)
Hash-based diff: only emit records with changed fields since last run
Supported
Webhook delivery
HTTP POST per record or batch for real-time processing
Supported
Age-gated checkout flow
Age verification and purchasing flows require manual intervention
Partial
StewardShip account history
Gated user purchase history requires account credentials
Partial
Infrastructure

Infrastructure powering the Wine.com pipeline

Open-source tooling on proven cloud infra — no vendor lock-in, full observability.

ScrapyPlaywrightPython 3.12RedisPostgreSQLApache AirflowAWS LambdaS3CloudWatch2CaptchaCapSolverResidential ProxiesDockerKubernetesGrafanaPrometheus
Scrapy + Playwright Stack

Scrapy handles crawl orchestration, deduplication, and retry logic. Playwright handles JavaScript rendering, cookie sessions, and interaction flows.

Residential Proxy Infrastructure

We maintain pools of residential ISP proxies. Rotation happens per-request with sticky sessions where required for state-specific pricing.

Cloud-Native Orchestration

Pipelines run on AWS Lambda and ECS. Airflow handles scheduling, dependency management, and SLA alerting. All state stored in managed Postgres.

Output & Delivery

Your data, your destination

Data delivered to where your team already works — no new tooling required.

JSON
Newline-delimited or nested - schema versioned per run
CSV
Flat file with typed columns - Excel compatible
XLS
Standard Excel spreadsheet delivery
Parquet
Columnar format for BigQuery, Snowflake, Athena
AWS S3
Direct bucket delivery - compatible with any data lake
Webhook
HTTP POST per record for real-time downstream processing
API
RESTful endpoints for on-demand data access
BigQuery
Streamed directly into your dataset with schema auto-detect
S3
Direct bucket delivery — compatible with any data lake
// faq

Common questions.

About wine.com scraping, legality, and pipeline operations.

Ask us directly →
Is scraping Wine.com legal?

Scraping publicly available information is generally permissible under applicable law. DataFlirt targets only public product, pricing, and review data. We do not extract personal data or circumvent authentication walls.

Can you extract state-specific pricing?

Yes. Our crawlers manage state-specific session cookies to extract accurate regional pricing matrices and inventory availability based on the target shipping destination.

Do you capture professional ratings like Wine Spectator?

Yes. We extract and normalise professional scores, reviewer names, and tasting notes from all listed authorities including Wine Spectator, Robert Parker, and James Suckling.

How do you handle vintage changes?

We track wines at the vintage level. When a new vintage replaces an old one on the same product page, we log it as a distinct record to maintain accurate historical pricing and rating data.

How fresh is the inventory data?

Pipelines can be configured at hourly, daily, or weekly cadences depending on your requirements. Daily refreshes are standard for most inventory monitoring use cases.

Can you extract tasting notes and food pairings?

Yes. We capture all structured and unstructured product metadata, including flavour profiles, winemaker notes, and recommended food pairings.

$ dataflirt scope --new-project --source=wine.com ready

Tell us what
to extract.
We do the rest.

20-minute scoping call. Pilot dataset within the week. Production within two. Whether you need a one-off catalogue dump or a continuous price-monitoring feed across 100K vintages - we scope, build, and operate the pipeline. Tell us what you need.

hello@dataflirt.com · Bengaluru · IST · typical reply < 4h
Related Scrapers

More in food drink and kitchen

Services

Data Extraction for Every Industry

View All Services →