SYSTEM all green source heb.com queue 12,904 pages p99 latency 185ms dataflirt.com · scraper/heb-com
RUN · 41 active pipelines · heb.com live

H-E-B grocery data,
at warehouse scale.

We extract grocery listings, store-specific pricing, stock depth, and promotional data from H-E-B. Delivered as clean JSON, CSV, or Parquet to your infrastructure.

Products extracted
184K /day
Price updates
892K /24h
Store locations
432 /run
Active pipelines
41
Uptime
99.98%
Data Dictionary

Every field we extract from heb.com

Structured, schema-consistent data across all major object types — delivered clean, typed, and ready to query.

Complete list of extractable fields for Product Listings objects from heb.com. All fields typed and schema-versioned.

skuupctitlebrandcategorysub_categorypriceunit_priceuomweightdescriptioningredientsnutrition_factsimage_urlheb_own_brand
product_listings
● 200 OK
"sku": "1234567",
"title": "H-E-B Meal Simple Brisket Queso",
"brand": "H-E-B",
"price": 8.48,
"category": "Deli & Prepared Food",
"uom": "16 oz",
"heb_own_brand": true
# skuupctitlebrandcategorysub_category
1
2
3

Complete list of extractable fields for Pricing & Promotions objects from heb.com. All fields typed and schema-versioned.

skustore_idregular_pricesale_pricecurbside_markupcombo_loco_eligibledigital_coupon_availablecoupon_detailsprice_timestamp
pricing_& promotions
● 200 OK
"sku": "1234567",
"store_id": "142",
"regular_price": 8.48,
"combo_loco_eligible": true,
"digital_coupon_available": false,
"curbside_markup": 0.25,
"price_timestamp": "2023-10-24T14:32:00Z"
# skustore_idregular_pricesale_pricecurbside_markupcombo_loco_eligible
1
2
3

Complete list of extractable fields for Store Locations objects from heb.com. All fields typed and schema-versioned.

store_idstore_nameaddresscityzip_codelatitudelongitudehas_curbsidehas_pharmacyinventory_statusaisle_location
store_locations
● 200 OK
"store_id": "142",
"store_name": "Austin 26",
"city": "Austin",
"has_curbside": true,
"inventory_status": "IN_STOCK",
"aisle_location": "Aisle 4"
# store_idstore_nameaddresscityzip_codelatitude
1
2
3

Complete list of extractable fields for Nutritional Data objects from heb.com. All fields typed and schema-versioned.

skucaloriestotal_fatsodiumtotal_carbohydrateproteindietary_tagsallergensingredients_list
nutritional_data
● 200 OK
"sku": "1234567",
"calories": 240,
"total_fat": "18g",
"protein": "12g",
"dietary_tags": "['Gluten Free', 'Keto Friendly']",
"allergens": "['Milk', 'Soy']"
# skucaloriestotal_fatsodiumtotal_carbohydrateprotein
1
2
3

Complete list of extractable fields for Weekly Ads objects from heb.com. All fields typed and schema-versioned.

ad_idstore_idstart_dateend_datepromotion_typeoffer_textapplicable_skusflyer_image_urlterms
weekly_ads
● 200 OK
"ad_id": "WKA-492",
"store_id": "142",
"promotion_type": "Meal Deal",
"offer_text": "Buy 1 H-E-B Brisket, Get 4 Items Free",
"start_date": "2023-10-25",
"end_date": "2023-10-31"
# ad_idstore_idstart_dateend_datepromotion_typeoffer_text
1
2
3

Capabilities

Everything you need from H-E-B - nothing you don't

Our H-E-B scraper handles the complexities of regional grocery data: store-specific sessions, GraphQL interception, Combo Loco parsing, and nutritional fact extraction.

Full Grocery Catalogue Extraction

Title, brand, UPC, pricing, images, and category taxonomy across all H-E-B departments.

Store-Level Price Tracking

Capture hyper-local pricing variations across 400+ locations, including curbside vs in-store differentials.

Combo Locos & Meal Deals

Track complex promotional mechanics, including Buy-One-Get-X and bundled meal deals specific to Texas regions.

Digital Coupon Monitoring

Extract clip-to-card digital coupons, discount values, and expiration dates mapped to specific SKUs.

Nutritional & Allergen Data

Parse structured nutrition facts panels, ingredient lists, and dietary flags like Gluten-Free or Keto-Friendly.

Inventory & Stock Depth

Monitor out-of-stock flags and inventory availability at the individual store level.

H-E-B Own-Brand Intelligence

Isolate and track H-E-B private label products against national brand equivalents.

Weekly Ad Flyer Parsing

Digitise weekly circulars into structured promotional datasets mapped to active store IDs.

Aisle Location Mapping

Extract exact in-store aisle and shelf locations for planogram analysis and instacart competitor tracking.

Scheduled + Streaming Modes

Run one-off bulk exports or configure continuous pipelines at hourly or daily cadences.

// engagement pipeline

From UPC list to warehouse record

Brief in. Clean data out.

Define Scope
d 0

Provide target categories, store IDs, or UPC lists. We design the extraction schema together.

Pipeline Build
d 2–4

We configure Scrapy crawlers, intercept GraphQL endpoints, and handle zip-code session management.

Validation & QA
d 4–6

Schema validation, null-rate checks, and price-outlier detection before full launch.

Delivery
ongoing

JSON / CSV / Parquet pushed to your S3 bucket, BigQuery dataset, or Snowflake stage on agreed cadence.

Under the hood

How our H-E-B pipeline handles the hard parts

Grocery extraction requires strict session management. Here is how we maintain stable pipelines across hundreds of regional store IDs.

pipeline-monitor · heb.com · live ● active
// fingerprinting
Identity rotation
TLS fingerprintrandomised
User-agentrotated
IP poolresidential
Challenges blocked0
// pagination
Page coverage
48,291 pages queued running
// observability
Pipeline health
99.9%
uptime
142ms
p99 lat
0.3%
null rate
2
alerts
Session management
Store-specific zip code routing

H-E-B pricing and inventory are strictly tied to local store sessions. Our infrastructure maintains persistent cookie jars mapped to specific store IDs and Texas zip codes, ensuring we extract the exact local price rather than generic regional fallbacks.

API interception
GraphQL and hidden endpoints

Modern grocery frontends rely heavily on GraphQL and undocumented internal APIs. We bypass the heavy React DOM entirely where possible, intercepting raw JSON payloads for faster, more reliable data extraction with lower compute overhead.

Anti-bot layer
Datacenter and ISP proxy rotation

Grocery sites aggressively rate-limit high-volume catalog scraping. We distribute requests across targeted US proxy pools, managing request concurrency and header rotation to avoid WAF blocks and 403 responses.

Complex promotions
Normalising Combo Locos

H-E-B's promotional logic is notoriously complex, involving multi-item dependencies. Our parsers flatten these into structured, queryable relational records, mapping every free item back to the parent purchase requirement.

Schema stability
Handling taxonomy drift

Grocery categories shift constantly. We maintain rigid schema validation, alerting on structural changes to the department tree or missing nutritional panels, ensuring downstream ingestion never fails.

Applications

Who uses H-E-B data - and how

Teams across industries use heb.com data to build competitive products and smarter operations.

01
Grocery Price Intelligence

Regional competitors monitor H-E-B's localized pricing strategies, tracking base price changes and curbside markups across Texas.

02
CPG Brand Monitoring

FMCG brands audit digital shelf placement, share of search, and out-of-stock rates for their products against H-E-B private labels.

03
Promotional Analysis

Retail analysts track the frequency, depth, and mechanics of Combo Locos and digital coupons to model promotional spend.

04
Nutritional Database Building

Health and wellness applications ingest structured ingredient and macronutrient data to power dietary recommendation engines.

05
Delivery & Quick-Commerce

Third-party delivery aggregators synchronise local store inventory and pricing to maintain accurate catalogues for their own users.

06
Inflation Tracking

Economic researchers build hyper-local CPI models by tracking basket price variance across different Texas zip codes over time.

Why DataFlirt

"H-E-B's hyper-local pricing and complex promotional mechanics make it a goldmine for regional retail intelligence - provided you can untangle the store-level session routing."

Extracting grocery data requires more than simple HTTP GET requests. You must manage persistent sessions tied to specific store IDs, parse undocumented GraphQL endpoints, and normalise complex promotional rules like Combo Locos. DataFlirt handles this session state and proxy routing, delivering clean, structured grocery data directly to your warehouse.

Technical Spec

H-E-B scraper - technical capabilities

Everything supported by our heb.com scraper — rendered SPA elements, auth walls, rate-limit evasion and beyond.

Store-level pricing
Prices mapped to specific physical store IDs
Supported
GraphQL interception
Direct extraction from backend API payloads
Supported
Combo Loco parsing
Flattened relational mapping of multi-item promotions
Supported
Nutritional facts extraction
Structured macro and micro nutrient parsing
Supported
Curbside vs In-store pricing
Differential price capture where available
Supported
US proxy rotation
Targeted US-based IP pools to bypass geo-fencing
Supported
Change detection (diffs)
Hash-based diff: only emit records with changed fields
Supported
Webhook delivery
HTTP POST per record or batch for real-time updates
Supported
Personalised digital coupons
Account-specific targeted offers requiring user login
Partial
Past purchase history
Historical order data gated behind customer authentication
Partial
Infrastructure

Infrastructure powering the H-E-B pipeline

Open-source tooling on proven cloud infra — no vendor lock-in, full observability.

ScrapyPlaywrightPython 3.12RedisPostgreSQLApache AirflowAWS LambdaS3CloudWatch2CaptchaCapSolverResidential ProxiesDockerKubernetesGrafanaPrometheusGraphQLDatadog
Stateful Session Management

We maintain persistent cookie jars mapped to specific H-E-B store IDs and zip codes, ensuring accurate local pricing and inventory extraction without session leakage.

GraphQL API Interception

Our crawlers bypass the heavy React frontend by targeting undocumented GraphQL endpoints directly, reducing latency and compute costs while extracting cleaner JSON structures.

Cloud-Native Orchestration

Pipelines run on AWS Lambda and ECS. Airflow handles scheduling, dependency management, and SLA alerting. All state stored in managed Postgres.

Output & Delivery

Your data, your destination

Data delivered to where your team already works — no new tooling required.

JSON
Newline-delimited or nested - schema versioned per run
CSV
Flat file with typed columns - Excel/Sheets compatible
XLS
Legacy spreadsheet format for business analyst teams
Parquet
Columnar format for BigQuery, Snowflake, Athena
AWS S3
Direct bucket delivery - compatible with any data lake
Webhook
HTTP POST per record for real-time downstream processing
API
RESTful endpoints to query extracted datasets on demand
Snowflake
Stage + COPY INTO workflow - incremental or full-replace
BigQuery
Streamed directly into your dataset with schema auto-detect
S3
Direct bucket delivery — compatible with any data lake
// faq

Common questions.

About heb.com scraping, legality, and pipeline operations.

Ask us directly →
Can you scrape pricing for multiple H-E-B locations simultaneously?

Yes. We configure concurrent pipeline runs using store-specific session cookies and zip code routing to extract hyper-local pricing and inventory across hundreds of locations.

How do you handle complex promotions like Combo Locos?

Our schema normalises these promotions into relational structures. We extract the primary qualifying item, the list of free or discounted items, and the exact promotional logic required to trigger the deal.

Do you extract nutritional panels and ingredients?

Yes. We parse the structured nutritional facts, ingredient text, and dietary flags (such as Gluten-Free or Vegan) for every SKU that provides this data.

Is it possible to track H-E-B private label products against national brands?

Absolutely. We can extract the brand taxonomy and flag H-E-B Own Brand items, allowing you to run price gap analysis against equivalent CPG products.

How fresh is the inventory data?

We can schedule pipelines to run at daily or intra-day cadences depending on your requirements. Note that inventory flags are based on the digital storefront's state at the time of the crawl.

What is the minimum viable engagement?

Our packages start at a defined category or store list with weekly delivery. For full-catalogue daily tracking across multiple locations, we price based on compute volume and proxy bandwidth.

Do you need my H-E-B account credentials?

No. DataFlirt only extracts publicly available data from unauthenticated sessions. We do not support scraping personal account data, past orders, or login-gated personalised coupons.

$ dataflirt scope --new-project --source=heb.com ready

Tell us what
to extract.
We do the rest.

20-minute scoping call. Pilot dataset within the week. Production within two. Whether you need a one-off catalogue dump or continuous price tracking across 400 store locations - we scope, build, and operate the infrastructure. Tell us what you need.

hello@dataflirt.com · Bengaluru · IST · typical reply < 4h
Related Scrapers

More in food drink and kitchen

Services

Data Extraction for Every Industry

View All Services →