SYSTEM all green source hills.com queue 4,192 pages p99 latency 184ms dataflirt.com · scraper/hills-com
RUN * 14 active pipelines * hills.com live

Pet nutrition data,
structured for analysis.

We extract Science Diet and Prescription Diet catalogues, granular nutritional breakdowns, feeding guides, and veterinary clinic locators from hills.com. Delivered as clean JSON or Parquet.

Products extracted
8,419 /run
Nutritional profiles
24.1K /month
Retailer locations
112K /run
Active pipelines
14
Uptime
99.98%
Data Dictionary

Every field we extract from hills.com

Structured, schema-consistent data across all major object types — delivered clean, typed, and ready to query.

Complete list of extractable fields for Product Metadata objects from hills.com. All fields typed and schema-versioned.

skuproduct_nameproduct_linelifestagehealth_conditionbreed_sizefood_formflavourdescriptionavailable_sizespage_urlimage_urls
product_metadata
● 200 OK
"sku": "603957",
"product_name": "Prescription Diet c/d Multicare Urinary Care Dry Dog Food",
"product_line": "Prescription Diet",
"lifestage": "Adult, Senior",
"health_condition": "Urinary Health",
"food_form": "Dry Food",
"available_sizes": "['8.5 lb', '17.6 lb', '27.5 lb']",
"flavour": "Chicken"
# skuproduct_nameproduct_linelifestagehealth_conditionbreed_size
1
2
3

Complete list of extractable fields for Nutritional Analysis objects from hills.com. All fields typed and schema-versioned.

skuprotein_pctfat_pctcrude_fibre_pctmoisture_pctcalcium_pctphosphorus_pctsodium_pctmagnesium_pctcaloric_density_kcal_kgcaloric_density_kcal_cupdry_matter_profile
nutritional_analysis
● 200 OK
"sku": "603957",
"protein_pct": 21.0,
"fat_pct": 13.0,
"crude_fibre_pct": 3.0,
"moisture_pct": 10.0,
"calcium_pct": 0.6,
"phosphorus_pct": 0.5,
"caloric_density_kcal_cup": 374
# skuprotein_pctfat_pctcrude_fibre_pctmoisture_pctcalcium_pct
1
2
3

Complete list of extractable fields for Ingredients objects from hills.com. All fields typed and schema-versioned.

skuprimary_ingredientfull_ingredient_listvitamins_addedminerals_addedartificial_coloursartificial_flavoursgrain_freeprescription_required
ingredients
● 200 OK
"sku": "603957",
"primary_ingredient": "Whole Grain Corn",
"full_ingredient_list": "Whole Grain Corn, Brewers Rice, Chicken Meal, Chicken Fat, Corn Gluten Meal...",
"grain_free": false,
"prescription_required": true,
"artificial_colours": false,
"artificial_flavours": false
# skuprimary_ingredientfull_ingredient_listvitamins_addedminerals_addedartificial_colours
1
2
3

Complete list of extractable fields for Feeding Guide objects from hills.com. All fields typed and schema-versioned.

skutarget_weight_lbtarget_weight_kgdaily_amount_cupsdaily_amount_gramstransition_daysmixed_feeding_ratiospecial_instructions
feeding_guide
● 200 OK
"sku": "603957",
"target_weight_lb": 10,
"target_weight_kg": 4.5,
"daily_amount_cups": 1.0,
"daily_amount_grams": 95,
"transition_days": 7,
"special_instructions": "Adjust feeding amounts as necessary to maintain optimal weight."
# skutarget_weight_lbtarget_weight_kgdaily_amount_cupsdaily_amount_gramstransition_days
1
2
3

Complete list of extractable fields for Retailer Locator objects from hills.com. All fields typed and schema-versioned.

store_idstore_namestore_typeaddresscitystatezip_codephonelatitudelongitudestocks_prescription_dietstocks_science_diet
retailer_locator
● 200 OK
"store_id": "LOC-8492",
"store_name": "Downtown Veterinary Clinic",
"store_type": "Veterinary Clinic",
"city": "Seattle",
"state": "WA",
"zip_code": "98101",
"stocks_prescription_diet": true,
"stocks_science_diet": true
# store_idstore_namestore_typeaddresscitystate
1
2
3

Capabilities

Extract the complete Hill's nutritional catalogue

Our hills.com scraper handles dynamic product variants, nested nutritional tables, and geo-fenced retailer locators to deliver a highly structured dataset for pet food analysis.

Full Product Catalogue

Extract every SKU across Science Diet, Prescription Diet, and Healthy Advantage lines, including all bag sizes and packaging variants.

Nutritional Breakdowns

Parse complex nutritional tables to capture protein, fat, fibre, moisture, and micro-nutrient percentages on a dry matter basis.

Ingredient Parsing

Tokenise the full ingredient list to identify primary protein sources, grains, added vitamins, and flag artificial additives.

Feeding Guide Extraction

Capture daily feeding recommendations mapped to pet weight in both imperial and metric units, including mixed feeding ratios.

Retailer & Vet Locator

Scrape the geo-fenced store locator to map veterinary clinics and pet specialty stores stocking specific product lines.

Prescription Diet Mapping

Identify therapeutic diets and map them to specific health conditions like urinary care, kidney support, or weight management.

Lifestage & Breed Filters

Categorise products accurately by target lifestage (kitten, adult, senior) and breed size (small paws, large breed).

Change Detection

Monitor formulation changes, new product launches, and discontinued SKUs with hash-based diffing.

Scheduled Exports

Run pipelines at your preferred frequency to keep your internal databases synchronised with the live site.

// engagement pipeline

From product URL to warehouse record

Brief in. Clean data out.

Define Scope
d 0

Select target product lines, nutritional data points, or geographic regions for the retailer locator.

Pipeline Build
d 2–4

We configure Playwright crawlers to handle dynamic table rendering and geo-fenced API endpoints.

Validation & QA
d 4–6

Schema validation, null-rate checks, and unit conversion verification before full launch.

Delivery
ongoing

JSON, CSV, or Parquet pushed to your S3 bucket, BigQuery dataset, or Snowflake stage on agreed cadence.

Under the hood

How our Hills pipeline handles the hard parts

Extracting accurate nutritional data requires parsing deeply nested DOM structures and executing JavaScript for variant selection.

pipeline-monitor · hills.com · live ● active
// fingerprinting
Identity rotation
TLS fingerprintrandomised
User-agentrotated
IP poolresidential
Challenges blocked0
// pagination
Page coverage
48,291 pages queued running
// observability
Pipeline health
99.9%
uptime
142ms
p99 lat
0.3%
null rate
2
alerts
Dynamic product rendering
Full Playwright execution for variant data

Bag sizes and corresponding nutritional shifts are heavily JavaScript-rendered. We run full Playwright browser sessions to trigger variant changes and capture accurate SKU-level data.

Geo-fenced retailer search
Zip code iteration and coordinate mapping

The where-to-buy locator requires geographic inputs. We iterate through comprehensive zip code lists using localised residential proxies to extract a complete map of stockists.

Nested nutritional tables
Resilient selectors for complex DOMs

Nutritional profiles are displayed in complex tabbed interfaces. Our selector strategy uses structured data extraction and XPath fallback chains to ensure every micronutrient is captured accurately.

Anti-bot layer
Residential proxy rotation

We use residential ISP proxies with realistic browser fingerprints to prevent rate-limiting during large-scale catalogue extraction.

Change detection
Only re-scrape what has changed

We maintain a hash index of last-seen values per field. Subsequent runs only push diffs, reducing downstream processing load and highlighting formulation changes.

Applications

Who uses Hills data and how

Teams across industries use hills.com data to build competitive products and smarter operations.

01
Competitor Benchmarking

Pet food manufacturers compare their nutritional profiles and caloric densities against Hill's Science Diet formulations.

02
Nutritional Analysis

Veterinary researchers aggregate macronutrient data across therapeutic diets to analyse industry standards for specific health conditions.

03
Retail Distribution Mapping

Sales teams analyse the geographic density of veterinary clinics stocking Prescription Diet products.

04
eCommerce Catalogue Enrichment

Pet supply retailers automatically update their product listings with accurate ingredients, feeding guides, and product images.

05
Veterinary Research

Academics track formulation changes in therapeutic diets over time to correlate with clinical outcomes.

06
Market Trend Analysis

Analysts track the introduction of new protein sources, grain-free options, and condition-specific diets in the pet food market.

Why DataFlirt

"Hill's Pet Nutrition provides some of the most clinically precise dietary data in the pet food industry, but extracting it at scale requires parsing highly nested, dynamic tables."

Extracting data from hills.com involves navigating complex JavaScript-rendered nutritional tables and geo-fenced retailer locators. DataFlirt manages the proxies, rendering, and parsing logic so your data team receives clean, normalised nutritional profiles and product specifications directly in your warehouse.

Technical Spec

Hills scraper technical capabilities

Everything supported by our hills.com scraper — rendered SPA elements, auth walls, rate-limit evasion and beyond.

JavaScript rendering
Full Playwright sessions required for variant selection and tabbed nutritional data
Supported
Geo-targeted retailer search
Iterative scraping across zip codes to build a national store directory
Supported
Nutritional table parsing
Extraction of nested tables including dry matter and as-fed profiles
Supported
Variant mapping (bag sizes)
Parent to child SKU relationships for different packaging options
Supported
Ingredient list tokenisation
Parsing comma-separated ingredient strings into structured arrays
Supported
Change detection (diffs)
Hash-based diff to emit records with changed formulations
Supported
Webhook delivery
HTTP POST per record or batch for downstream processing
Supported
Veterinarian Portal (Hill's Vet)
Gated clinical studies and wholesale pricing requires active vet credentials
Partial
Staff training modules
Internal certification courses are authenticated and inaccessible
Partial
Direct consumer purchase history
User account order history is behind a login wall
Partial
Infrastructure

Infrastructure powering the Hills pipeline

Open-source tooling on proven cloud infra — no vendor lock-in, full observability.

ScrapyPlaywrightPython 3.12RedisPostgreSQLApache AirflowAWS LambdaS3CloudWatch2CaptchaCapSolverResidential ProxiesDockerKubernetesGrafanaPrometheus
Scrapy + Playwright Stack

Scrapy handles crawl orchestration and deduplication. Playwright manages JavaScript rendering for complex nutritional tables and variant selectors.

Residential Proxy Infrastructure

We maintain pools of residential ISP proxies to avoid rate limits during intensive catalogue and retailer locator extraction.

Cloud-Native Orchestration

Pipelines run on AWS Lambda and ECS. Airflow handles scheduling, dependency management, and SLA alerting. All state is stored in managed Postgres.

Output & Delivery

Your data, your destination

Data delivered to where your team already works — no new tooling required.

JSON
Newline-delimited or nested arrays for complex nutritional data
CSV
Flat file with typed columns for quick analysis
XLS
Excel compatible format for business teams
Parquet
Columnar format for BigQuery, Snowflake, and Athena
AWS S3
Direct bucket delivery compatible with your data lake
Webhook
HTTP POST per record for immediate downstream updates
API
RESTful endpoints to query extracted nutritional profiles on demand
Postgres
Upsert directly into your existing relational schema
S3
Direct bucket delivery — compatible with any data lake
// faq

Common questions.

About hills.com scraping, legality, and pipeline operations.

Ask us directly →
Can you extract data for every bag size variant?

Yes. We execute JavaScript to select every available bag size on a product page, capturing the specific SKU, weight, and any variations in the nutritional profile or feeding guide.

Do you parse the nutritional tables accurately?

Yes. Hill's displays complex nutritional data. We parse these tables to extract precise percentages for protein, fat, fibre, and moisture, mapping them to standard schema fields.

Can you scrape the where-to-buy store locator?

Yes. We automate searches across comprehensive zip code lists to extract full directories of veterinary clinics and pet stores that stock specific product lines.

How do you track formulation changes?

We maintain a hash index of the ingredient list and nutritional table for every SKU. If a formulation changes, the pipeline detects the diff and flags the update in your next delivery.

Is it possible to filter products by health condition?

Yes. We capture all metadata tags, allowing you to filter the dataset by specific health conditions such as urinary care, weight management, or kidney support.

What formats do you deliver the data in?

We deliver structured data in JSON, CSV, XLS, and Parquet. We can push this directly to AWS S3, Snowflake, BigQuery, or via Webhook and API.

$ dataflirt scope --new-project --source=hills.com ready

Tell us what
to extract.
We do the rest.

20-minute scoping call. Pilot dataset within the week. Production within two. Whether you need a one-off nutritional catalogue dump or continuous tracking of formulation changes. Tell us what you need.

hello@dataflirt.com · Bengaluru · IST · typical reply < 4h
Related Scrapers

More in pets

Services

Data Extraction for Every Industry

View All Services →