SYSTEM all green source iherb.com queue 18,492 pages p99 latency 164ms dataflirt.com · scraper/iherb-com
RUN · 32 active pipelines · iherb.com live

iHerb data,
at warehouse scale.

We extract product listings, supplement facts, expiration dates, global pricing, and multi-language reviews from iHerb. Delivered as clean JSON, CSV, or Parquet to S3, BigQuery, or Snowflake on your cadence.

Products extracted
182K /day
Price updates
1.4M /24h
Review records
410K /run
Active pipelines
32
Uptime
99.98%
Data Dictionary

Every field we extract from iherb.com

Structured, schema-consistent data across all major object types — delivered clean, typed, and ready to query.

Complete list of extractable fields for Product Listings objects from iherb.com. All fields typed and schema-versioned.

product_idupc_codetitlebrandcategory_hierarchypricecurrencyin_stockexpiration_dateweight_lbsweight_kgdimensionspackage_quantityratingreview_countproduct_url
product_listings
● 200 OK
"product_id": "CGN-01093",
"title": "California Gold Nutrition, Omega-3 Premium Fish Oil",
"brand": "California Gold Nutrition",
"price": 7.0,
"currency": "USD",
"in_stock": true,
"expiration_date": "2027-02-01",
"rating": 4.8,
"review_count": 342190
# product_idupc_codetitlebrandcategory_hierarchyprice
1
2
3

Complete list of extractable fields for Supplement Facts objects from iherb.com. All fields typed and schema-versioned.

product_idserving_sizeservings_per_containeringredient_nameamount_per_servingdaily_value_pctother_ingredientsallergenswarningscertificationsdietary_flags
supplement_facts
● 200 OK
"product_id": "CGN-01093",
"serving_size": "2 Softgels",
"servings_per_container": "50",
"ingredient_name": "Total Omega-3s",
"amount_per_serving": "640 mg",
"daily_value_pct": "None",
"other_ingredients": "Fish Gelatin Softgel, Vegetable Glycerin, Purified Water",
"allergens": "['Fish (Anchovy, Mackerel, Sardine, Tuna)']"
# product_idserving_sizeservings_per_containeringredient_nameamount_per_servingdaily_value_pct
1
2
3

Complete list of extractable fields for Pricing & Offers objects from iherb.com. All fields typed and schema-versioned.

product_idcountry_codebase_pricediscount_pricetrial_pricebulk_discount_qtybulk_discount_pctcurrencyloyalty_credit_estflash_sale_activeshipping_saver_eligiblescraped_at
pricing_& offers
● 200 OK
"product_id": "CGN-01093",
"country_code": "US",
"base_price": 7.0,
"trial_price": 3.5,
"bulk_discount_qty": 4,
"bulk_discount_pct": 5,
"shipping_saver_eligible": true,
"scraped_at": "2026-05-12T09:14:00Z"
# product_idcountry_codebase_pricediscount_pricetrial_pricebulk_discount_qty
1
2
3

Complete list of extractable fields for Reviews objects from iherb.com. All fields typed and schema-versioned.

review_idproduct_iduser_nameratingreview_datereview_titlereview_texthelpful_voteslanguagetranslatedverified_buyeruser_tier
reviews
● 200 OK
"review_id": "REV-984210",
"product_id": "CGN-01093",
"rating": 5,
"review_date": "2026-04-18",
"review_text": "Excellent quality fish oil, no fishy burps.",
"helpful_votes": 12,
"language": "en",
"verified_buyer": true
# review_idproduct_iduser_nameratingreview_datereview_title
1
2
3

Complete list of extractable fields for Categories objects from iherb.com. All fields typed and schema-versioned.

category_idcategory_namebreadcrumbtotal_productstop_brandsbest_selling_product_idcategory_urlscraped_at
categories
● 200 OK
"category_id": "cat-fish-oil",
"category_name": "Fish Oil & Omegas",
"breadcrumb": "['Supplements', 'Fish Oil & Omegas']",
"total_products": 412,
"top_brands": "['California Gold Nutrition', 'Now Foods', 'Carlson']",
"best_selling_product_id": "CGN-01093",
"scraped_at": "2026-05-12T09:15:33Z"
# category_idcategory_namebreadcrumbtotal_productstop_brandsbest_selling_product_id
1
2
3

Capabilities

Extract precise health and beauty data

Our iHerb pipeline navigates strict bot protection, dynamic geo-pricing, and complex HTML structures to deliver clean, normalised supplement and cosmetic datasets.

Supplement Facts Parsing

Extract structured ingredient lists, serving sizes, and daily values from complex HTML tables across thousands of SKUs.

Localised Pricing

Capture accurate pricing, shipping saver eligibility, and stock availability across 180+ countries using targeted geo-proxies.

Expiration Date Tracking

Extract precise expiration dates and lot numbers displayed on product pages for shelf-life analysis.

Multi-Language Reviews

Scrape reviews in native languages with translation flags, helpful votes, and verified buyer status.

Trial & Flash Sale Monitoring

Track trial pricing, flash sales, and bulk discount tiers to monitor competitive promotional strategies.

Weight & Dimension Data

Capture precise shipping weight and package dimensions crucial for logistics and shipping cost calculations.

Allergen & Warning Extraction

Parse dietary flags, allergen warnings, and certifications (e.g., Vegan, Non-GMO, Gluten-Free) into structured arrays.

Category Rank Intelligence

Track best-seller rankings within specific health and beauty subcategories to monitor brand performance.

Change Detection

Run continuous pipelines with hash-based diffing. Only ingest records when prices, stock, or formulations change.

// engagement pipeline

From product links to warehouse tables

Brief in. Clean data out.

Define Scope
d 0

Provide iHerb category URLs, brand names, or specific UPCs. We design the extraction schema together.

Pipeline Build
d 2–4

We configure Scrapy crawlers, geo-targeted proxy rotation, and anti-bot circumvention for iherb.com.

Validation & QA
d 4–6

Schema validation, null-rate checks, ingredient parsing accuracy, and geo-pricing verification before full launch.

Delivery
ongoing

JSON / CSV / Parquet pushed to your S3 bucket, BigQuery dataset, or via Webhook on agreed cadence.

Under the hood

Overcoming iHerb's extraction challenges

iHerb employs strict bot protection and dynamically renders content based on IP location. Here is how we ensure reliable data delivery.

pipeline-monitor · iherb.com · live ● active
// fingerprinting
Identity rotation
TLS fingerprintrandomised
User-agentrotated
IP poolresidential
Challenges blocked0
// pagination
Page coverage
48,291 pages queued running
// observability
Pipeline health
99.9%
uptime
142ms
p99 lat
0.3%
null rate
2
alerts
Anti-bot evasion
Bypassing Cloudflare and Akamai

iHerb uses advanced CDNs and bot protection that block standard HTTP clients. We utilise residential proxies and TLS fingerprint spoofing to maintain high success rates without triggering CAPTCHAs.

Geo-pricing
Accurate localised data

Prices, currency, and stock availability change drastically based on the visitor's IP and session cookies. We manage persistent sessions with country-specific residential IPs to guarantee accurate local data.

Data parsing
Structuring supplement facts

Supplement facts tables on iHerb are notoriously inconsistent in their HTML structure. We deploy custom parsing logic with regex fallbacks to normalise ingredients, amounts, and daily values into clean JSON arrays.

Schema stability
Resilient DOM selectors

iHerb frequently updates its frontend architecture. Our selector strategy uses multiple fallback chains—CSS, XPath, and JSON-LD—to ensure pipeline stability during site updates.

Scale
Managing high-volume review extraction

Popular products have tens of thousands of reviews. Our infrastructure handles deep pagination efficiently, capturing historical review data without timing out or hitting rate limits.

Applications

Who uses iHerb data

Teams across industries use iherb.com data to build competitive products and smarter operations.

01
Competitor Pricing Intelligence

Supplement brands monitor iHerb pricing, bulk discounts, and trial offers to adjust their direct-to-consumer pricing strategies.

02
Ingredient Trend Analysis

R&D teams analyse supplement facts and formulations across top-selling products to identify emerging ingredient trends.

03
Brand Protection

Cosmetic and wellness brands audit iHerb listings for MAP violations, unauthorised sellers, and grey-market distribution.

04
Machine Learning Training

Health tech companies use structured ingredient and review datasets to train recommendation engines and NLP sentiment models.

05
Global Market Research

Analysts track product availability and category rankings across different regions to evaluate international expansion opportunities.

06
Supply Chain Forecasting

Distributors correlate stock availability flags and expiration date data with category demand to optimise procurement.

Why DataFlirt

"iHerb holds the most comprehensive structured dataset of global supplement facts and ingredient combinations available online."

Extracting data from iHerb requires parsing complex nested HTML tables for supplement facts, managing strict anti-bot measures, and rotating residential proxies to capture accurate localised pricing across 180 countries. We handle the infrastructure so you can query clean data.

Technical Spec

iHerb scraper — technical capabilities

Everything supported by our iherb.com scraper — rendered SPA elements, auth walls, rate-limit evasion and beyond.

Geo-targeted pricing
Extract prices and stock specific to US, UK, JP, KR, and 180+ other regions
Supported
Supplement facts parsing
Normalisation of complex ingredient tables into structured arrays
Supported
Multi-language reviews
Capture reviews across all supported iHerb languages
Supported
Expiration date tracking
Extract exact expiration dates and shelf-life indicators per product
Supported
Change detection
Hash-based diffing to emit only updated prices or stock statuses
Supported
Residential proxy rotation
ISP-grade IPs to bypass Akamai/Cloudflare bot protection
Supported
Trial & Flash sale capture
Identify temporary promotional pricing and trial restrictions
Supported
User Cart & Checkout Data
Gated data requiring individual user authentication
Partial
Rewards Program History
Private user loyalty credit balances and referral history
Partial
Infrastructure

Infrastructure powering the iHerb pipeline

Open-source tooling on proven cloud infra — no vendor lock-in, full observability.

ScrapyPlaywrightPython 3.12RedisPostgreSQLApache AirflowAWS LambdaS3CloudWatch2CaptchaCapSolverResidential ProxiesDockerKubernetesGrafanaPrometheusBeautifulSouplxml
Scrapy + Playwright Stack

Scrapy manages high-throughput crawl orchestration and deduplication. Playwright handles dynamic content rendering and bot-challenge resolution when required.

Geo-Targeted Proxy Infrastructure

We route requests through country-specific residential proxies to ensure pricing, currency, and stock data accurately reflect local market conditions.

Cloud-Native Orchestration

Pipelines run on scalable AWS infrastructure managed by Apache Airflow, ensuring reliable scheduling, dependency management, and strict SLA compliance.

Output & Delivery

Your data, your destination

Data delivered to where your team already works — no new tooling required.

JSON
Newline-delimited or nested — ideal for complex supplement facts arrays
CSV
Flat file with typed columns — Excel/Sheets compatible
XLS
Formatted spreadsheet delivery for business analysts
Parquet
Columnar format optimised for BigQuery, Snowflake, Athena
AWS S3
Direct bucket delivery — compatible with any data lake
Webhook
HTTP POST per record for real-time downstream processing
API
REST endpoint to query latest extracted records
BigQuery
Streamed directly into your dataset with schema auto-detect
S3
Direct bucket delivery — compatible with any data lake
// faq

Common questions.

About iherb.com scraping, legality, and pipeline operations.

Ask us directly →
Is scraping iHerb legal?

Scraping publicly available information from iHerb is generally permissible under applicable laws. DataFlirt targets only public, non-authenticated product, pricing, ingredient, and review data. We do not extract personal user data or circumvent authentication walls.

How do you handle iHerb's bot protection?

We use residential ISP proxies, TLS fingerprint spoofing, and realistic request timing to mimic human behaviour, avoiding Cloudflare blocks. Our infrastructure automatically rotates IPs and handles solver queues if challenges arise.

Can you extract prices for different countries?

Yes. We configure pipelines to use geo-specific proxies and session cookies, allowing us to extract accurate localised pricing, currency, and stock availability for any region iHerb supports.

How accurate is the supplement facts parsing?

Highly accurate. We maintain custom parsers designed specifically for iHerb's varied HTML table structures, converting complex nutritional panels into clean, queryable JSON arrays containing ingredient names, amounts, and daily values.

Do you capture expiration dates?

Yes. We extract the exact expiration date and lot number displayed on the product page, which is critical for inventory and shelf-life analysis.

Can you scrape reviews in multiple languages?

Yes. We can extract reviews in their native language or capture the translated versions provided by iHerb, along with helpful vote counts and verified buyer flags.

What is the delivery frequency?

Pipelines can be configured for daily, weekly, or custom cadences. We also support change-detection modes that only deliver data when prices, stock, or formulations update.

$ dataflirt scope --new-project --source=iherb.com ready

Tell us what
to extract.
We do the rest.

20-minute scoping call. Pilot dataset within the week. Production within two. Whether you need a one-off export of supplement facts or a continuous global price-monitoring feed — we scope, build, and operate the pipeline. Tell us what you need.

hello@dataflirt.com · Bengaluru · IST · typical reply < 4h
Related Scrapers

More in beauty and skincare

Services

Data Extraction for Every Industry

View All Services →