We extract medicine listings, pricing signals, substitute mappings, manufacturer intelligence, reviews, and lab test catalogs from 1mg. Delivered as clean JSON, CSV, or Parquet to S3, BigQuery, or Snowflake on your cadence.
Structured, schema-consistent data across all major object types — delivered clean, typed, and ready to query.
Complete list of extractable fields for Medicine Listings objects from 1mg.com. All fields typed and schema-versioned.
"product_id": "1MG-MED-00291847", "name": "Dolo 650 Tablet", "manufacturer": "Micro Labs Ltd", "salt_composition": "Paracetamol (650mg)", "price": 30.36, "mrp": 33.73, "currency": "INR", "discount_pct": 10, "prescription_required": false, "rating": 4.6, "in_stock": true
| # | product_id | name | brand | manufacturer | salt_composition | category |
|---|---|---|---|---|---|---|
| 1 | ||||||
| 2 | ||||||
| 3 |
Complete list of extractable fields for Pricing & Substitutes objects from 1mg.com. All fields typed and schema-versioned.
"product_id": "1MG-MED-00291847", "price": 30.36, "mrp": 33.73, "price_per_unit": 2.02, "substitute_name": "Calpol 650mg Tablet", "substitute_price": 27.90, "substitute_discount_pct": 12, "price_timestamp": "2026-05-12T08:30:00Z"
| # | product_id | name | price | mrp | discount_pct | pack_size |
|---|---|---|---|---|---|---|
| 1 | ||||||
| 2 | ||||||
| 3 |
Complete list of extractable fields for Reviews & Ratings objects from 1mg.com. All fields typed and schema-versioned.
"review_id": "1MG-REV-00847321", "product_id": "1MG-MED-00291847", "star_rating": 5, "verified_purchase": true, "review_title": "Works fast for fever relief", "helpful_votes": 84, "condition_treated": "Fever", "review_date": "2026-04-02"
| # | review_id | product_id | reviewer_name | star_rating | review_title | review_body |
|---|---|---|---|---|---|---|
| 1 | ||||||
| 2 | ||||||
| 3 |
Complete list of extractable fields for Lab Tests objects from 1mg.com. All fields typed and schema-versioned.
"test_id": "1MG-LAB-00034821", "test_name": "Complete Blood Count (CBC)", "price": 299.00, "mrp": 499.00, "home_collection_available": true, "report_turnaround_hrs": 24, "fasting_required": false, "parameters_count": 24
| # | test_id | test_name | category | price | mrp | discount_pct |
|---|---|---|---|---|---|---|
| 1 | ||||||
| 2 | ||||||
| 3 |
Our 1mg scraper handles every layer of the platform: medicine catalogs, MRP vs selling price, substitute chains, manufacturer data, and the full review corpus — with JavaScript rendering and anti-bot circumvention built in.
Name, salt composition, manufacturer, pack size, dosage form, prescription status, uses, side effects, and every metadata field 1mg surfaces — at product level.
Capture MRP, selling price, discount percentage, price-per-unit, and promotional offer details — timestamped per crawl across the entire catalog.
Extract full substitute chains with comparative pricing, manufacturer, salt equivalence, and discount differentials — critical for pharma pricing intelligence.
Full review text, star ratings, helpful votes, verified purchase flags, condition treated, and duration of use — paginated across all review pages.
Test name, category, price, lab accreditation, turnaround time, home collection availability, fasting requirements, and parameter counts — across all diagnostic offerings.
Manufacturer name, country of origin, full product portfolio on 1mg, pricing position vs category peers, and market share by therapeutic category.
Capture prescription requirement flags, Schedule H/H1 status, and narcotic classification at product level across the full catalog.
Track organic position for any drug name, salt, or condition keyword — with sponsored placement detection and badge capture.
One-off catalog dumps or continuous price-monitoring pipelines at hourly, daily, or custom cadences with change-detection diffing.
Brief in. Clean data out.
Provide product IDs, category URLs, therapeutic segment lists, or manufacturer names. We design the extraction schema together.
We configure Scrapy / Playwright crawlers, proxy rotation, session management, and anti-bot handling for 1mg.com.
Schema validation, MRP sanity checks, null-rate monitoring, and sample review before full launch.
JSON / CSV / Parquet pushed to your S3 bucket, BigQuery dataset, or Snowflake stage on agreed cadence.
Pharmaceutical data has unique extraction challenges — dynamic pricing, prescription gating, and deep substitute trees. Here's how we stay resilient.
1mg rate-limits aggressive crawlers using IP reputation scoring and session fingerprinting. Our crawlers use Indian residential ISP proxies with realistic browser fingerprints, randomised request intervals, and full cookie session management to appear as genuine consumer traffic.
Pricing, stock availability, and substitute panels on 1mg are heavily JavaScript-rendered. We run full Playwright browser sessions with lazy-load triggering and dynamic widget hydration — capturing data that lightweight HTTP clients miss entirely.
1mg updates its page structure regularly. Our selector strategy uses multiple fallback chains per field — CSS selectors, XPath, structured data (LD+JSON), and text-pattern matching — so layout changes don't break your pipeline overnight.
For large medicine catalogs, we maintain a hash index of last-seen values per field. Subsequent runs only push diffs — reducing compute cost and downstream load. You get a clean changelog rather than full re-dumps.
Every run emits structured logs to our observability stack. We alert on null-rate spikes, MRP anomalies, schema drift, and coverage drops — and respond before you notice. SLA uptime is contractual, not aspirational.
Pharmaceutical companies and distributors monitor MRP vs selling price, discount depth, and substitute pricing to benchmark their portfolio and identify margin pressure points.
Generic manufacturers track branded-to-generic price ratios, substitute chain penetration, and market share by salt composition to time product launches and set pricing.
Analysts map therapeutic category sizes, OTC vs Rx mix, manufacturer dominance, and emerging product segments to support investment and strategy decisions.
Diagnostic chains track lab test pricing, home collection availability, and turnaround time across 1mg's partner network to benchmark their own offering.
Health platforms use 1mg catalog data to power medicine search, dosage lookup, and substitute recommendation features in their own products.
Policy researchers and compliance teams track MRP adherence, prescription requirement labelling, and schedule classification consistency across the catalog.
"1mg is India's most comprehensive digital pharmacy — but without a structured pipeline, its pricing and substitute intelligence is inaccessible to analysts."
Reliable 1mg scraping requires handling dynamic pricing widgets, substitute tree traversal, and session-based rate limiting — all while maintaining schema stability across frequent layout updates. DataFlirt absorbs that complexity so your pharma, health-tech, or research team can focus on the analysis.
Everything supported by our 1mg.com scraper — rendered SPA elements, auth walls, rate-limit evasion and beyond.
Open-source tooling on proven cloud infra — no vendor lock-in, full observability.
Scrapy handles crawl orchestration, deduplication, and retry logic. Playwright handles JavaScript rendering, cookie sessions, and substitute panel interactions. Combined via scrapy-playwright middleware.
We maintain pools of Indian residential ISP proxies to match 1mg's primary user geography. Rotation happens per-request with sticky sessions where required for session continuity.
Pipelines run on AWS Lambda (burst) and ECS (sustained). Airflow handles scheduling, dependency management, and SLA alerting. All state stored in managed Postgres.
Data delivered to where your team already works — no new tooling required.
About 1mg.com scraping, legality, and pipeline operations.
Ask us directly →Scraping publicly available information from 1mg is generally permissible under applicable Indian law. DataFlirt targets only public, non-authenticated product, pricing, and review data. We do not extract personal user data, circumvent authentication walls, or access prescription-gated records. We recommend clients review 1mg's ToS independently and consult legal counsel for specific use cases.
We use Indian residential ISP proxies that appear as genuine consumer traffic, full Playwright sessions with realistic browser fingerprints, and request timing modelled on human behaviour. Our selectors include multi-layer fallback chains so DOM changes don't break the pipeline.
Yes — including full substitute chains with comparative pricing, manufacturer details, salt equivalence, and discount differentials for each substitute. This is one of the most requested data points from pharma clients.
Yes. We extract the full diagnostics catalog including test name, category, price, MRP, lab accreditation, turnaround time, home collection availability, fasting requirements, and parameter count.
Real-time pipelines achieve sub-60-minute latency for price and stock updates on a defined product set. Full catalog refreshes at daily cadence complete within a 4–8 hour window depending on scope.
Our smallest packages start at a defined product list (typically 1,000–20,000 SKUs) with weekly delivery. For larger catalogs or ongoing monitoring, we price based on volume and delivery frequency. Contact us for a scoped quote.
Yes. We provide a sample run of up to 500 products as part of the pre-engagement scoping process — so you can validate schema fit, field completeness, and data quality before signing any contract.
20-minute scoping call. Pilot dataset within the week. Production within two. Whether you need a one-off pharma catalog snapshot or a continuous price-monitoring feed — we scope, build, and operate the pipeline. Tell us what you need.
