SYSTEM all green source mfine.co queue 12,943 URLs p99 latency 218ms dataflirt.com · scraper/mfine-co
RUN · 41 active pipelines · mfine.co live

MFine data,
at warehouse scale.

We extract doctor profiles, clinic affiliations, lab test pricing, and pharmacy catalogues from MFine. Delivered as clean JSON, CSV, or Parquet to S3, BigQuery, or Snowflake on your cadence.

Doctors extracted
47.2K /run
Lab tests tracked
14.8K /day
Pharmacy items
112K /week
Active pipelines
41
Uptime
99.98%
Data Dictionary

Every field we extract from mfine.co

Structured, schema-consistent data across all major object types — delivered clean, typed, and ready to query.

Complete list of extractable fields for Doctor Profiles objects from mfine.co. All fields typed and schema-versioned.

doctor_idnamespecialtyqualificationsexperience_yearslanguages_spokenconsultation_feeratingreview_countnext_available_slothospital_affiliationsmfine_url
doctor_profiles
● 200 OK
"doctor_id": "DOC-84921",
"name": "Dr. Ramesh Kumar",
"specialty": "Cardiology",
"qualifications": "MBBS, MD - General Medicine, DM - Cardiology",
"experience_years": 14,
"consultation_fee": 800.0,
"rating": 4.8
# doctor_idnamespecialtyqualificationsexperience_yearslanguages_spoken
1
2
3

Complete list of extractable fields for Lab Tests objects from mfine.co. All fields typed and schema-versioned.

test_idtest_namecategoryparameters_coveredfasting_requiredhome_collection_availablereport_turnaround_timepricediscount_pctprovider_nameprovider_ratingmfine_url
lab_tests
● 200 OK
"test_id": "LAB-3921",
"test_name": "Comprehensive Full Body Checkup",
"category": "Health Packages",
"price": 1499.0,
"fasting_required": true,
"report_turnaround_time": "24 hours",
"home_collection_available": true
# test_idtest_namecategoryparameters_coveredfasting_requiredhome_collection_available
1
2
3

Complete list of extractable fields for Pharmacy objects from mfine.co. All fields typed and schema-versioned.

sku_idmedicine_namemanufactureractive_ingredientspackaging_sizeprescription_requiredmrpselling_pricediscount_pctstock_statusreturn_policyside_effects
pharmacy
● 200 OK
"sku_id": "MED-99214",
"medicine_name": "Pan 40 Tablet",
"manufacturer": "Alkem Laboratories Ltd",
"mrp": 155.5,
"selling_price": 132.17,
"prescription_required": true,
"stock_status": "In Stock"
# sku_idmedicine_namemanufactureractive_ingredientspackaging_sizeprescription_required
1
2
3

Complete list of extractable fields for Clinics & Hospitals objects from mfine.co. All fields typed and schema-versioned.

clinic_idclinic_namecitylocalitypin_codespecialties_offereddoctor_countbed_countamenitiesratingreview_countmfine_url
clinics_& hospitals
● 200 OK
"clinic_id": "CLN-4829",
"clinic_name": "Apollo Clinic",
"city": "Bengaluru",
"locality": "Koramangala",
"specialties_offered": "['General Physician', 'Pediatrics', 'Gynecology']",
"doctor_count": 12,
"rating": 4.6
# clinic_idclinic_namecitylocalitypin_codespecialties_offered
1
2
3

Complete list of extractable fields for Search Results objects from mfine.co. All fields typed and schema-versioned.

search_querylocation_pinresult_typerank_positionentity_identity_nameprimary_attributeprice_indicatoravailability_badgesponsored_flagscraped_timestamp
search_results
● 200 OK
"search_query": "Dermatologist",
"location_pin": "560034",
"rank_position": 1,
"entity_name": "Dr. Sneha Reddy",
"primary_attribute": "Dermatology",
"price_indicator": 600.0,
"sponsored_flag": false
# search_querylocation_pinresult_typerank_positionentity_identity_name
1
2
3

Capabilities

Everything you need from MFine, nothing you do not

Our MFine scraper handles every layer of the platform: doctor directories, diagnostic test pricing, pharmacy catalogues, and pin code serviceability with residential proxies and dynamic hydration handling built in.

Doctor Profile Extraction

Extract qualifications, experience, spoken languages, specialties, and consultation fees for thousands of listed practitioners.

Lab Test Pricing

Capture individual test costs, package inclusions, fasting requirements, and turnaround times across different diagnostic partners.

Pharmacy Catalogues

Track medicine MRPs, selling prices, active ingredients, and prescription requirements across the entire pharmacy inventory.

Location Spoofing

Inject pin code specific headers and cookies to capture accurate hyperlocal pricing and serviceability flags.

Availability Slots

Monitor next available consultation times and home collection slots to gauge provider capacity and demand.

Clinic & Hospital Data

Map doctors to physical clinics, extracting hospital amenities, bed counts, and aggregate patient ratings.

Search Ranking

Track organic versus sponsored positions for specialty keywords across different city pin codes.

Change Detection

Run continuous pipelines that emit diffs for consultation fee adjustments or medicine price drops.

Multi-City Coverage

Scale extraction across Bengaluru, Delhi, Mumbai, and tier-2 cities concurrently without triggering rate limits.

// engagement pipeline

From URL list to warehouse record

Brief in. Clean data out.

Define Scope
d 0

Provide target specialties, pin codes, or test categories. We design the extraction schema together.

Pipeline Build
d 2–4

We configure Scrapy and Playwright crawlers, proxy rotation, and session management for mfine.co.

Validation & QA
d 4–6

Schema validation, null-rate checks, and price-outlier detection before full launch.

Delivery
ongoing

JSON, CSV, or Parquet pushed to your S3 bucket, BigQuery dataset, or Snowflake stage on agreed cadence.

Under the hood

How our MFine pipeline handles the hard parts

Healthcare platforms employ strict rate limits and geo-fencing. Here is how we stay resilient and deliver clean normalisation.

pipeline-monitor · mfine.co · live ● active
// fingerprinting
Identity rotation
TLS fingerprintrandomised
User-agentrotated
IP poolresidential
Challenges blocked0
// pagination
Page coverage
48,291 pages queued running
// observability
Pipeline health
99.9%
uptime
142ms
p99 lat
0.3%
null rate
2
alerts
Geo-targeting
Pin code specific headers and cookies

MFine alters doctor availability, lab test pricing, and medicine stock based on location. We inject specific pin codes into session cookies and API headers to extract accurate hyperlocal data.

JavaScript rendering
Dynamic hydration for React components

Many provider lists and pricing widgets on MFine load dynamically via client-side JavaScript. We use Playwright to execute these scripts and wait for network idle states before parsing the DOM.

Rate limit evasion
Residential proxy pools

Aggressive scraping triggers IP bans. We route all requests through Indian residential proxy networks, rotating IPs per request to mimic organic user distribution across regions.

Schema normalisation
Standardising varying qualifications

Doctor qualifications and hospital names are often entered inconsistently. Our pipeline applies regex-based normalisation rules to clean and standardise these fields before warehouse delivery.

Anomaly detection
Alerts for null rates

If MFine changes its API response structure for consultation fees, our pipeline detects the resulting null values, halts the sync, and alerts our engineering team immediately.

Applications

Who uses MFine data and how

Teams across industries use mfine.co data to build competitive products and smarter operations.

01
Competitor Price Monitoring

Healthcare aggregators track lab test and medicine prices to maintain competitive parity in local markets.

02
Doctor Supply Analysis

Health-tech startups identify specialty gaps by pin code to target their provider acquisition efforts.

03
Insurance Network Mapping

Insurers cross-reference doctor availability and consultation fees to optimise their cashless network directories.

04
Pharma Market Research

Pharmaceutical companies track active ingredients, generic alternatives, and discount structures across the platform.

05
Healthcare AI Training

Machine learning teams train triage models using symptom-to-specialty mappings derived from provider profiles.

06
Hyperlocal Expansion

Diagnostic chains analyse test provider density by locality to plan new physical collection centers.

Why DataFlirt

"MFine aggregates India's fragmented healthcare supply into a single digital interface. Without automated extraction, monitoring this pricing and availability is impossible."

Most teams underestimate the investment required: reliable MFine scraping requires residential proxies, pin-code based session handling, daily selector maintenance, and anomaly monitoring. DataFlirt absorbs that complexity so your engineers can focus on the analysis.

Technical Spec

MFine scraper - technical capabilities

Everything supported by our mfine.co scraper — rendered SPA elements, auth walls, rate-limit evasion and beyond.

JavaScript rendering
Playwright sessions for dynamic React components and pricing widgets
Supported
Pin code geo-targeting
Header and cookie injection for hyperlocal pricing and stock
Supported
Pagination traversal
Extract all results across deep category and search pages
Supported
Doctor availability slots
Capture next available consultation times per practitioner
Supported
Pharmacy stock status
Monitor inventory levels and out-of-stock flags for medicines
Supported
Change detection (diffs)
Only emit records with changed fields since the last run
Supported
Webhook delivery
HTTP POST per record for real-time downstream processing
Supported
Patient medical records
Historical health data and test reports require user authentication
Partial
Active consultation chats
Private messaging between doctors and patients is strictly gated
Partial
Infrastructure

Infrastructure powering the MFine pipeline

Open-source tooling on proven cloud infra — no vendor lock-in, full observability.

ScrapyPlaywrightPython 3.12RedisPostgreSQLApache AirflowAWS LambdaS3CloudWatch2CaptchaCapSolverResidential ProxiesDockerKubernetesGrafanaPrometheus
Scrapy + Playwright Stack

Scrapy handles crawl orchestration, deduplication, and retry logic. Playwright handles JavaScript rendering, cookie sessions, and interaction flows. Combined via scrapy-playwright middleware.

Residential Proxy Infrastructure

We maintain pools of residential ISP proxies across Indian regions. Rotation happens per request with sticky sessions where required. IP score monitoring prevents blacklisted pool contamination.

Cloud-Native Orchestration

Pipelines run on AWS Lambda and ECS. Airflow handles scheduling, dependency management, and SLA alerting. All state stored in managed Postgres.

Output & Delivery

Your data, your destination

Data delivered to where your team already works — no new tooling required.

JSON
Newline-delimited or nested array structures
CSV
Flat file with typed columns for tabular analysis
XLS
Excel format for business team consumption
Parquet
Columnar format for BigQuery, Snowflake, Athena
AWS S3
Direct bucket delivery compatible with any data lake
Webhook
HTTP POST per record for real-time workflows
API
Queryable REST endpoints for on-demand access
BigQuery
Streamed directly into your dataset with schema auto-detect
S3
Direct bucket delivery — compatible with any data lake
// faq

Common questions.

About mfine.co scraping, legality, and pipeline operations.

Ask us directly →
Is scraping MFine legal?

Scraping publicly available information from MFine is generally permissible under applicable law. DataFlirt targets only public, non-authenticated doctor profiles, lab test pricing, and pharmacy catalogues. We do not extract patient records, circumvent authentication walls, or violate privacy regulations.

How do you handle location-based pricing?

We inject specific pin codes into session cookies and API headers. This ensures the pipeline captures accurate hyperlocal pricing, doctor availability, and medicine stock for the exact regions you target.

Can you track doctor availability?

Yes. The pipeline extracts the next available consultation slots for each doctor, allowing you to monitor provider capacity and demand trends over time.

What pharmacy data is available?

We extract medicine names, manufacturers, active ingredients, packaging sizes, MRP, selling prices, discount percentages, and prescription requirements across the entire catalogue.

How fresh is the data?

Pipelines can be configured for daily, weekly, or monthly cadences. Full catalogue refreshes typically complete within a 6 to 12 hour window depending on the target scope.

How do you handle rate limits?

We use Indian residential proxy pools, rotate IPs per request, and enforce strict concurrency limits. Our request timing is modelled on human behaviour to prevent triggering automated rate limiters.

Can I request a sample dataset before committing?

Yes. We provide a sample run of up to 500 records as part of the pre-engagement scoping process so you can validate schema fit and data quality before signing a contract.

$ dataflirt scope --new-project --source=mfine.co ready

Tell us what
to extract.
We do the rest.

20-minute scoping call. Pilot dataset within the week. Production within two. Whether you need a one-off extraction of doctor profiles or a continuous price-monitoring feed for lab tests, we scope, build, and operate the pipeline. Tell us what you need.

hello@dataflirt.com · Bengaluru · IST · typical reply < 4h
Related Scrapers

More in healthcare pharmacy doctors

Services

Data Extraction for Every Industry

View All Services →