SYSTEM all green source mhada.gov.in queue 1,492 documents p99 latency 842ms dataflirt.com · scraper/mhada-gov
RUN : 14 active pipelines : mhada.gov.in live

MHADA housing data,
at warehouse scale.

We extract lottery schemes, winner lists, waitlists, project specifications, and pricing from mhada.gov.in. Delivered as clean JSON, CSV, or Parquet to S3, BigQuery, or Snowflake on your cadence.

Lottery results parsed
412K /run
Projects tracked
1,284 /24h
PDFs extracted
8,492 /run
Active pipelines
14
Uptime
99.85%
Data Dictionary

Every field we extract from mhada.gov.in

Structured, schema-consistent data across all major object types — delivered clean, typed, and ready to query.

Complete list of extractable fields for Lottery Schemes objects from mhada.gov.in. All fields typed and schema-versioned.

scheme_codeboard_namescheme_nameincome_grouptotal_tenementscarpet_area_sqmbase_costemd_amountstart_dateend_datelocation_zone
lottery_schemes
● 200 OK
"scheme_code": "281",
"board_name": "Mumbai Board",
"scheme_name": "Pahari Goregaon",
"income_group": "MIG",
"total_tenements": 227,
"carpet_area_sqm": 65.4,
"base_cost": 6850000.0,
"emd_amount": 50000.0
# scheme_codeboard_namescheme_nameincome_grouptotal_tenementscarpet_area_sqm
1
2
3

Complete list of extractable fields for Winner Lists objects from mhada.gov.in. All fields typed and schema-versioned.

applicant_numberapplicant_namescheme_codecategorypriority_numberflat_numberbuilding_namestatusdraw_datepdf_source_url
winner_lists
● 200 OK
"applicant_number": "1180054321",
"applicant_name": "Ramesh Kumar Patil",
"scheme_code": "281",
"category": "General",
"priority_number": 14,
"flat_number": "B-402",
"status": "Winner",
"draw_date": "2025-08-14"
# applicant_numberapplicant_namescheme_codecategorypriority_numberflat_number
1
2
3

Complete list of extractable fields for Waitlists objects from mhada.gov.in. All fields typed and schema-versioned.

applicant_numberapplicant_namescheme_codecategorywaitlist_numberstatusdraw_dateremarksboard_namepdf_source_url
waitlists
● 200 OK
"applicant_number": "1180058992",
"applicant_name": "Sneha Desai",
"scheme_code": "281",
"category": "SC",
"waitlist_number": 3,
"status": "Waitlisted",
"draw_date": "2025-08-14",
"board_name": "Mumbai Board"
# applicant_numberapplicant_namescheme_codecategorywaitlist_numberstatus
1
2
3

Complete list of extractable fields for Project Details objects from mhada.gov.in. All fields typed and schema-versioned.

project_idboardlocationpincodetotal_flatsavailable_flatsrera_numbercontractorcompletion_dateamenitiesgps_coordinates
project_details
● 200 OK
"project_id": "PRJ-9921",
"board": "Pune Board",
"location": "Pimpri Chinchwad",
"pincode": "411018",
"total_flats": 1200,
"available_flats": 450,
"rera_number": "P52100004512",
"completion_date": "2026-12-31"
# project_idboardlocationpincodetotal_flatsavailable_flats
1
2
3

Complete list of extractable fields for Board Announcements objects from mhada.gov.in. All fields typed and schema-versioned.

circular_idboard_nametitledate_publishedpdf_urlcategorylanguageis_activescraped_at
board_announcements
● 200 OK
"circular_id": "CIR-2025-042",
"board_name": "Konkan Board",
"title": "Extension of EMD Payment Deadline",
"date_published": "2025-07-10",
"pdf_url": "https://mhada.gov.in/documents/cir-042.pdf",
"category": "Notification",
"language": "Marathi",
"is_active": true
# circular_idboard_nametitledate_publishedpdf_urlcategory
1
2
3

Capabilities

Extract structured housing data from government portals

Our MHADA pipeline converts unstructured PDFs, nested ASP.NET tables, and bilingual announcements into clean, queryable databases. We handle the server timeouts so you do not have to.

PDF Result Parsing

MHADA publishes winner and waitlist results as unstructured PDFs. We use OCR and spatial parsing to convert these documents into structured tabular data.

Scheme & Project Tracking

Extract base costs, EMD amounts, carpet areas, and total tenements for every active and historical housing scheme across all regional boards.

Applicant List Extraction

Capture applicant names, application numbers, categories, and priority statuses from published accepted and rejected lists.

Regional Board Monitoring

Track schemes across Mumbai, Pune, Konkan, Nashik, Aurangabad, Amravati, and Nagpur boards from a single normalised schema.

Income Group Filtering

Categorise properties by Economically Weaker Section (EWS), Low Income Group (LIG), Middle Income Group (MIG), and High Income Group (HIG).

RERA Number Matching

Extract MahaRERA registration numbers from project brochures to cross-reference with official state real estate regulatory data.

Historical Data Archiving

Access past lottery results and pricing data to build time-series models of affordable housing demand in Maharashtra.

Marathi Text Normalisation

Handle bilingual content gracefully. We map Marathi location names and categories to standardized English equivalents for easier querying.

Scheduled Updates

Run daily diffs during active lottery periods to capture new circulars, deadline extensions, and updated applicant lists immediately.

// engagement pipeline

From government portal to warehouse record

Brief in. Clean data out.

Define Scope
d 0

Specify the regional boards, lottery years, or specific data points (e.g. winner lists vs project specs) you require.

Pipeline Build
d 2–4

We configure Scrapy crawlers, PDF extraction modules, and retry logic to handle mhada.gov.in server instability.

Validation & QA
d 4–6

Schema validation, null-rate checks, and PDF parsing accuracy verification before full pipeline launch.

Delivery
ongoing

JSON, CSV, or Parquet pushed to your S3 bucket, BigQuery dataset, or Snowflake stage on agreed cadence.

Under the hood

How our MHADA pipeline handles the hard parts

Government websites present unique extraction challenges. Here is how we ensure reliable data delivery from mhada.gov.in.

pipeline-monitor · mhada.gov.in · live ● active
// fingerprinting
Identity rotation
TLS fingerprintrandomised
User-agentrotated
IP poolresidential
Challenges blocked0
// pagination
Page coverage
48,291 pages queued running
// observability
Pipeline health
99.9%
uptime
142ms
p99 lat
0.3%
null rate
2
alerts
PDF Parsing at Scale
Extracting tabular data from unstructured results

MHADA publishes lottery results as massive PDF files, often with misaligned columns or scanned pages. We utilize spatial OCR and machine learning models to reconstruct these PDFs into clean, relational tables mapping applicants to flat numbers.

Server Instability
Handling 503s and timeouts during draw days

During lottery announcements, mhada.gov.in frequently crashes or throttles connections. Our infrastructure employs exponential backoff, distributed request queuing, and low-concurrency polling to ensure we capture the data without overwhelming the target servers.

Session Management
Navigating ASP.NET ViewStates

The portal relies heavily on complex ASP.NET ViewStates and session cookies for pagination and form submissions. We maintain persistent Playwright sessions that correctly pass these hidden tokens, preventing session drops mid-extraction.

Language Normalisation
Bilingual data handling

Circulars and project details are often published in Marathi, English, or a mix of both. We capture the raw text and apply normalisation dictionaries to standardize locations, categories, and statuses across the dataset.

Change Detection
Only pushing new circulars

We maintain a hash index of all previously scraped circulars and lists. Subsequent runs only extract and deliver new documents, saving you from processing duplicate PDFs and reducing downstream compute costs.

Applications

Who uses MHADA data and how

Teams across industries use mhada.gov.in data to build competitive products and smarter operations.

01
Real Estate Market Analysis

Analysts track base costs and total applications across income groups to gauge localized demand for affordable housing in specific micro-markets.

02
Financial Services & Lending

Banks and NBFCs ingest winner lists to identify pre-qualified leads for home loans and mortgage products immediately after a lottery draw.

03
Policy Research

Urban development researchers analyze historical lottery data to study housing supply deficits and demographic shifts across Maharashtra.

04
Competitor Benchmarking

Private real estate developers monitor MHADA project specifications and pricing to competitively position their own upcoming affordable housing projects.

05
Secondary Market Brokerage

Real estate brokers track waitlists and winners to facilitate secondary market transactions once lock-in periods expire.

06
Aggregator Portals

Property listing websites integrate MHADA scheme details via our API to provide comprehensive new-launch coverage to their users.

Why DataFlirt

"MHADA holds the definitive dataset for affordable housing demand in Maharashtra, but the data is locked in unstructured PDFs and slow government portals."

Extracting data from mhada.gov.in requires navigating unpredictable server uptimes, complex ASP.NET session states, and thousands of unstructured PDF result sheets. DataFlirt handles the OCR, table extraction, and retry logic so your team gets clean, queryable real estate data without the operational overhead.

Technical Spec

MHADA scraper technical capabilities

Everything supported by our mhada.gov.in scraper — rendered SPA elements, auth walls, rate-limit evasion and beyond.

PDF table extraction
Spatial OCR and table reconstruction for lottery result documents
Supported
Marathi text normalisation
Standardises regional location names and categories to English
Supported
ASP.NET ViewState handling
Maintains hidden form tokens required for deep pagination
Supported
Historical lottery archives
Extraction of past scheme data and previous winner lists
Supported
Automated retry on 503/504
Exponential backoff designed for unstable government servers
Supported
RERA ID extraction
Captures MahaRERA numbers from project brochures
Supported
Change detection (diffs)
Hash-based diffing to only emit new circulars and lists
Supported
Applicant login portal
Personal applicant dashboards and uploaded KYC documents
Partial
Payment gateway transactions
Live EMD payment verification and banking details
Partial
Infrastructure

Infrastructure powering the MHADA pipeline

Open-source tooling on proven cloud infra — no vendor lock-in, full observability.

ScrapyPlaywrightPython 3.12RedisPostgreSQLApache AirflowAWS LambdaS3CloudWatch2CaptchaCapSolverResidential ProxiesDockerKubernetesGrafanaPrometheusAWS Textract
Machine Learning OCR

We integrate AWS Textract and custom vision models to parse highly irregular PDF tables, converting visual columns into structured JSON arrays.

Resilient Crawl Logic

Scrapy combined with Playwright handles the complex ASP.NET navigation, while custom middleware manages the frequent connection drops typical of government infrastructure.

Cloud-Native Orchestration

Pipelines run on Kubernetes. Airflow orchestrates the sequential extraction, PDF downloading, and OCR processing steps, ensuring strict dependency management.

Output & Delivery

Your data, your destination

Data delivered to where your team already works — no new tooling required.

JSON
Nested arrays mapping schemes to applicants
CSV
Flat files perfect for Excel or Pandas analysis
XLS
Direct Excel exports for non-technical teams
Parquet
Columnar format optimized for BigQuery and Athena
AWS S3
Direct bucket delivery of both data and raw PDFs
Webhook
HTTP POST notifications when new circulars drop
API
REST endpoints to query historical scheme data
BigQuery
Streamed directly into your GCP environment
Snowflake
Stage and COPY INTO workflow for data warehouses
PostgreSQL
Direct upserts into your existing relational schema
S3
Direct bucket delivery — compatible with any data lake
// faq

Common questions.

About mhada.gov.in scraping, legality, and pipeline operations.

Ask us directly →
Is scraping mhada.gov.in legal?

Scraping publicly available information, such as published lottery results and scheme details, is generally permissible. DataFlirt targets only public, non-authenticated data. We do not bypass applicant login walls or extract private KYC documents. Clients should consult legal counsel regarding their specific data usage.

How do you handle the PDF result files?

We download the raw PDFs and process them through our OCR and spatial parsing pipeline. This converts the visual tables into structured rows and columns, mapping applicant names to flat numbers and waitlist positions.

Can you extract data during the live lottery draw?

Live draws often cause severe server instability on mhada.gov.in. We queue requests and employ exponential backoff. While we extract data as fast as the server allows, absolute real-time delivery during peak crashes is limited by the source hardware.

Do you provide the original PDF files?

Yes. Alongside the structured JSON or CSV data, we can deliver the raw source PDFs to your S3 bucket for compliance and verification purposes.

Which regional boards do you support?

We extract data across all MHADA regional boards, including Mumbai, Pune, Konkan, Nashik, Nagpur, Amravati, and Aurangabad.

How do you handle Marathi text?

We capture the original Marathi text and apply a normalisation layer to map standard terms, locations, and categories to English, ensuring your database remains consistent and queryable.

Can I get historical lottery data?

Yes. We can run one-off historical extraction pipelines to pull past schemes, pricing, and result lists that are still accessible in the portal archives.

$ dataflirt scope --new-project --source=mhada.gov.in ready

Tell us what
to extract.
We do the rest.

20-minute scoping call. Pilot dataset within the week. Production within two. Stop manually downloading PDFs and fighting server timeouts. Let DataFlirt deliver clean, structured Maharashtra housing data directly to your warehouse.

hello@dataflirt.com · Bengaluru · IST · typical reply < 4h
Related Scrapers

More in real estate

Services

Data Extraction for Every Industry

View All Services →