SYSTEM all green source landregistry.gov.uk queue 12,842 records p99 latency 312ms dataflirt.com · scraper/landregistry-gov.uk
RUN . 31 active pipelines . landregistry.gov.uk live

Land Registry data,
at warehouse scale.

We extract Price Paid Data (PPD), corporate ownership records, and title indices from HM Land Registry. Delivered as clean JSON, CSV, or Parquet to S3, BigQuery, or Snowflake on your cadence.

PPD records
1.2M /month
Corporate titles
85K /run
Polygon coordinates
3.4M /week
Active pipelines
31
Uptime
99.94%
Data Dictionary

Every field we extract from landregistry.gov.uk

Structured, schema-consistent data across all major object types — delivered clean, typed, and ready to query.

Complete list of extractable fields for Price Paid Data (PPD) objects from landregistry.gov.uk. All fields typed and schema-versioned.

transaction_idpricedate_of_transferpostcodeproperty_typeold_newdurationpaonsaonstreetlocalitytown_citydistrictcountyppd_category_typerecord_status
price_paid data (ppd)
● 200 OK
"transaction_id": "{8A9B3C4D-5E6F-7A8B-9C0D-1E2F3A4B5C6D}",
"price": 450000,
"date_of_transfer": "2023-11-14",
"postcode": "SW1A 1AA",
"property_type": "T",
"old_new": "N",
"duration": "F",
"town_city": "LONDON",
"county": "GREATER LONDON"
# transaction_idpricedate_of_transferpostcodeproperty_typeold_new
1
2
3

Complete list of extractable fields for Corporate Ownership objects from landregistry.gov.uk. All fields typed and schema-versioned.

title_numberproperty_addresstenureproprietor_nameproprietor_addresscompany_registration_numbercountry_of_incorporationdate_proprietor_addedadditional_info
corporate_ownership
● 200 OK
"title_number": "NGL123456",
"tenure": "Freehold",
"proprietor_name": "ACME PROPERTY HOLDINGS LTD",
"company_registration_number": "12345678",
"country_of_incorporation": "UNITED KINGDOM",
"date_proprietor_added": "2018-05-22"
# title_numberproperty_addresstenureproprietor_nameproprietor_addresscompany_registration_number
1
2
3

Complete list of extractable fields for Title Register Index objects from landregistry.gov.uk. All fields typed and schema-versioned.

title_numberaddresspostcodeuprntenure_typelocal_authorityregionmap_referenceindex_polygon_id
title_register index
● 200 OK
"title_number": "AGL987654",
"address": "14 High Street, Manchester",
"postcode": "M1 1AA",
"uprn": "100023456789",
"tenure_type": "Leasehold",
"local_authority": "Manchester City Council"
# title_numberaddresspostcodeuprntenure_typelocal_authority
1
2
3

Complete list of extractable fields for Spatial Data (Polygons) objects from landregistry.gov.uk. All fields typed and schema-versioned.

inspire_idgeometry_typecoordinatescrsbounding_boxarea_sqmtitle_numberupdate_date
spatial_data (polygons)
● 200 OK
"inspire_id": "12345678",
"geometry_type": "Polygon",
"crs": "EPSG:27700",
"area_sqm": 145.2,
"title_number": "NGL123456",
"update_date": "2023-12-01"
# inspire_idgeometry_typecoordinatescrsbounding_boxarea_sqm
1
2
3

Complete list of extractable fields for Transaction Trends objects from landregistry.gov.uk. All fields typed and schema-versioned.

postcode_sectoraverage_pricetransaction_volumeproperty_type_breakdownnew_build_premiumyoy_growthmonthyear
transaction_trends
● 200 OK
"postcode_sector": "SW1A 1",
"average_price": 1250000,
"transaction_volume": 14,
"new_build_premium": 0.12,
"yoy_growth": 0.04,
"month": 11,
"year": 2023
# postcode_sectoraverage_pricetransaction_volumeproperty_type_breakdownnew_build_premiumyoy_growth
1
2
3

Capabilities

Everything you need from HM Land Registry

Our Land Registry scraper handles the complexity of UK property data: inconsistent address formats, spatial polygon transformations, and monthly incremental updates.

Price Paid Data Extraction

Extract full historical PPD datasets with monthly incremental updates to track real property transaction values.

Corporate Ownership Tracking

Monitor UK and overseas corporate property ownership using company registration numbers and proprietor records.

UPRN Resolution

Map HM Land Registry records to Unique Property Reference Numbers for interoperability with other UK government datasets.

Spatial Polygon Parsing

Extract and normalise INSPIRE index polygons into standard GeoJSON formats for immediate GIS integration.

Leasehold & Freehold Segmentation

Identify tenure types and track leasehold transaction volumes across specific postcode districts.

New Build Premiums

Isolate new build transactions to calculate regional premiums and track development activity.

Change Detection

Only emit new transactions, deletions, or ownership changes to keep your warehouse state perfectly synced.

Scheduled Updates

Run bulk historical exports or continuous monthly diffs aligned with the Land Registry publication schedule.

Postcode Sector Aggregation

Compute aggregated transaction metrics at the postcode district level for macroeconomic analysis.

// engagement pipeline

From target area to warehouse record

Brief in. Clean data out.

Define Scope
d 0

Provide postcodes, bounding boxes, or corporate entities. We design the extraction schema together.

Pipeline Build
d 2–4

We configure Scrapy crawlers, spatial data parsers, and rate-limit handling for landregistry.gov.uk.

Validation & QA
d 4–6

Schema validation, null-rate checks, and spatial coordinate verification before full launch.

Delivery
ongoing

JSON / CSV / Parquet pushed to your S3 bucket, BigQuery dataset, or Snowflake stage on agreed cadence.

Under the hood

How our Land Registry pipeline handles the hard parts

UK property data is notoriously messy. Here is how we normalise the output and manage extraction pipelines.

pipeline-monitor · landregistry.gov.uk · live ● active
// fingerprinting
Identity rotation
TLS fingerprintrandomised
User-agentrotated
IP poolresidential
Challenges blocked0
// pagination
Page coverage
48,291 pages queued running
// observability
Pipeline health
99.9%
uptime
142ms
p99 lat
0.3%
null rate
2
alerts
Rate limit management
Distributed request architecture

HM Land Registry endpoints enforce strict request quotas. We distribute requests across IP pools and regulate concurrency to ensure 100% extraction success without triggering blocks.

Spatial data normalisation
Automated CRS transformations

INSPIRE polygons require coordinate reference system transformations. We convert British National Grid (EPSG:27700) to standard WGS84 (EPSG:4326) GeoJSON automatically.

Address standardisation
Cleaning PAON and SAON fields

Property address fields often lack consistency. We normalise Primary Addressable Object Name and Secondary Addressable Object Name strings to match standard UK address formats.

Incremental diffing
Handling monthly state changes

Monthly PPD updates contain additions, changes, and deletions. We handle state resolution so your database reflects accurate historical truth without duplicate records.

Monitoring & alerting
Pipeline health observability

Every run emits structured logs to our observability stack. We alert on null-rate spikes or missing geographic data before the payload reaches your warehouse.

Applications

Who uses Land Registry data and how

Teams across industries use landregistry.gov.uk data to build competitive products and smarter operations.

01
Automated Valuation Models

AVMs ingest historical PPD to train pricing algorithms and estimate current property values.

02
PropTech Market Analysis

Analyse transaction volumes and yield compressions across postcodes to identify investment hotspots.

03
Corporate Due Diligence

Identify ultimate beneficial owners and aggregate corporate property portfolios for risk assessment.

04
Site Sourcing & Development

Overlay spatial polygons with ownership data to identify viable development plots and assemble sites.

05
Mortgage Risk Assessment

Track local market liquidity and new build premiums to calibrate lending criteria and LTV ratios.

06
Academic & Economic Research

Analyse macroeconomic housing trends and policy impacts on transaction volumes over time.

Why DataFlirt

"HM Land Registry holds the definitive record of UK property transactions and ownership, but extracting clean, queryable datasets requires significant engineering effort."

Most teams underestimate the complexity of UK property data. Parsing inconsistent address fields, handling monthly state changes in Price Paid Data, and transforming spatial polygons into usable GeoJSON requires dedicated infrastructure. DataFlirt absorbs this complexity so your analysts can focus on market trends, not data engineering.

Technical Spec

Land Registry scraper technical capabilities

Everything supported by our landregistry.gov.uk scraper — rendered SPA elements, auth walls, rate-limit evasion and beyond.

Price Paid Data (PPD) extraction
Full historical datasets and monthly incremental files
Supported
Corporate & overseas ownership
Company registration numbers and proprietor names
Supported
INSPIRE index polygons
Spatial boundary data for registered titles
Supported
UPRN mapping
Cross-reference titles with Unique Property Reference Numbers
Supported
Incremental monthly updates
State resolution for additions, changes, and deletions
Supported
Address normalisation
Standardised PAON, SAON, and street strings
Supported
GeoJSON transformation
Convert BNG to WGS84 coordinates automatically
Supported
Full Title Register PDF downloads
Requires 3 GBP statutory fee per document and account credentials
Partial
Official Title Plan maps
Requires 3 GBP statutory fee per document and account credentials
Partial
Infrastructure

Infrastructure powering the Land Registry pipeline

Open-source tooling on proven cloud infra — no vendor lock-in, full observability.

ScrapyPlaywrightPython 3.12RedisPostgreSQLApache AirflowAWS LambdaS3CloudWatch2CaptchaCapSolverResidential ProxiesDockerKubernetesGrafanaPrometheusPostGISGeoPandas
Scrapy Extraction Stack

Scrapy handles crawl orchestration, deduplication, and retry logic to process millions of property records efficiently.

Spatial Data Processing

We use GeoPandas and PostGIS to process, transform, and validate INSPIRE polygon coordinates before delivery.

Cloud-Native Orchestration

Pipelines run on AWS Lambda and ECS. Airflow handles scheduling and dependency management for monthly PPD updates.

Output & Delivery

Your data, your destination

Data delivered to where your team already works — no new tooling required.

JSON
Newline-delimited or nested objects
CSV
Flat file with typed columns
XLS
Excel compatible format for smaller extracts
Parquet
Columnar format for BigQuery, Snowflake, Athena
AWS S3
Direct bucket delivery
Webhook
HTTP POST per record for real-time processing
API
REST endpoints to query extracted datasets
PostgreSQL
Upsert into your existing schema
S3
Direct bucket delivery — compatible with any data lake
// faq

Common questions.

About landregistry.gov.uk scraping, legality, and pipeline operations.

Ask us directly →
Is extracting data from HM Land Registry legal?

Extracting public Price Paid Data and open datasets from HM Land Registry is permissible under the Open Government Licence (OGL). DataFlirt targets only public, non-authenticated records. We do not extract restricted personal data or bypass statutory fee walls.

How fresh is the data?

Price Paid Data is updated monthly by HM Land Registry. Our pipelines sync and process the incremental updates within 24 hours of publication.

Can you get full title registers?

No. Full title registers require a statutory fee per document and authenticated access. We extract public indices, corporate ownership open data, and PPD.

Do you handle spatial data?

Yes. We extract INSPIRE index polygons and convert them from British National Grid coordinates to standard WGS84 GeoJSON for immediate use in mapping tools.

Can I search by corporate owner?

Yes. We can extract property portfolios based on company registration numbers or proprietor names using the commercial and corporate ownership datasets.

How do you handle address inconsistencies?

We standardise Primary Addressable Object Name (PAON), Secondary Addressable Object Name (SAON), and street fields to match standard UK formats.

$ dataflirt scope --new-project --source=landregistry.gov.uk ready

Tell us what
to extract.
We do the rest.

20-minute scoping call. Pilot dataset within the week. Production within two. Whether you need a one-off historical PPD dump or continuous monthly updates across the UK, we scope, build, and operate the pipeline. Tell us what you need.

hello@dataflirt.com · Bengaluru · IST · typical reply < 4h
Related Scrapers

More in real estate

Services

Data Extraction for Every Industry

View All Services →