SYSTEM all green source ritchiebros.com queue 12,409 lots p99 latency 218ms dataflirt.com · scraper/ritchiebros-com
RUN · 38 active pipelines · ritchiebros.com live

Heavy equipment data,
at warehouse scale.

We extract upcoming auction lots, historical price realisations, equipment specifications, and condition reports from Ritchie Bros. Delivered as clean JSON, CSV, or Parquet to S3, BigQuery, or Snowflake on your cadence.

Lots extracted
42.1K /run
Auction results
1.8M /month
Equipment images
315K /day
Active pipelines
38
Uptime
99.94%
Data Dictionary

Every field we extract from ritchiebros.com

Structured, schema-consistent data across all major object types — delivered clean, typed, and ready to query.

Complete list of extractable fields for Upcoming Lots objects from ritchiebros.com. All fields typed and schema-versioned.

lot_numberauction_idauction_locationauction_datemakemodelyearequipment_groupmeter_readingserial_numbercurrent_biditem_url
upcoming_lots
● 200 OK
"lot_number": "142A",
"make": "Caterpillar",
"model": "D8T",
"year": 2018,
"meter_reading": "4,512 hours",
"auction_location": "Orlando, FL",
"current_bid": 125000.0
# lot_numberauction_idauction_locationauction_datemakemodel
1
2
3

Complete list of extractable fields for Auction Results objects from ritchiebros.com. All fields typed and schema-versioned.

result_idlot_numberauction_dateselling_pricecurrencybuyer_locationmakemodelyearserial_number
auction_results
● 200 OK
"selling_price": 245000.0,
"currency": "USD",
"make": "Komatsu",
"model": "PC210LC-11",
"year": 2020,
"auction_date": "2023-11-14",
"buyer_location": "Texas, USA"
# result_idlot_numberauction_dateselling_pricecurrencybuyer_location
1
2
3

Complete list of extractable fields for Equipment Specs objects from ritchiebros.com. All fields typed and schema-versioned.

item_idcategorysub_categoryengine_makeengine_modelgross_poweroperating_weighttrack_widthbucket_capacitydimensions
equipment_specs
● 200 OK
"category": "Excavators",
"operating_weight": "49,600 lb",
"engine_make": "Cummins",
"gross_power": "165 hp",
"track_width": "31.5 in",
"bucket_capacity": "1.5 yd3"
# item_idcategorysub_categoryengine_makeengine_modelgross_power
1
2
3

Complete list of extractable fields for Condition Reports objects from ritchiebros.com. All fields typed and schema-versioned.

report_iditem_idoverall_ratingengine_conditiontransmission_conditionhydraulic_systemundercarriageexterior_damageironclad_assuranceinspector_notes
condition_reports
● 200 OK
"overall_rating": 4.2,
"engine_condition": "Good",
"hydraulic_system": "Minor leaks detected",
"ironclad_assurance": true,
"undercarriage": "50% remaining",
"exterior_damage": "Scratches on counterweight"
# report_iditem_idoverall_ratingengine_conditiontransmission_conditionhydraulic_system
1
2
3

Complete list of extractable fields for Locations & Yards objects from ritchiebros.com. All fields typed and schema-versioned.

yard_idfacility_nameaddresscitystatecountrypostal_codelatitudelongitudecontact_phoneupcoming_auctions_count
locations_& yards
● 200 OK
"facility_name": "Orlando Auction Site",
"city": "Davenport",
"state": "FL",
"country": "USA",
"latitude": 28.2435,
"longitude": -81.6321,
"upcoming_auctions_count": 3
# yard_idfacility_nameaddresscitystatecountry
1
2
3

Capabilities

Complete heavy equipment intelligence

Our Ritchie Bros scraper extracts complex auction data across thousands of equipment categories, normalising specifications, meter readings, and condition reports into structured formats.

Full Lot Extraction

Extract make, model, year, meter, and serial numbers across all heavy equipment categories.

Historical Pricing

Capture final auction results and price realisations to build residual value models.

Condition Report Parsing

Extract IronClad Assurance data, component ratings, and inspector notes.

Meter & Usage Data

Normalise hour meter and odometer readings for precise valuation modelling.

Auction Calendar Tracking

Monitor upcoming sales, yard locations, and lot additions in real-time.

Image & Document Scraping

Download high-resolution equipment photos and PDF inspection reports to S3.

Cross-Platform Unification

Merge data from Ritchie Bros and IronPlanet listings into a single schema.

Serial Number Validation

Extract and structure VINs and PINs for fleet tracking and history verification.

Scheduled Modes

Run one-off bulk exports or configure continuous pipelines at daily cadences.

// engagement pipeline

From auction list to warehouse record

Brief in. Clean data out.

Define Scope
d 0

Provide target categories, auction locations, or specific makes. We design the extraction schema together.

Pipeline Build
d 2–4

We configure Scrapy / Playwright crawlers, proxy rotation, session management, and CAPTCHA handling for ritchiebros.com.

Validation & QA
d 4–6

Schema validation, null-rate checks, price-outlier detection, and sample reviews before full launch.

Delivery
ongoing

JSON / CSV / Parquet pushed to your S3 bucket, BigQuery dataset, or Snowflake stage on agreed cadence.

Under the hood

How our Ritchie Bros pipeline handles the hard parts

Heavy equipment data is highly unstructured and gated by complex search interfaces. Here is how we maintain reliable extraction.

pipeline-monitor · ritchiebros.com · live ● active
// fingerprinting
Identity rotation
TLS fingerprintrandomised
User-agentrotated
IP poolresidential
Challenges blocked0
// pagination
Page coverage
48,291 pages queued running
// observability
Pipeline health
99.9%
uptime
142ms
p99 lat
0.3%
null rate
2
alerts
Anti-bot layer
Residential proxy rotation and fingerprint spoofing

Ritchie Bros uses strict rate limiting and perimeter defenses. Our crawlers use residential ISP proxies with realistic browser fingerprints and full cookie session management to maintain access.

JavaScript rendering
Full Playwright execution for dynamic lots

Auction lot details and image galleries are heavily JavaScript-rendered. We run full Playwright browser sessions to capture dynamic content that headless HTTP clients miss.

Schema normalisation
Handling unstructured equipment specs

Heavy machinery specifications vary wildly between a bulldozer and a crane. We normalise specs into a structured JSON schema, extracting distinct attributes like operating weight and engine power.

Pagination & Search
Deep traversal of auction catalogues

Large auctions contain thousands of lots spread across complex filter views. Our crawlers systematically traverse all pagination states and category trees to ensure zero dropped records.

Change detection
Only re-scrape modified lots

For upcoming auctions, we maintain a hash index of last-seen values per lot. Subsequent runs only push diffs for bid updates or added lots, reducing compute cost.

Applications

Who uses Ritchie Bros data and how

Teams across industries use ritchiebros.com data to build competitive products and smarter operations.

01
Residual Value Modelling

Financial institutions use historical auction results to calculate depreciation curves and residual values for heavy machinery.

02
Fleet Procurement

Construction firms monitor upcoming auctions for specific makes and models to optimise capital expenditure.

03
Competitor Intelligence

OEMs and dealerships track secondary market pricing for their equipment versus competitors.

04
Market Trend Analysis

Analysts track volume and price realisations across equipment categories to gauge construction sector health.

05
Asset Valuation

Appraisers use recent comparable sales from Ritchie Bros to value existing fleets for insurance or liquidation.

06
Equipment Arbitrage

Dealers identify pricing disparities between regional auctions to buy low and transport to higher-demand markets.

Why DataFlirt

"Ritchie Bros holds the definitive dataset for heavy equipment valuation, but extracting structured, historical pricing requires navigating complex, dynamic auction interfaces."

Most teams underestimate the investment required: reliable Ritchie Bros scraping requires residential proxies, full JavaScript rendering for condition reports, and complex schema normalisation across thousands of equipment types. DataFlirt absorbs that complexity so your engineers can focus on the analysis, not the infrastructure.

Technical Spec

Ritchie Bros scraper technical capabilities

Everything supported by our ritchiebros.com scraper — rendered SPA elements, auth walls, rate-limit evasion and beyond.

JavaScript rendering
Full Playwright sessions for dynamic lot data and image galleries
Supported
Residential proxy rotation
ISP-grade residential IPs rotated per request
Supported
Historical auction results
Extraction of past sales data and price realisations
Supported
High-res image extraction
Direct download of equipment photos to S3
Supported
Condition report parsing
Structured extraction of IronClad Assurance ratings
Supported
Meter reading normalisation
Standardising hour and mile metrics
Supported
Change detection (diffs)
Hash-based diff for active auction monitoring
Supported
Gated historical pricing
Requires authenticated user session to view certain past auction results
Partial
Live bidding websockets
Real-time bid capture via authenticated websocket streams
Partial
Infrastructure

Infrastructure powering the Ritchie Bros pipeline

Open-source tooling on proven cloud infra — no vendor lock-in, full observability.

ScrapyPlaywrightPython 3.12RedisPostgreSQLApache AirflowAWS LambdaS3CloudWatch2CaptchaCapSolverResidential ProxiesDockerKubernetesGrafanaPrometheusSnowflake
Scrapy + Playwright Stack

Scrapy handles crawl orchestration and deduplication. Playwright handles JavaScript rendering and interaction flows for complex lot pages.

Residential Proxy Infrastructure

We maintain pools of residential ISP proxies. Rotation happens per-request with sticky sessions where required to bypass rate limits.

Cloud-Native Orchestration

Pipelines run on AWS Lambda and ECS. Airflow handles scheduling, dependency management, and SLA alerting. All state stored in managed Postgres.

Output & Delivery

Your data, your destination

Data delivered to where your team already works — no new tooling required.

JSON
Newline-delimited or nested schema
CSV
Flat file with typed columns
XLS
Excel compatible for analysts
Parquet
Columnar format for BigQuery and Snowflake
AWS S3
Direct bucket delivery
Webhook
HTTP POST per record
API
REST endpoints for on-demand querying
PostgreSQL
Direct database insertion
S3
Direct bucket delivery — compatible with any data lake
// faq

Common questions.

About ritchiebros.com scraping, legality, and pipeline operations.

Ask us directly →
Is scraping Ritchie Bros legal?

Scraping publicly available auction data is generally permissible under applicable law. DataFlirt targets only public, non-authenticated listings and specifications.

How do you handle bot detection?

We use residential ISP proxies, Playwright browser sessions with realistic fingerprints, and request timing modelled on human behaviour.

Can you extract historical auction results?

Yes, we extract publicly visible historical pricing and auction results, normalising the data for residual value modelling.

Do you capture condition reports?

Yes, we parse structured condition reports, including component ratings, inspector notes, and IronClad Assurance flags.

How do you handle different equipment types?

Our schema normalises core attributes like make, model, year, and meter reading, while retaining category-specific specifications in a nested JSON payload.

Can you download equipment images?

Yes, we can extract image URLs or download high-resolution assets directly to your S3 bucket, linked by lot ID.

What is the minimum viable engagement?

Our smallest packages start at scheduled extraction of specific auction events or categories. Contact us for a scoped quote.

$ dataflirt scope --new-project --source=ritchiebros.com ready

Tell us what
to extract.
We do the rest.

20-minute scoping call. Pilot dataset within the week. Production within two. Whether you need a historical pricing dump for valuation models or continuous monitoring of upcoming auctions, we scope, build, and operate the pipeline. Tell us what you need.

hello@dataflirt.com · Bengaluru · IST · typical reply < 4h
Related Scrapers

More in industrial and mro

Services

Data Extraction for Every Industry

View All Services →