SYSTEM all green source ironplanet.com queue 12,943 listings p99 latency 310ms dataflirt.com · scraper/ironplanet-com
RUN - 41 active pipelines - ironplanet.com live

Heavy equipment data,
at warehouse scale.

We extract machinery listings, IronClad inspection reports, meter readings, and bid histories from IronPlanet. Delivered as clean JSON, CSV, or Parquet to S3, BigQuery, or Snowflake on your cadence.

Listings extracted
14.2K /day
Bid updates
89.4K /24h
Inspection records
52.1K /run
Active pipelines
41
Uptime
99.94%
Data Dictionary

Every field we extract from ironplanet.com

Structured, schema-consistent data across all major object types — delivered clean, typed, and ready to query.

Complete list of extractable fields for Equipment Listings objects from ironplanet.com. All fields typed and schema-versioned.

item_idmakemodelyearcategorysub_categorymeter_readingmeter_typelocation_citylocation_stateauction_datecurrent_bidcurrencylisting_url
equipment_listings
● 200 OK
"item_id": "U392814",
"make": "Caterpillar",
"model": "320F L",
"year": 2017,
"category": "Excavators",
"meter_reading": 4821,
"meter_type": "Hours",
"current_bid": 65000.0,
"currency": "USD"
# item_idmakemodelyearcategorysub_category
1
2
3

Complete list of extractable fields for IronClad Inspections objects from ironplanet.com. All fields typed and schema-versioned.

item_idinspector_nameinspection_dateoverall_conditionengine_conditiontransmission_conditionhydraulics_conditionundercarriage_conditiontire_tread_remainingoil_leaksstructural_damageinspection_pdf_url
ironclad_inspections
● 200 OK
"item_id": "U392814",
"inspection_date": "2026-05-10",
"overall_condition": "Good",
"engine_condition": "Operational",
"hydraulics_condition": "No visible leaks",
"undercarriage_condition": "40% remaining",
"oil_leaks": false,
"structural_damage": false
# item_idinspector_nameinspection_dateoverall_conditionengine_conditiontransmission_condition
1
2
3

Complete list of extractable fields for Bid History objects from ironplanet.com. All fields typed and schema-versioned.

item_idauction_idbid_amountbid_timestampbidder_locationproxy_bidwinning_bidbid_incrementcurrency
bid_history
● 200 OK
"item_id": "U392814",
"auction_id": "A9921",
"bid_amount": 65000.0,
"bid_timestamp": "2026-05-12T14:32:11Z",
"bidder_location": "Texas, USA",
"proxy_bid": true,
"winning_bid": false,
"currency": "USD"
# item_idauction_idbid_amountbid_timestampbidder_locationproxy_bid
1
2
3

Complete list of extractable fields for Pricing & Results objects from ironplanet.com. All fields typed and schema-versioned.

item_idfinal_pricereserve_metbuyers_premiumtax_ratetotal_costsold_datecurrencyauction_type
pricing_& results
● 200 OK
"item_id": "U392814",
"final_price": 72500.0,
"reserve_met": true,
"buyers_premium": 7250.0,
"total_cost": 79750.0,
"sold_date": "2026-05-13",
"currency": "USD",
"auction_type": "Unreserved"
# item_idfinal_pricereserve_metbuyers_premiumtax_ratetotal_cost
1
2
3

Complete list of extractable fields for Seller & Logistics objects from ironplanet.com. All fields typed and schema-versioned.

item_idseller_typeseller_ratinglocation_citylocation_statelocation_countryshipping_optionsloading_assistancepickup_windowcustoms_cleared
seller_& logistics
● 200 OK
"item_id": "U392814",
"seller_type": "Fleet Owner",
"location_city": "Houston",
"location_state": "TX",
"location_country": "USA",
"loading_assistance": "Available",
"pickup_window": "14 days",
"customs_cleared": true
# item_idseller_typeseller_ratinglocation_citylocation_statelocation_country
1
2
3

Capabilities

Everything you need from IronPlanet

Our IronPlanet scraper handles the complexities of auction platforms: high-frequency bid updates, deeply nested inspection reports, and dynamic inventory catalogues.

Heavy Machinery Specs

Extract make, model, year, VIN, serial numbers, and detailed operational specifications for every asset.

IronClad Inspection Data

Parse condition ratings across engine, transmission, hydraulics, and undercarriage systems directly from inspection nodes.

Live Bid Tracking

Monitor current bids, bid increments, and proxy bidding activity leading up to the auction close.

Final Auction Results

Capture final hammer prices, reserve status, and buyer premiums to build accurate valuation models.

Meter & Usage Data

Extract hours, miles, and operational metrics critical for residual value calculations.

Location & Logistics

Map where the equipment sits, available loading assistance, and mandatory pickup windows.

Multimedia Extraction

Capture URLs for high-resolution photos, operational videos, and downloadable inspection PDFs.

Certification Parsing

Identify EPA, CE, and regional emissions compliance status for cross-border equipment trading.

Category Taxonomy

Map listings to precise industrial categories and sub-categories for structured catalogue integration.

Change Detection

Diff listings across frequent polling intervals to capture bid updates without redundant data transfer.

// engagement pipeline

From equipment list to warehouse record

Brief in. Clean data out.

Define Scope
d 0

Provide asset categories, target makes, or specific auction dates. We design the extraction schema together.

Pipeline Build
d 2–4

We configure Scrapy / Playwright crawlers, proxy rotation, and session management for ironplanet.com.

Validation & QA
d 4–6

Schema validation, null-rate checks, and data type enforcement before full launch.

Delivery
ongoing

JSON / CSV / Parquet pushed to your S3 bucket, BigQuery dataset, or Snowflake stage on agreed cadence.

Under the hood

How our IronPlanet pipeline handles auction dynamics

Auction sites require high-frequency polling and complex state management. We handle the infrastructure so you get clean data.

pipeline-monitor · ironplanet.com · live ● active
// fingerprinting
Identity rotation
TLS fingerprintrandomised
User-agentrotated
IP poolresidential
Challenges blocked0
// pagination
Page coverage
48,291 pages queued running
// observability
Pipeline health
99.9%
uptime
142ms
p99 lat
0.3%
null rate
2
alerts
Anti-bot layer
Residential proxy rotation

IronPlanet employs bot detection to prevent aggressive scraping. Our crawlers use residential ISP proxies with realistic browser fingerprints and randomised request timing to maintain uninterrupted access.

JavaScript rendering
Playwright execution for dynamic bids

Bid histories and image galleries rely heavily on client-side rendering. We run full Playwright browser sessions to execute JavaScript, ensuring we capture real-time auction state.

Schema stability
Handling diverse equipment types

An excavator's specification sheet looks completely different from a sleeper truck's. Our extraction logic normalises diverse HTML structures into a consistent, queryable schema.

High-frequency polling
Capturing the final minutes

Auction action concentrates in the final minutes. We dynamically scale crawl concurrency based on time-to-close, ensuring you do not miss critical bid increments.

Media handling
Inspection report extraction

IronClad reports are often nested in complex UI components or PDFs. We traverse these nodes to extract structured condition data rather than just returning a document link.

Applications

Who uses IronPlanet data

Teams across industries use ironplanet.com data to build competitive products and smarter operations.

01
Residual Value Forecasting

Financial institutions use historical hammer prices and meter readings to build depreciation curves for heavy assets.

02
Fleet Valuation

Construction firms mark-to-market their existing fleet by comparing internal assets against live IronPlanet listings.

03
Dealer Arbitrage

Used equipment dealers monitor unreserved auctions to identify underpriced assets for regional arbitrage.

04
Market Trend Analysis

Analysts track supply volumes across specific equipment categories to gauge macroeconomic construction activity.

05
Competitor Pricing

OEMs monitor secondary market pricing to adjust new equipment incentives and trade-in values.

06
Insurance & Risk Modeling

Underwriters use condition reports and final sale prices to determine accurate replacement costs in claims processing.

Why DataFlirt

"IronPlanet holds the canonical dataset for used heavy equipment pricing, but extracting nested inspection reports and live bids requires specialized infrastructure."

Most teams fail at auction scraping because they cannot handle the high-frequency polling required during the final minutes of bidding, or the deep DOM traversal needed for IronClad inspection reports. DataFlirt absorbs that complexity so your analysts can focus on valuation models, not proxy rotation.

Technical Spec

IronPlanet scraper - technical capabilities

Everything supported by our ironplanet.com scraper — rendered SPA elements, auth walls, rate-limit evasion and beyond.

JavaScript rendering
Full Playwright sessions required for dynamic bid histories and image galleries
Supported
CAPTCHA bypass
Automated integration with CapSolver for uninterrupted extraction
Supported
Residential proxy rotation
ISP-grade residential IPs to prevent rate limiting during high-frequency polling
Supported
Bid history extraction
Capture full timestamped bid logs for every auction item
Supported
IronClad report parsing
Deep extraction of condition ratings across all mechanical systems
Supported
High-res image URLs
Extraction of primary and gallery image assets
Supported
Change detection
Hash-based diffs to track bid changes without redundant payload delivery
Supported
Post-auction buyer identity
Buyer names and contact information are protected by the platform
Partial
Private reserve prices
Hidden reserve thresholds are strictly server-side and cannot be scraped
Partial
Infrastructure

Infrastructure powering the IronPlanet pipeline

Open-source tooling on proven cloud infra — no vendor lock-in, full observability.

ScrapyPlaywrightPython 3.12RedisPostgreSQLApache AirflowAWS LambdaS3CloudWatch2CaptchaCapSolverResidential ProxiesDockerKubernetesGrafanaPrometheus
Scrapy + Playwright Stack

Scrapy handles crawl orchestration and deduplication. Playwright handles JavaScript rendering for dynamic auction interfaces.

Residential Proxy Infrastructure

Pools of residential ISP proxies ensure we maintain access during aggressive polling intervals near auction close.

Cloud-Native Orchestration

Pipelines run on Kubernetes and AWS Lambda. Airflow manages scheduling and dynamic concurrency scaling.

Output & Delivery

Your data, your destination

Data delivered to where your team already works — no new tooling required.

JSON
Newline-delimited or nested arrays
CSV
Flat file with typed columns
XLS
Excel compatible export for analyst teams
Parquet
Columnar format for data warehouse ingestion
AWS S3
Direct bucket delivery
Webhook
HTTP POST per record for real-time bid updates
API
REST endpoint to query historical extractions
BigQuery
Streamed directly into your dataset
Snowflake
Stage and COPY INTO workflow
S3
Direct bucket delivery — compatible with any data lake
// faq

Common questions.

About ironplanet.com scraping, legality, and pipeline operations.

Ask us directly →
Is scraping IronPlanet legal?

Scraping publicly available auction data is generally permissible. DataFlirt extracts only public, non-authenticated listings, bid histories, and inspection reports. We do not extract PII or bypass authentication walls. Clients should review IronPlanet terms of service and consult legal counsel.

How do you manage high-frequency polling near auction close?

Our Airflow schedulers dynamically increase crawl concurrency for items within 60 minutes of closing. We distribute requests across broad residential proxy pools to capture final bid increments without triggering rate limits.

Can you extract data from the IronClad inspection reports?

Yes. We parse the structured HTML nodes of the inspection reports to deliver specific condition ratings (e.g., hydraulics, undercarriage) as distinct JSON fields, rather than just providing a link to the report.

How fresh is the data?

For continuous pipelines, we can achieve sub-5-minute latency on targeted auction items. Full catalogue refreshes typically run on a daily cadence.

Do you provide historical auction data?

We begin building your historical time-series database from the day your pipeline is commissioned. We cannot retrieve auction results from before the pipeline start date if IronPlanet has removed them from the public site.

What is the minimum viable engagement?

Our minimum engagement typically starts with a defined category subset (e.g., all North American excavators) delivered on a daily cadence. Contact us for a scoped quote based on your volume requirements.

Can I request a sample dataset?

Yes. We provide a sample run of up to 200 equipment listings and their associated inspection reports to validate schema fit before you sign a contract.

$ dataflirt scope --new-project --source=ironplanet.com ready

Tell us what
to extract.
We do the rest.

20-minute scoping call. Pilot dataset within the week. Production within two. Whether you need a daily dump of excavator listings or real-time bid tracking across global auctions, we build and operate the pipeline. Tell us what you need.

hello@dataflirt.com · Bengaluru · IST · typical reply < 4h
Related Scrapers

More in industrial and mro

Services

Data Extraction for Every Industry

View All Services →