SYSTEM all green source iihs.org queue 12,408 vehicles p99 latency 184ms dataflirt.com · scraper/iihs-org
RUN · 14 active pipelines · iihs.org live

Vehicle safety data,
at warehouse scale.

We extract Top Safety Pick awards, crash test metrics, headlight ratings, and HLDI loss statistics from IIHS. Delivered as clean JSON, CSV, or Parquet to S3, BigQuery, or Snowflake on your cadence.

Vehicles extracted
14,291 /run
Crash test metrics
118,402 /run
HLDI loss records
42,155 /run
Active pipelines
14
Uptime
99.98%
Data Dictionary

Every field we extract from iihs.org

Structured, schema-consistent data across all major object types — delivered clean, typed, and ready to query.

Complete list of extractable fields for Vehicle Overview objects from iihs.org. All fields typed and schema-versioned.

makemodelyearvehicle_classtop_safety_picktop_safety_pick_plusoverall_evaluationrelease_datebase_pricecurb_weight
vehicle_overview
● 200 OK
"make": "Subaru",
"model": "Outback",
"year": 2023,
"vehicle_class": "Midsize SUV",
"top_safety_pick_plus": true,
"overall_evaluation": "Good"
# makemodelyearvehicle_classtop_safety_picktop_safety_pick_plus
1
2
3

Complete list of extractable fields for Crashworthiness objects from iihs.org. All fields typed and schema-versioned.

vehicle_idsmall_overlap_front_driversmall_overlap_front_passengermoderate_overlap_frontside_originalside_updatedroof_strengthhead_restraints_seatsstructure_safety_cagedriver_injury_measures
crashworthiness
● 200 OK
"small_overlap_front_driver": "Good",
"moderate_overlap_front": "Good",
"side_updated": "Acceptable",
"roof_strength": "Good",
"head_restraints_seats": "Good",
"structure_safety_cage": "Good"
# vehicle_idsmall_overlap_front_driversmall_overlap_front_passengermoderate_overlap_frontside_originalside_updated
1
2
3

Complete list of extractable fields for Crash Avoidance objects from iihs.org. All fields typed and schema-versioned.

vehicle_idheadlights_evaluationfront_crash_prevention_v2vfront_crash_prevention_v2p_dayfront_crash_prevention_v2p_nightseat_belt_remindersstandard_equipmentoptional_equipmentsystem_name
crash_avoidance
● 200 OK
"headlights_evaluation": "Good",
"front_crash_prevention_v2v": "Superior",
"front_crash_prevention_v2p_day": "Advanced",
"seat_belt_reminders": "Marginal",
"standard_equipment": true,
"system_name": "EyeSight"
# vehicle_idheadlights_evaluationfront_crash_prevention_v2vfront_crash_prevention_v2p_dayfront_crash_prevention_v2p_nightseat_belt_reminders
1
2
3

Complete list of extractable fields for LATCH Ease of Use objects from iihs.org. All fields typed and schema-versioned.

vehicle_idlatch_overall_ratinglower_anchors_too_deeplower_anchors_force_requiredhardware_confusingtether_anchor_confusingtether_anchor_locationtotal_latch_positionscenter_latch_available
latch_ease of use
● 200 OK
"latch_overall_rating": "Good+",
"lower_anchors_too_deep": false,
"hardware_confusing": false,
"tether_anchor_confusing": false,
"total_latch_positions": 3,
"center_latch_available": true
# vehicle_idlatch_overall_ratinglower_anchors_too_deeplower_anchors_force_requiredhardware_confusingtether_anchor_confusing
1
2
3

Complete list of extractable fields for HLDI Losses objects from iihs.org. All fields typed and schema-versioned.

vehicle_idcollision_lossproperty_damage_losscomprehensive_losspersonal_injury_protectionmedical_paymentbodily_injuryrelative_risk_scorevehicle_sizevehicle_type
hldi_losses
● 200 OK
"collision_loss": 112,
"property_damage_loss": 98,
"comprehensive_loss": 105,
"personal_injury_protection": 85,
"medical_payment": 88,
"bodily_injury": 92
# vehicle_idcollision_lossproperty_damage_losscomprehensive_losspersonal_injury_protectionmedical_payment
1
2
3

Capabilities

Everything you need from IIHS — parsed and structured

Our IIHS scraper translates complex HTML tables, dynamic filters, and historical rating changes into a unified, queryable dataset for automotive analytics.

Award Extraction

Identify Top Safety Pick and Top Safety Pick+ winners across all years, including the specific criteria met for each award.

Crashworthiness Metrics

Extract granular ratings for small overlap, moderate overlap, side impact, roof strength, and head restraints.

Crash Avoidance Data

Capture evaluations for vehicle-to-vehicle and vehicle-to-pedestrian front crash prevention systems, including day and night performance.

Headlight Evaluations

Parse detailed headlight performance metrics, noting differences across trim levels and option packages.

LATCH System Ratings

Extract ease-of-use ratings for child seat attachment hardware, including anchor depth, force requirements, and potential confusion points.

HLDI Insurance Losses

Scrape relative risk scores for collision, property damage, comprehensive, PIP, medical payment, and bodily injury claims.

Historical Tracking

Maintain a full history of rating changes and test updates as IIHS evolves its evaluation criteria over time.

Trim-Level Normalisation

Map safety equipment and ratings to specific vehicle trims, handling complex conditional logic presented on the IIHS site.

Change Detection

Run continuous pipelines that only emit records when new test results or updated ratings are published.

// engagement pipeline

From vehicle list to warehouse record

Brief in. Clean data out.

Define Scope
d 0

Provide vehicle makes, models, years, or specific vehicle classes. We design the extraction schema together.

Pipeline Build
d 2–4

We configure Scrapy / Playwright crawlers, handle dynamic filters, and parse nested rating tables on iihs.org.

Validation & QA
d 4–6

Schema validation, null-rate checks, and normalisation of historical rating scales before full launch.

Delivery
ongoing

JSON / CSV / Parquet pushed to your S3 bucket, BigQuery dataset, or Snowflake stage on agreed cadence.

Under the hood

How our IIHS pipeline handles the hard parts

Extracting structured data from IIHS requires parsing deeply nested HTML tables and normalising evolving rating scales. Here is how we maintain data integrity.

pipeline-monitor · iihs.org · live ● active
// fingerprinting
Identity rotation
TLS fingerprintrandomised
User-agentrotated
IP poolresidential
Challenges blocked0
// pagination
Page coverage
48,291 pages queued running
// observability
Pipeline health
99.9%
uptime
142ms
p99 lat
0.3%
null rate
2
alerts
Dynamic navigation
Handling JS-driven vehicle filters

IIHS uses JavaScript-heavy dropdowns and dynamic routing to filter vehicles by make, model, and year. Our Playwright integration executes these flows natively to ensure complete catalogue coverage without missing hidden variants.

Nested tables
Parsing complex HTML structures

Crashworthiness details are often buried in expanding HTML tables with merged cells and inconsistent DOM layouts. We use bespoke XPath rules and structural mapping to flatten these tables into strict relational schemas.

Schema standardisation
Normalising evolving test criteria

IIHS frequently updates its test protocols, such as introducing the updated side impact test. We standardise these metrics, explicitly separating 'original' and 'updated' test results so longitudinal analysis remains accurate.

Trim logic
Resolving conditional safety equipment

Headlight and crash prevention ratings often vary by trim or option package. Our extraction logic parses the conditional text ('Applies to models built after...', 'When equipped with...') and maps it directly to the relevant trim designations.

Monitoring & alerting
Detecting schema drift

When IIHS redesigns a vehicle page or introduces a new rating category, our observability stack flags the schema drift immediately. We update extraction rules before your downstream models encounter null values.

Applications

Who uses IIHS data — and how

Teams across industries use iihs.org data to build competitive products and smarter operations.

01
Insurance Underwriting

Actuaries ingest HLDI loss metrics and crashworthiness ratings to refine premium pricing models and risk assessments.

02
Consumer Automotive Portals

Car research websites aggregate IIHS Top Safety Pick awards and crash test data to enrich vehicle detail pages.

03
Fleet Procurement

Corporate fleet managers filter available vehicles against strict safety thresholds, ensuring compliance with internal safety mandates.

04
Competitor Benchmarking

Automotive OEMs track how rival models perform in specific tests like the updated moderate overlap front evaluation.

05
Academic Safety Research

Researchers correlate historical IIHS ratings with real-world fatality statistics to evaluate the effectiveness of new safety standards.

06
Market Analysis

Analysts track the adoption rate of standard front crash prevention systems across different vehicle segments over time.

Why DataFlirt

"IIHS provides the definitive benchmark for vehicle safety in North America, but its data is locked in complex web views rather than accessible APIs."

Building a reliable parser for IIHS requires handling nested HTML tables, dynamic JavaScript filters, and constantly evolving rating criteria. DataFlirt manages this complexity entirely, delivering a clean, structured dataset of crash metrics and HLDI loss statistics directly to your warehouse. You focus on risk modelling, not DOM parsing.

Technical Spec

IIHS scraper — technical capabilities

Everything supported by our iihs.org scraper — rendered SPA elements, auth walls, rate-limit evasion and beyond.

JavaScript rendering
Full Playwright sessions to handle dynamic vehicle selection dropdowns
Supported
CAPTCHA bypass
Automated 2Captcha + CapSolver integration for uninterrupted extraction
Supported
Historical ratings
Extraction of legacy test results alongside current evaluation protocols
Supported
HLDI relative risk metrics
Capture of all insurance loss data categories by vehicle size and type
Supported
Trim-level variations
Mapping of conditional safety features to specific vehicle trims
Supported
Change detection (diffs)
Hash-based diffing to emit only new or updated safety ratings
Supported
Webhook delivery
HTTP POST per record or batch upon detection of new test results
Supported
Crash test video downloads
Video file extraction and hosting is not supported directly; we provide video URLs
Partial
Raw telemetry data
IIHS does not expose raw dummy sensor telemetry, only aggregated rating grades
Partial
Infrastructure

Infrastructure powering the IIHS pipeline

Open-source tooling on proven cloud infra — no vendor lock-in, full observability.

ScrapyPlaywrightPython 3.12RedisPostgreSQLApache AirflowAWS LambdaS3CloudWatch2CaptchaCapSolverResidential ProxiesDockerKubernetesGrafanaPrometheus
Scrapy + Playwright Stack

Scrapy handles crawl orchestration and deduplication. Playwright navigates the JavaScript-heavy vehicle selection filters and dynamic tables.

Structural Mapping

Bespoke parsing modules map IIHS's evolving HTML table structures into strict relational data models, handling merged cells and nested sub-metrics.

Cloud-Native Orchestration

Pipelines run on AWS Lambda and ECS. Airflow manages scheduling and dependency tracking, ensuring data is delivered reliably on your cadence.

Output & Delivery

Your data, your destination

Data delivered to where your team already works — no new tooling required.

JSON
Newline-delimited or nested — schema versioned per run
CSV
Flat file with typed columns — Excel/Sheets compatible
XLS
Standard Excel workbook for manual review
Parquet
Columnar format for BigQuery, Snowflake, Athena
AWS S3
Direct bucket delivery — compatible with any data lake
Webhook
HTTP POST per record for real-time downstream processing
API
RESTful endpoints to query extracted safety records
PostgreSQL
Upsert into your existing schema with conflict resolution
S3
Direct bucket delivery — compatible with any data lake
// faq

Common questions.

About iihs.org scraping, legality, and pipeline operations.

Ask us directly →
Is scraping IIHS legal?

Scraping publicly available safety ratings and test results from IIHS is generally permissible under applicable web scraping laws. DataFlirt extracts only public, non-authenticated data. Clients should review IIHS terms of service and consult legal counsel for their specific commercial use cases.

How do you handle changes to IIHS rating criteria?

IIHS frequently introduces new tests (like the updated side test). Our pipeline maps these as distinct schema fields rather than overwriting historical data, ensuring longitudinal analysis remains accurate. We monitor schema drift and update parsers promptly.

Can you extract data for specific trims and option packages?

Yes. IIHS often assigns different headlight or crash avoidance ratings based on specific trims or optional equipment. We parse this conditional text and map it accurately to the relevant vehicle configurations.

Do you capture HLDI insurance loss data?

Yes. We extract the full suite of HLDI relative risk scores, including collision, property damage, comprehensive, personal injury protection, medical payment, and bodily injury metrics.

How frequently is the data updated?

We can configure pipelines to run weekly or monthly to capture new vehicle test publications. Change detection ensures you only receive records for newly tested or updated vehicles.

Can you provide a historical dump of all vehicle ratings?

Yes. We can execute a full historical scrape of all available makes, models, and years currently published on the IIHS website to seed your database before transitioning to a continuous update schedule.

$ dataflirt scope --new-project --source=iihs.org ready

Tell us what
to extract.
We do the rest.

20-minute scoping call. Pilot dataset within the week. Production within two. Whether you need a complete historical dump of vehicle safety ratings or continuous monitoring for new crash test results, we scope, build, and operate the pipeline. Tell us what you need.

hello@dataflirt.com · Bengaluru · IST · typical reply < 4h
Related Scrapers

More in automotive

Services

Data Extraction for Every Industry

View All Services →