SYSTEM all green source nhtsa.gov queue 12,943 queries p99 latency 318ms dataflirt.com · scraper/nhtsa-gov
RUN . 41 active pipelines . nhtsa.gov live

NHTSA safety data,
at warehouse scale.

We extract vehicle recalls, consumer complaints, 5-Star Safety Ratings, investigations, and Technical Service Bulletins from NHTSA. Delivered as clean JSON, CSV, or Parquet to S3, BigQuery, or Snowflake on your cadence.

Recalls extracted
84,192 /total
Complaints logged
1.8M /total
VINs decoded
450K /day
TSB PDFs parsed
12,400 /month
Uptime
99.98%
Data Dictionary

Every field we extract from nhtsa.gov

Structured, schema-consistent data across all major object types — delivered clean, typed, and ready to query.

Complete list of extractable fields for Recalls objects from nhtsa.gov. All fields typed and schema-versioned.

recall_numbercampaign_idmanufacturermakemodelyearcomponentsummaryconsequenceremedynotesreport_date
recalls
● 200 OK
"recall_number": "23V-123",
"make": "Ford",
"model": "F-150",
"year": 2023,
"component": "STEERING",
"report_date": "2023-04-12"
# recall_numbercampaign_idmanufacturermakemodelyear
1
2
3

Complete list of extractable fields for Complaints objects from nhtsa.gov. All fields typed and schema-versioned.

odi_numbermakemodelyearcrash_indicatorfire_indicatornumber_of_injuriesnumber_of_deathscomplaint_dateincident_datecomponentsummary
complaints
● 200 OK
"odi_number": "11412345",
"crash_indicator": false,
"fire_indicator": false,
"number_of_injuries": 0,
"complaint_date": "2023-05-18",
"component": "ELECTRICAL SYSTEM"
# odi_numbermakemodelyearcrash_indicatorfire_indicator
1
2
3

Complete list of extractable fields for Investigations objects from nhtsa.gov. All fields typed and schema-versioned.

nhtsa_action_numbermakemodelyearsubjectopened_dateclosed_datesummarystatuscomponentmanufacturer
investigations
● 200 OK
"nhtsa_action_number": "PE22-001",
"status": "OPEN",
"opened_date": "2022-01-15",
"subject": "Phantom Braking",
"component": "FORWARD COLLISION AVOIDANCE"
# nhtsa_action_numbermakemodelyearsubjectopened_date
1
2
3

Complete list of extractable fields for Safety Ratings objects from nhtsa.gov. All fields typed and schema-versioned.

vehicle_idmakemodelyearoverall_ratingfrontal_crash_ratingside_crash_ratingrollover_ratingrollover_possibilityside_pole_ratingcomplaints_countrecalls_count
safety_ratings
● 200 OK
"make": "Honda",
"model": "Civic",
"year": 2022,
"overall_rating": 5,
"frontal_crash_rating": 5,
"rollover_rating": 4
# vehicle_idmakemodelyearoverall_ratingfrontal_crash_rating
1
2
3

Complete list of extractable fields for TSBs objects from nhtsa.gov. All fields typed and schema-versioned.

tsb_numbermanufacturer_communication_numbermakemodelyearcomponentsummarydocument_urlpdf_text_extractedissue_date
tsbs
● 200 OK
"tsb_number": "TSB-21-01",
"issue_date": "2021-03-10",
"component": "ENGINE",
"document_url": "https://static.nhtsa.gov/odi/tsbs/...",
"summary": "Engine misfire under heavy load."
# tsb_numbermanufacturer_communication_numbermakemodelyearcomponent
1
2
3

Capabilities

Complete automotive safety intelligence

Our NHTSA scraper extracts safety records across decades of vehicle history. We parse complex search interfaces, decode VINs in bulk, and extract text from manufacturer PDF submissions.

Recalls & Defects

Extract campaign IDs, affected populations, and remedy instructions for all vehicle, tire, and equipment recalls.

Consumer Complaints (ODI)

Pull millions of user submitted complaints with crash indicators, injury counts, and narrative summaries.

NCAP 5-Star Ratings

Track frontal, side, and rollover crash test ratings for all tested makes and models.

Technical Service Bulletins

Scrape manufacturer communications and automatically extract text from attached PDF documents.

Defect Investigations

Monitor open and closed NHTSA investigations, including engineering analyses and preliminary evaluations.

Bulk VIN Decoding

Process millions of VINs through the vPIC API to normalise make, model, year, and plant data.

Early Warning Reporting

Extract aggregated manufacturer data on death and injury incidents.

Child Seat Ease of Use

Capture safety ratings and installation metrics for child restraint systems.

Historical Data Recovery

Paginate through decades of archived safety records without timing out or missing records.

// engagement pipeline

From vehicle query to warehouse record

Brief in. Clean data out.

Define Scope
d 0

Specify vehicle makes, years, or data types (recalls, complaints, TSBs). We map the extraction schema.

Pipeline Build
d 2–4

We configure Scrapy crawlers, API polling for vPIC, and PDF parsing pipelines for document extraction.

Validation & QA
d 4–6

Schema validation, null-rate checks, and cross-referencing VIN decodes before full launch.

Delivery
ongoing

JSON / CSV / Parquet pushed to your S3 bucket, BigQuery dataset, or Snowflake stage on agreed cadence.

Under the hood

Navigating government infrastructure

NHTSA provides massive public datasets, but their interfaces are prone to timeouts, rate limits, and nested document structures. Here is how we build resilience.

pipeline-monitor · nhtsa.gov · live ● active
// fingerprinting
Identity rotation
TLS fingerprintrandomised
User-agentrotated
IP poolresidential
Challenges blocked0
// pagination
Page coverage
48,291 pages queued running
// observability
Pipeline health
99.9%
uptime
142ms
p99 lat
0.3%
null rate
2
alerts
API Rate Limiting
Distributed request pacing

NHTSA APIs frequently throttle bulk requests. We implement distributed IP rotation and exponential backoff to maintain throughput without triggering blocks.

PDF Text Extraction
Automated OCR pipelines

TSBs and manufacturer letters are often scanned PDFs. We deploy OCR pipelines to convert image based documents into queryable text.

Pagination Timeouts
Micro-batch date slicing

Deep pagination on NHTSA databases often results in server 504 errors. Our crawlers slice date ranges into micro batches to ensure complete historical extraction.

Schema Normalisation
vPIC standardisation

Manufacturer naming conventions change over time. We normalise make and manufacturer fields against the vPIC database.

Incremental Updates
Stateful tracking

We track ODIs and campaign IDs to only extract new complaints and recalls, reducing load and preventing duplicate records in your warehouse.

Applications

Who uses NHTSA data and how

Teams across industries use nhtsa.gov data to build competitive products and smarter operations.

01
Automotive Market Research

Analyze defect trends and reliability metrics across competing manufacturers to inform product strategy.

02
Insurance Risk Modeling

Actuaries correlate consumer complaints and crash test ratings with claim frequencies to adjust premium pricing.

03
Used Car Valuation

Integrate open recall status and historical complaint volume into automated vehicle valuation algorithms.

04
Predictive Maintenance

Fleet operators use TSBs and early warning reports to proactively service vehicles before catastrophic failures.

05
Legal & Compliance

Law firms monitor defect investigations and consumer complaints to identify class action opportunities.

06
Parts Manufacturing

Aftermarket suppliers track component specific failure rates to forecast demand for replacement parts.

Why DataFlirt

"NHTSA holds the definitive record of automotive safety failures in the United States, but extracting actionable signals from their legacy systems requires industrial grade pipelines."

Most teams struggle with NHTSA data because it is fragmented across APIs, HTML tables, and scanned PDFs. DataFlirt centralises this extraction, handling the rate limits, OCR, and schema normalisation so your data science team receives clean, queryable records ready for analysis.

Technical Spec

NHTSA scraper technical capabilities

Everything supported by our nhtsa.gov scraper — rendered SPA elements, auth walls, rate-limit evasion and beyond.

Vehicle Recalls (Campaigns)
Full text of summary, consequence, and remedy
Supported
Consumer Complaints (ODI)
Crash indicators, injury counts, and narratives
Supported
TSB Document Parsing
Automated text extraction from attached PDF files
Supported
NCAP Safety Ratings
Frontal, side, and rollover crash test scores
Supported
Bulk VIN Decoding
High volume translation of VINs to vehicle specifications
Supported
Defect Investigations
Status tracking for preliminary evaluations and engineering analyses
Supported
Incremental Sync
Fetch only new or updated records since the last run
Supported
PII of Complainants
Names and contact details of individuals submitting complaints (redacted by NHTSA)
Partial
Confidential Trade Secrets
Manufacturer technical data submitted under seal to NHTSA
Partial
Infrastructure

Infrastructure powering the NHTSA pipeline

Open-source tooling on proven cloud infra — no vendor lock-in, full observability.

ScrapyPlaywrightPython 3.12RedisPostgreSQLApache AirflowAWS LambdaS3CloudWatch2CaptchaCapSolverResidential ProxiesDockerKubernetesGrafanaPrometheusTesseract OCR
API & HTML Orchestration

Scrapy handles direct HTML parsing for legacy search interfaces while managing rate limited requests to the vPIC API.

Document Processing Pipeline

PDFs attached to TSBs are downloaded to S3, queued in Redis, and processed via distributed OCR workers to extract raw text.

Cloud-Native Orchestration

Pipelines run on AWS Lambda (burst) and ECS (sustained). Airflow handles scheduling, dependency management, and SLA alerting.

Output & Delivery

Your data, your destination

Data delivered to where your team already works — no new tooling required.

JSON
Newline-delimited or nested arrays for complex document structures
CSV
Flat files for tabular recall and complaint data
XLS
Excel compatible exports for analyst teams
Parquet
Columnar format optimised for analytical workloads
AWS S3
Direct bucket delivery for data lake integration
Webhook
HTTP POST for real time alerts on new defect investigations
API
REST endpoints to query your extracted dataset
BigQuery
Streamed directly into your GCP environment
S3
Direct bucket delivery — compatible with any data lake
// faq

Common questions.

About nhtsa.gov scraping, legality, and pipeline operations.

Ask us directly →
Is scraping NHTSA data legal?

Yes. NHTSA data is public domain government information. We strictly adhere to public access guidelines and respect API rate limits to ensure we do not disrupt government infrastructure.

Can you extract text from TSB PDFs?

Yes. Our pipeline includes automated document downloading and text extraction. We use OCR for scanned documents to ensure the technical details are fully searchable.

How far back does the data go?

NHTSA records span decades. We can extract historical complaints, recalls, and investigations dating back to the 1970s, depending on the specific dataset.

Do you decode VINs?

Yes. We integrate with the NHTSA vPIC API to decode VINs in bulk, normalising manufacturer, make, model, year, and plant specifications.

How do you handle rate limits?

We use distributed IP rotation, intelligent request pacing, and exponential backoff to extract data efficiently without overwhelming NHTSA servers.

Are consumer names included in complaints?

No. NHTSA redacts Personally Identifiable Information (PII) from public complaint records before publishing them. We only extract the public, anonymised data.

How frequently can you update the data?

We support daily, weekly, or monthly cadences. For critical safety monitoring, we can configure hourly incremental runs to capture new recalls or investigations.

$ dataflirt scope --new-project --source=nhtsa.gov ready

Tell us what
to extract.
We do the rest.

20-minute scoping call. Pilot dataset within the week. Production within two. Whether you need a historical dump of consumer complaints or continuous monitoring for new vehicle recalls, we build and operate the pipeline. Tell us what you need.

hello@dataflirt.com · Bengaluru · IST · typical reply < 4h
Related Scrapers

More in automotive

Services

Data Extraction for Every Industry

View All Services →