SYSTEM all green source borderstates.com queue 18,492 pages p99 latency 314ms dataflirt.com · scraper/borderstates-com
RUN · 31 active pipelines · borderstates.com live

Border States data,
at warehouse scale.

We extract MRO product listings, MPNs, branch-specific inventory levels, technical specifications, and PDF data sheets from Border States. Delivered as clean JSON, CSV, or Parquet to S3, BigQuery, or Snowflake.

Products extracted
1.4M /run
Branch updates
114 /24h
Spec sheets parsed
890K /total
Active pipelines
31
Uptime
99.94%
Data Dictionary

Every field we extract from borderstates.com

Structured, schema-consistent data across all major object types — delivered clean, typed, and ready to query.

Complete list of extractable fields for Product Listings objects from borderstates.com. All fields typed and schema-versioned.

item_idmpnupctitlebrandmanufacturercategory_pathdescriptionimage_urlsdatasheet_url
product_listings
● 200 OK
"item_id": "BSE-104928",
"mpn": "HBL5262",
"upc": "783585435205",
"title": "Hubbell Wiring Device-Kellems HBL5262 Duplex Receptacle",
"brand": "Hubbell",
"manufacturer": "Hubbell Wiring Device-Kellems",
"category_path": "Electrical > Wiring Devices > Receptacles",
"datasheet_url": "https://borderstates.com/docs/HBL5262_spec.pdf"
# item_idmpnupctitlebrandmanufacturer
1
2
3

Complete list of extractable fields for Pricing & Inventory objects from borderstates.com. All fields typed and schema-versioned.

item_idbase_pricecurrencyuommin_order_qtybranch_idbranch_namestock_levelin_stocklead_time_days
pricing_& inventory
● 200 OK
"item_id": "BSE-104928",
"base_price": 14.5,
"currency": "USD",
"uom": "EA",
"min_order_qty": 1,
"branch_id": "BR-042",
"branch_name": "Fargo, ND",
"stock_level": 142,
"in_stock": true
# item_idbase_pricecurrencyuommin_order_qtybranch_id
1
2
3

Complete list of extractable fields for Technical Specs objects from borderstates.com. All fields typed and schema-versioned.

item_idunspsc_codevoltage_ratingamperage_ratingmaterialcolourmounting_typenema_ratingenvironmental_conditionscompliance_flags
technical_specs
● 200 OK
"item_id": "BSE-104928",
"unspsc_code": "39121406",
"voltage_rating": "125V AC",
"amperage_rating": "15 A",
"material": "Nylon",
"colour": "Brown",
"mounting_type": "Flush",
"nema_rating": "5-15R"
# item_idunspsc_codevoltage_ratingamperage_ratingmaterialcolour
1
2
3

Complete list of extractable fields for Branch Data objects from borderstates.com. All fields typed and schema-versioned.

branch_idbranch_nameaddress_line_1citystatezip_codephone_numberhours_of_operationwill_call_availableservices_offered
branch_data
● 200 OK
"branch_id": "BR-042",
"branch_name": "Fargo, ND",
"address_line_1": "605 25th St S",
"city": "Fargo",
"state": "ND",
"zip_code": "58103",
"phone_number": "701-232-1456",
"will_call_available": true
# branch_idbranch_nameaddress_line_1citystatezip_code
1
2
3

Complete list of extractable fields for Search Results objects from borderstates.com. All fields typed and schema-versioned.

keywordpositionitem_idmpntitlebrandbase_priceuomstock_statusscraped_at
search_results
● 200 OK
"keyword": "duplex receptacle 15a",
"position": 1,
"item_id": "BSE-104928",
"mpn": "HBL5262",
"brand": "Hubbell",
"base_price": 14.5,
"stock_status": "In Stock",
"scraped_at": "2026-08-14T10:12:00Z"
# keywordpositionitem_idmpntitlebrand
1
2
3

Capabilities

Extract the industrial catalogue, accurately

Border States maintains a complex MRO catalogue with heavy reliance on MPNs, branch-specific availability, and deeply nested categories. Our infrastructure handles session-based branch selection and large-scale catalogue traversal.

MPN & UPC Extraction

Capture Manufacturer Part Numbers, UPCs, and internal item codes to ensure exact cross-referencing with your internal ERP systems.

Branch-Level Inventory

Simulate branch selection via session cookies to extract localized stock levels, lead times, and will-call availability across 110+ locations.

Spec Sheet & PDF Links

Extract URLs for technical data sheets, MSDS, and installation manuals directly from product pages for compliance documentation.

UOM Normalisation

Capture base pricing tied strictly to Unit of Measure (EA, C, M, PK, RL) to prevent pricing calculation errors in downstream systems.

Deep Category Traversal

Navigate complex, multi-tiered taxonomy trees to map products to specific industry verticals and applications.

Technical Attributes

Scrape dynamic specification tables including voltage, amperage, material, colour, and NEMA ratings into normalised JSON keys.

Cross-Reference Mapping

Extract manufacturer alternative parts and substitute items suggested on product pages for supply chain resilience.

Base Pricing Capture

Extract non-authenticated list pricing and promotional discounts to monitor baseline market rates.

Scheduled Delta Updates

Run pipelines on daily or weekly cadences, delivering only changed records to minimise warehouse compute costs.

// engagement pipeline

From category URL to warehouse record

Brief in. Clean data out.

Define Scope
d 0

Provide target categories, manufacturer lists, or specific branch IDs. We design the extraction schema together.

Pipeline Build
d 2–4

We configure Scrapy / Playwright crawlers, proxy rotation, and branch-specific session handling for borderstates.com.

Validation & QA
d 4–6

Schema validation, null-rate checks, UOM verification, and MPN format checks before full launch.

Delivery
ongoing

JSON / CSV / Parquet pushed to your S3 bucket, BigQuery dataset, or Snowflake stage on agreed cadence.

Under the hood

How our Border States pipeline handles the hard parts

B2B distribution sites deploy specific challenges: branch-dependent state, complex catalogue rendering, and strict anti-bot measures. Here is how we build resilience.

pipeline-monitor · borderstates.com · live ● active
// fingerprinting
Identity rotation
TLS fingerprintrandomised
User-agentrotated
IP poolresidential
Challenges blocked0
// pagination
Page coverage
48,291 pages queued running
// observability
Pipeline health
99.9%
uptime
142ms
p99 lat
0.3%
null rate
2
alerts
Session state
Branch-specific cookie management

Inventory and pricing on Border States depend on the selected branch. Our crawlers inject specific location cookies and maintain persistent sessions per worker to extract accurate, localized data without cross-contamination.

Anti-bot layer
B2B firewall circumvention

Industrial distributors often use strict WAFs to block automated catalogue scraping. We use US-based residential proxies, realistic TLS fingerprinting, and controlled concurrency to blend in with legitimate contractor traffic.

Data normalisation
UOM and pricing alignment

Pricing in MRO is complex, often quoted per 100 (C) or per 1000 (M). We extract both the raw price and the exact UOM, normalising the output so your ERP ingests accurate unit costs.

Pagination limits
Deep catalogue extraction

Category pages often cap results at 1,000 items. We automatically inject sub-category filters and brand facets to force the site to reveal the entire product depth, ensuring zero data loss.

Schema stability
Resilient selectors for dynamic specs

Product specifications vary wildly between a conduit and a transformer. We use dynamic key-value extraction for spec tables rather than hardcoded selectors, ensuring all technical data is captured regardless of product type.

Applications

Who uses Border States data — and how

Teams across industries use borderstates.com data to build competitive products and smarter operations.

01
ERP Master Data Enrichment

Distributors and contractors ingest clean MPNs, UPCs, and technical specifications to standardise their internal item masters.

02
Competitor Price Monitoring

Regional electrical distributors track base pricing and promotional discounts to optimise their own pricing matrices.

03
Supply Chain Visibility

Procurement teams monitor branch-level stock availability across regions to identify supply constraints for critical components.

04
Distributor Cross-Referencing

Manufacturers map their catalogue against Border States listings to audit product representation and identify missing lines.

05
Procurement Analytics

Estimators feed base pricing and lead times into bidding software to generate accurate project quotes.

06
Market Gap Analysis

Product managers analyse category depth and brand presence to identify expansion opportunities in specific MRO verticals.

Why DataFlirt

"MRO data is defined by its complexity. If you cannot accurately map MPNs and UOMs to localized inventory, the dataset is useless for procurement."

Extracting data from B2B distributors like Border States requires more than simple HTTP GET requests. It requires managing branch-specific session state, parsing complex specification tables, and normalising units of measure. DataFlirt handles this engineering overhead so your procurement and data teams receive clean, ERP-ready records.

Technical Spec

Border States scraper — technical capabilities

Everything supported by our borderstates.com scraper — rendered SPA elements, auth walls, rate-limit evasion and beyond.

Branch inventory
Extract stock levels and lead times for specific branch IDs via session injection
Supported
Base list pricing
Capture public, non-authenticated pricing and unit of measure
Supported
PDF spec sheet URLs
Extract direct links to manufacturer data sheets and installation guides
Supported
Manufacturer cross-references
Capture MPNs, UPCs, and UNSPSC codes for exact item matching
Supported
Category taxonomy
Extract full breadcrumb paths for deep category mapping
Supported
Account-specific negotiated pricing
Customer-specific contract pricing requires secure login credentials
Partial
Customer purchase history
Order history and invoice data requires authenticated account access
Partial
Change detection (diffs)
Hash-based diff: only emit records with changed inventory or pricing since last run
Supported
Infrastructure

Infrastructure powering the Border States pipeline

Open-source tooling on proven cloud infra — no vendor lock-in, full observability.

ScrapyPlaywrightPython 3.12RedisPostgreSQLApache AirflowAWS LambdaS3CloudWatch2CaptchaCapSolverResidential ProxiesDockerKubernetesGrafanaPrometheus
Scrapy + Playwright Stack

Scrapy handles crawl orchestration and deduplication. Playwright manages JavaScript execution and branch-specific cookie injection. Combined via scrapy-playwright middleware.

Residential Proxy Infrastructure

We maintain pools of US-based residential ISP proxies. Rotation happens per-request with sticky sessions to maintain branch state without triggering WAF blocks.

Cloud-Native Orchestration

Pipelines run on AWS ECS. Airflow handles scheduling, dependency management, and SLA alerting. All state stored in managed Postgres.

Output & Delivery

Your data, your destination

Data delivered to where your team already works — no new tooling required.

JSON
Newline-delimited or nested — schema versioned per run
CSV
Flat file with typed columns — Excel/Sheets compatible
XLS
Legacy spreadsheet format for direct procurement use
Parquet
Columnar format for BigQuery, Snowflake, Athena
AWS S3
Direct bucket delivery — compatible with any data lake
Webhook
HTTP POST per record for real-time downstream processing
API
REST endpoint to query latest extracted records
PostgreSQL
Upsert into your existing schema with conflict resolution
S3
Direct bucket delivery — compatible with any data lake
// faq

Common questions.

About borderstates.com scraping, legality, and pipeline operations.

Ask us directly →
Is scraping Border States legal?

Scraping publicly available information is generally permissible under applicable law. DataFlirt targets only public, non-authenticated product, base pricing, and inventory data. We do not circumvent authentication walls to extract account-specific pricing. Clients should review terms of service and consult legal counsel for specific use cases.

How do you extract branch-specific inventory?

We programmatically inject the required session cookies and headers to simulate a user selecting a specific branch location. This allows us to extract localized stock levels and lead times across multiple branches in parallel.

Can you extract manufacturer data sheets?

Yes. We extract the direct URLs to PDF data sheets, MSDS, and installation manuals linked on the product pages, ensuring you have the necessary compliance documentation.

How do you handle UOM (Unit of Measure) variations?

MRO pricing is heavily dependent on UOM (e.g., price per 100 vs price per each). Our schema explicitly extracts and normalises the UOM alongside the base price to ensure accurate calculations in your ERP.

What is the minimum viable engagement?

Our smallest packages start at a defined manufacturer list or category subset with weekly delivery. For full catalogue extraction across multiple branches, we price based on volume and delivery frequency.

Can I request a sample dataset before committing?

Absolutely. We provide a sample run of up to 500 products from specified categories as part of the pre-engagement scoping process to validate schema fit and data quality.

$ dataflirt scope --new-project --source=borderstates.com ready

Tell us what
to extract.
We do the rest.

20-minute scoping call. Pilot dataset within the week. Production within two. Whether you need a one-off catalogue dump or a continuous inventory feed across 50 branches — we scope, build, and operate the pipeline. Tell us what you need.

hello@dataflirt.com · Bengaluru · IST · typical reply < 4h
Related Scrapers

More in industrial and mro

Services

Data Extraction for Every Industry

View All Services →