SYSTEM all green source propetusa.com queue 8,412 pages p99 latency 184ms dataflirt.com · scraper/propetusa-com
RUN - 18 active pipelines - propetusa.com live

Propetusa data,
at warehouse scale.

We extract orthotic footwear catalogues, Medicare A5500 compliance flags, multi-width sizing matrices, and inventory levels from Propet USA. Delivered as clean JSON, CSV, or Parquet to S3, BigQuery, or Snowflake on your cadence.

SKUs extracted
14,291 /run
Width variants
82,104 /run
Price updates
14,291 /24h
Active pipelines
18
Uptime
99.94%
Data Dictionary

Every field we extract from propetusa.com

Structured, schema-consistent data across all major object types — delivered clean, typed, and ready to query.

Complete list of extractable fields for Product Info objects from propetusa.com. All fields typed and schema-versioned.

skutitlepricecategorymedicare_a5500_approvedorthotic_friendlymachine_washabledescriptionmaterialclosure_typeheel_heighturl
product_info
● 200 OK
"sku": "WCA049M",
"title": "Tour Walker Strap",
"price": 94.95,
"medicare_a5500_approved": true,
"orthotic_friendly": true,
"machine_washable": false,
"closure_type": "Hook and Loop",
"material": "Full grain leather"
# skutitlepricecategorymedicare_a5500_approvedorthotic_friendly
1
2
3

Complete list of extractable fields for Sizing & Widths objects from propetusa.com. All fields typed and schema-versioned.

skubase_skusizewidth_labelwidth_codeinventory_statusstock_quantityprice_modifierbarcode
sizing_& widths
● 200 OK
"sku": "WCA049M-8W",
"base_sku": "WCA049M",
"size": "8",
"width_label": "Wide",
"width_code": "D",
"inventory_status": "in_stock",
"stock_quantity": 42
# skubase_skusizewidth_labelwidth_codeinventory_status
1
2
3

Complete list of extractable fields for Variants & Colours objects from propetusa.com. All fields typed and schema-versioned.

skucolour_namehex_codeimage_urlsswatch_urlavailable_sizesavailable_widthsbase_sku
variants_& colours
● 200 OK
"sku": "WCA049M-BLK",
"colour_name": "Black",
"hex_code": "#000000",
"image_urls": "['https://example.com/img1.jpg', 'https://example.com/img2.jpg']",
"available_sizes": "['6', '6.5', '7', '7.5', '8']",
"available_widths": "['Narrow', 'Medium', 'Wide', 'X-Wide', 'XX-Wide']"
# skucolour_namehex_codeimage_urlsswatch_urlavailable_sizes
1
2
3

Complete list of extractable fields for Reviews & Ratings objects from propetusa.com. All fields typed and schema-versioned.

review_idskuratingreviewer_namereview_datereview_textverified_buyerhelpful_votesfit_ratingcomfort_rating
reviews_& ratings
● 200 OK
"review_id": "REV-98231",
"sku": "WCA049M",
"rating": 5,
"reviewer_name": "Jane D.",
"review_date": "2023-11-14",
"verified_buyer": true,
"fit_rating": "True to size",
"comfort_rating": 5
# review_idskuratingreviewer_namereview_datereview_text
1
2
3

Complete list of extractable fields for Categories & Collections objects from propetusa.com. All fields typed and schema-versioned.

category_namesub_categorycollection_nameurlproduct_countbreadcrumbsgenderactivity_type
categories_& collections
● 200 OK
"category_name": "Walking Shoes",
"sub_category": "Strap Sneakers",
"collection_name": "Tour Walker",
"gender": "Women",
"activity_type": "Walking",
"product_count": 24,
"breadcrumbs": "['Home', 'Women', 'Walking Shoes']"
# category_namesub_categorycollection_nameurlproduct_countbreadcrumbs
1
2
3

Capabilities

Extracting the complexity of therapeutic footwear

Propet USA catalogues feature highly dimensional sizing matrices and specific medical compliance flags. Our pipeline normalises this structure into flat, queryable tables.

Multi-Width Sizing Matrices

Extract inventory and pricing arrays across all 5 width profiles: Narrow (AA), Medium (B), Wide (D), X-Wide (2E), and XX-Wide (4E).

Medicare A5500 Flags

Capture therapeutic compliance data, identifying SKUs approved for diabetic footwear reimbursement under Medicare code A5500.

Orthotic Compatibility

Extract features like double insoles, removable footbeds, and orthotic-friendly indicators for every shoe model.

Colour Variant Mapping

Map base SKUs to all colour options, capturing specific swatch images, hex codes, and colour-specific inventory states.

Inventory Depth Tracking

Monitor stock availability across the entire size and width matrix to detect out-of-stock patterns and restock velocities.

Pricing & Discount Signals

Track MSRP, current retail price, clearance flags, and promotional discounts across the entire catalogue.

Customer Review Mining

Extract textual reviews, star ratings, and specific fit feedback (e.g., runs small, true to width) to analyse product reception.

Material & Construction Specs

Parse unstructured descriptions into structured fields for upper materials, sole types, closure mechanisms, and washability.

Scheduled Extraction

Run pipelines daily or weekly to maintain an updated mirror of Propet USA's catalogue and inventory state.

// engagement pipeline

From catalogue URL to structured dataset

Brief in. Clean data out.

Define Scope
d 0

Specify target categories, collections, or the entire catalogue. We map the required attributes and sizing dimensions.

Pipeline Build
d 2–4

We configure crawlers to handle dynamic inventory loading, multi-dimensional size selectors, and proxy rotation.

Validation & QA
d 4–6

We test the extraction against edge cases, ensuring all 5 width dimensions and Medicare flags are accurately captured.

Delivery
ongoing

Data is formatted into normalised JSON, CSV, or Parquet and pushed to your data warehouse or S3 bucket.

Under the hood

Handling multi-dimensional footwear arrays

Extracting therapeutic footwear data is complex due to the sheer number of SKU variations. Here is how we ensure complete data capture.

pipeline-monitor · propetusa.com · live ● active
// fingerprinting
Identity rotation
TLS fingerprintrandomised
User-agentrotated
IP poolresidential
Challenges blocked0
// pagination
Page coverage
48,291 pages queued running
// observability
Pipeline health
99.9%
uptime
142ms
p99 lat
0.3%
null rate
2
alerts
Matrix normalisation
Flattening 5-dimensional sizing

A single Propet shoe style can have over 60 variations (12 lengths multiplied by 5 widths). Our pipeline iterates through every UI combination, extracting the specific SKU, barcode, and inventory state for each permutation, outputting a flattened, queryable table.

Dynamic rendering
JavaScript hydration for inventory

Stock levels and variant-specific prices load dynamically via frontend JavaScript. We use Playwright to execute these scripts, ensuring we capture the true availability state rather than static placeholder HTML.

Attribute parsing
Structuring medical specifications

Critical data like Medicare A5500 approval and double-insole construction often lives in unstructured description blocks or icon tooltips. We use regex and DOM parsing to extract these attributes into distinct boolean fields.

Rate limiting
Polite crawling with proxy rotation

To extract thousands of variants without triggering anti-bot protections, we distribute requests across US residential proxies, inserting randomised delays to mimic standard browsing behaviour.

Change tracking
Delta exports for inventory

For daily inventory tracking, our pipeline compares current stock states against the previous run, emitting only the changed records. This reduces bandwidth and processing costs for downstream systems.

Applications

Who relies on Propet USA data

Teams across industries use propetusa.com data to build competitive products and smarter operations.

01
Medical Footwear Competitor Analysis

Competing therapeutic brands monitor Propet's pricing, width offerings, and Medicare-approved product lines to benchmark their own catalogues.

02
Inventory Forecasting

Retailers and distributors track stockout velocities across specific size and width combinations to optimise their wholesale purchasing models.

03
MAP Monitoring

Brands track retail pricing across the site to ensure alignment with Minimum Advertised Price policies and promotional calendars.

04
Product Development

Footwear designers analyse customer reviews and fit ratings to identify sizing inconsistencies and comfort issues in orthotic designs.

05
Market Research

Healthcare analysts track the expansion of Medicare A5500 approved footwear lines to gauge market demand for diabetic care products.

06
Assortment Planning

Merchandisers analyse the distribution of available widths (Narrow to XX-Wide) to inform inclusivity strategies in their own product lines.

Why DataFlirt

"Propet USA's catalogue represents the industry standard for therapeutic footwear sizing matrices, complex data requiring precise extraction."

Extracting orthotic footwear data requires handling multi-dimensional sizing arrays (length multiplied by up to five widths per SKU), Medicare compliance flags, and dynamic inventory states. DataFlirt manages the proxy rotation, JavaScript hydration, and schema normalisation so your engineers receive clean, structured tables.

Technical Spec

Propetusa scraper technical specifications

Everything supported by our propetusa.com scraper — rendered SPA elements, auth walls, rate-limit evasion and beyond.

JavaScript rendering
Full Playwright sessions required for dynamic inventory and variant loading
Supported
Multi-width mapping
Captures inventory states across all 5 width profiles per length
Supported
Medicare A5500 extraction
Parses product descriptions and badges for therapeutic compliance flags
Supported
Review pagination
Extracts all historical reviews, star ratings, and fit feedback
Supported
Change detection
Hash-based diffing to emit only inventory or price changes since last run
Supported
Webhook delivery
HTTP POST per record for real-time inventory alerting
Supported
Image extraction
Captures high-resolution product images and colour swatches
Supported
B2B wholesale pricing
Dealer-specific pricing matrices require authenticated dealer portal credentials
Partial
Customer purchase history
Historical order data requires direct user authentication
Partial
Infrastructure

Infrastructure powering the extraction

Open-source tooling on proven cloud infra — no vendor lock-in, full observability.

ScrapyPlaywrightPython 3.12RedisPostgreSQLApache AirflowAWS LambdaS3CloudWatch2CaptchaCapSolverResidential ProxiesDockerKubernetesGrafanaPrometheus
Scrapy + Playwright Stack

Scrapy handles the broad crawl orchestration while Playwright executes JavaScript to hydrate the multi-dimensional sizing matrices and inventory states.

Residential Proxy Infrastructure

Requests are routed through US-based residential IPs to prevent rate limiting and ensure access to accurate regional pricing and stock data.

Cloud-Native Orchestration

Pipelines run on AWS infrastructure, managed by Apache Airflow for strict scheduling, dependency resolution, and SLA adherence.

Output & Delivery

Your data, your destination

Data delivered to where your team already works — no new tooling required.

JSON
Nested structures preserving the size/width matrix relationships
CSV
Flattened files with one row per SKU variant
Parquet
Columnar format optimised for analytical queries
S3
Direct delivery to your AWS environment
BigQuery
Streamed into GCP datasets with defined schemas
Webhook
Real-time HTTP POST delivery for inventory alerts
API
REST endpoints to query the latest extracted catalogue state
Postgres
Direct database upserts with conflict resolution
Snowflake
Automated staging and COPY INTO workflows
// faq

Common questions.

About propetusa.com scraping, legality, and pipeline operations.

Ask us directly →
Can you extract all width variations for a single shoe?

Yes. Our pipeline iterates through the frontend matrix, extracting specific SKU codes, inventory levels, and prices for Narrow, Medium, Wide, X-Wide, and XX-Wide variations for every available length.

How do you identify Medicare-approved footwear?

We parse product badges, specification lists, and description text to reliably extract the Medicare A5500 compliance flag, outputting it as a clean boolean field in the final dataset.

How frequently can we track inventory changes?

Pipelines can be scheduled daily, weekly, or at custom intervals. For inventory tracking, we recommend daily runs to capture stockout velocities and restock events accurately.

Do you extract customer reviews and fit data?

Yes. We paginate through the review sections, extracting textual feedback, star ratings, and structured fit data indicating if a shoe runs small, large, narrow, or wide.

Can you deliver the data in a flattened format?

Absolutely. While the native data is highly nested, we normalise it into flat CSV or Parquet files where each row represents a distinct size/width variant, ready for immediate analysis.

Do you scrape B2B wholesale pricing?

No. Wholesale pricing on Propet USA requires authenticated access to the dealer portal. We only extract publicly available retail pricing and MSRP data.

$ dataflirt scope --new-project --source=propetusa.com ready

Tell us what
to extract.
We do the rest.

20-minute scoping call. Pilot dataset within the week. Production within two. Whether you need a complete catalogue export or daily inventory tracking across complex sizing matrices, we build and maintain the infrastructure. Tell us your requirements.

hello@dataflirt.com · Bengaluru · IST · typical reply < 4h
Related Scrapers

More in shoes and footwear

Services

Data Extraction for Every Industry

View All Services →