SYSTEM all green source thk.com queue 12,408 pages p99 latency 218ms dataflirt.com · scraper/thk-com
RUN · 42 active pipelines · thk.com live

THK technical data,
at warehouse scale.

We extract linear motion component specifications, load ratings, dimensions, and CAD metadata from THK. Delivered as clean JSON, CSV, or Parquet to S3, BigQuery, or Snowflake on your cadence.

Components extracted
84.2K /run
Spec updates
312K /month
CAD metadata records
45.1K /run
Active pipelines
42
Uptime
99.98%
Data Dictionary

Every field we extract from thk.com

Structured, schema-consistent data across all major object types — delivered clean, typed, and ready to query.

Complete list of extractable fields for LM Guides objects from thk.com. All fields typed and schema-versioned.

part_numberseriesblock_typerail_width_mmdynamic_load_c_knstatic_load_c0_knmass_block_kgmass_rail_kg_moverall_length_mmcad_url
lm_guides
● 200 OK
"part_number": "SHS25C1SS+1200L",
"series": "SHS",
"block_type": "C",
"rail_width_mm": 23.0,
"dynamic_load_c_kn": 36.8,
"static_load_c0_kn": 35.2,
"mass_block_kg": 0.59,
"mass_rail_kg_m": 3.3
# part_numberseriesblock_typerail_width_mmdynamic_load_c_knstatic_load_c0_kn
1
2
3

Complete list of extractable fields for Ball Screws objects from thk.com. All fields typed and schema-versioned.

part_numberscrew_shaft_od_mmlead_mmball_center_dia_mmthread_minor_dia_mmdynamic_load_ca_knstatic_load_c0a_knrigidity_n_micrommax_speed_rpm
ball_screws
● 200 OK
"part_number": "SBN2005-5",
"screw_shaft_od_mm": 20.0,
"lead_mm": 5.0,
"ball_center_dia_mm": 20.5,
"dynamic_load_ca_kn": 12.1,
"static_load_c0a_kn": 22.4,
"rigidity_n_microm": 410.0
# part_numberscrew_shaft_od_mmlead_mmball_center_dia_mmthread_minor_dia_mmdynamic_load_ca_kn
1
2
3

Complete list of extractable fields for Actuators objects from thk.com. All fields typed and schema-versioned.

model_numberstroke_mmmax_speed_mm_smotor_capacity_wrepeatability_mmpayload_horizontal_kgpayload_vertical_kgball_screw_lead_mmoverall_length_mm
actuators
● 200 OK
"model_number": "KR3310A-0100",
"stroke_mm": 100.0,
"max_speed_mm_s": 500.0,
"repeatability_mm": 0.02,
"payload_horizontal_kg": 15.0,
"payload_vertical_kg": 4.0,
"ball_screw_lead_mm": 10.0
# model_numberstroke_mmmax_speed_mm_smotor_capacity_wrepeatability_mmpayload_horizontal_kg
1
2
3

Complete list of extractable fields for Cross Roller Rings objects from thk.com. All fields typed and schema-versioned.

model_numberinner_dia_mmouter_dia_mmwidth_mmroller_pitch_circle_dia_mmbasic_dynamic_load_c_knbasic_static_load_c0_knmass_kggreasing_hole
cross_roller rings
● 200 OK
"model_number": "RU66",
"inner_dia_mm": 35.0,
"outer_dia_mm": 95.0,
"width_mm": 15.0,
"roller_pitch_circle_dia_mm": 66.0,
"basic_dynamic_load_c_kn": 12.5,
"basic_static_load_c0_kn": 17.8
# model_numberinner_dia_mmouter_dia_mmwidth_mmroller_pitch_circle_dia_mmbasic_dynamic_load_c_kn
1
2
3

Complete list of extractable fields for Component Metadata objects from thk.com. All fields typed and schema-versioned.

part_numbercategorysub_categoryseries_descriptionpdf_catalogue_url2d_cad_available3d_cad_availablerohs_compliantregional_availability
component_metadata
● 200 OK
"part_number": "SHS25C",
"category": "LM Guide",
"sub_category": "Caged Ball LM Guide",
"series_description": "Standard type with equal load rating in 4 directions",
"pdf_catalogue_url": "https://tech.thk.com/en/products/pdf/shs.pdf",
"2d_cad_available": true,
"3d_cad_available": true
# part_numbercategorysub_categoryseries_descriptionpdf_catalogue_url2d_cad_available
1
2
3

Capabilities

Everything you need from THK — nothing you do not

Our THK scraper handles complex industrial catalogues: deeply nested specification tables, parametric part configurations, multi-region variants, and CAD metadata extraction.

LM Guide Specifications

Extract rail widths, block types, dynamic load ratings, and static load ratings for every series in the catalogue.

Ball Screw Parameters

Capture shaft diameters, leads, thread minor diameters, and rigidity metrics across rolled and precision screw types.

Dimensional Data Extraction

Parse nested HTML tables to extract exact millimeter dimensions for mounting holes, overall lengths, and block heights.

CAD Metadata Mapping

Extract availability flags and portal links for 2D and 3D CAD models associated with specific part numbers.

Part Number Generation

Deconstruct THK part number syntax to map individual components to their parent assembly configurations.

Multi-Region Catalogues

Scrape specification variants across THK regional sites to capture localized availability and metric vs imperial units.

PDF Documentation Links

Aggregate direct URLs to technical datasheets, installation manuals, and maintenance guides for every product line.

Tolerance & Rigidity Classes

Extract clearance codes, accuracy grades, and preload specifications for precision motion planning.

Scheduled Updates

Run recurring pipelines to detect new product series introductions and deprecated part numbers.

// engagement pipeline

From component list to warehouse record

Brief in. Clean data out.

Define Scope
d 0

Provide category URLs, product series, or target specifications. We design the extraction schema together.

Pipeline Build
d 2–4

We configure Scrapy crawlers, table normalisation logic, and unit standardisation for thk.com.

Validation & QA
d 4–6

Schema validation, null-rate checks, unit consistency verification, and sample records before full launch.

Delivery
ongoing

JSON / CSV / Parquet pushed to your S3 bucket, BigQuery dataset, or Snowflake stage on agreed cadence.

Under the hood

How our THK pipeline handles the hard parts

Industrial catalogues present unique data structuring challenges. Here is how we maintain clean, typed component databases.

pipeline-monitor · thk.com · live ● active
// fingerprinting
Identity rotation
TLS fingerprintrandomised
User-agentrotated
IP poolresidential
Challenges blocked0
// pagination
Page coverage
48,291 pages queued running
// observability
Pipeline health
99.9%
uptime
142ms
p99 lat
0.3%
null rate
2
alerts
Table normalisation
Untangling nested specification grids

THK displays specifications in complex HTML tables with merged cells and dynamic column headers. Our parsing engine standardises these grids, mapping row spans to individual part records so every column aligns correctly.

Part permutations
Expanding base models to orderable parts

A single THK product page often represents thousands of part number permutations based on rail length, block count, and seal type. We extract the permutation rules and generate flat records for valid orderable items.

Unit standardisation
Strict metric casting

Industrial data is useless if units are mixed. We strip text strings like 'kN' or 'mm', cast values to strict floats, and standardise the schema so your database receives clean numerics ready for calculation.

Multi-language support
Cross-referencing regional catalogues

THK maintains different catalogues for Japan, Europe, and the Americas. We map part numbers across regional sites to capture complete specification profiles and regional availability flags.

Change detection
Tracking catalogue deprecations

We maintain a hash index of last-seen values per component. When THK discontinues a series or updates a load rating, our pipeline isolates the diffs, reducing downstream processing load.

Applications

Who uses THK data — and how

Teams across industries use thk.com data to build competitive products and smarter operations.

01
Competitor Cross-Referencing

Industrial manufacturers map THK specifications against their own product lines to build automated cross-reference tools.

02
Engineering Design Automation

CAD software providers integrate THK dimensional data directly into plugin libraries for mechanical engineers.

03
Procurement & ERP

Supply chain teams ingest exact part configurations to standardise internal catalogues and validate supplier quotes.

04
Digital Twins

Simulation teams use extracted mass and rigidity metrics to model system kinematics and predict component wear.

05
Distributor Catalogues

B2B industrial distributors enrich their ecommerce platforms with accurate load ratings and technical specifications.

06
Predictive Maintenance Models

Data science teams correlate static and dynamic load ratings with operational data to forecast linear guide lifespans.

Why DataFlirt

"THK's catalogue contains the foundational mechanics for global automation. Extracting it requires untangling thousands of parametric variations into flat, queryable records."

Industrial component scraping is rarely about bot mitigation. It is about data normalisation. THK represents technical specifications across hundreds of product series, with complex part numbering conventions. DataFlirt structures this engineering data into clean, typed schemas so your procurement and engineering systems can consume it directly.

Technical Spec

THK scraper — technical capabilities

Everything supported by our thk.com scraper — rendered SPA elements, auth walls, rate-limit evasion and beyond.

Table normalisation
Parses merged cells and nested headers into flat key-value pairs
Supported
CAD metadata extraction
Captures availability flags and portal links for 2D/3D models
Supported
Part number expansion
Generates valid permutations from base model syntax rules
Supported
Unit conversion
Strips string suffixes and casts dimensions to strict float types
Supported
PDF parsing
Extracts direct URLs to technical datasheets and manuals
Supported
Multi-region mapping
Aligns part series across global THK subdomains
Supported
Scheduled diffing
Emits only changed or newly added component records
Supported
3D STEP file downloading
Direct automated download of heavy CAD geometry files
Partial
Distributor pricing
Requires authenticated portal access to partner networks
Partial
Infrastructure

Infrastructure powering the THK pipeline

Open-source tooling on proven cloud infra — no vendor lock-in, full observability.

ScrapyPlaywrightPython 3.12RedisPostgreSQLApache AirflowAWS LambdaS3CloudWatch2CaptchaCapSolverResidential ProxiesDockerKubernetesGrafanaPrometheus
Scrapy + Playwright Stack

Scrapy handles crawl orchestration and deduplication. Playwright handles JavaScript rendering for dynamic specification tables and configurator tools.

Table Normalisation Engine

Custom Python middleware designed specifically for industrial catalogues. It reconstructs DOM matrices to ensure row spans map correctly to component columns.

Cloud-Native Orchestration

Pipelines run on AWS Lambda and ECS. Airflow handles scheduling and dependency management. All state is stored in managed Postgres.

Output & Delivery

Your data, your destination

Data delivered to where your team already works — no new tooling required.

JSON
Newline-delimited or nested arrays for complex configurations
CSV
Flat file with typed columns for engineering teams
XLS
Native Excel format for procurement review
Parquet
Columnar format for BigQuery, Snowflake, Athena
AWS S3
Direct bucket delivery on pipeline completion
Webhook
HTTP POST per record for real-time catalogue sync
API
REST endpoints to query your extracted dataset
PostgreSQL
Upsert into your existing schema with conflict resolution
S3
Direct bucket delivery — compatible with any data lake
// faq

Common questions.

About thk.com scraping, legality, and pipeline operations.

Ask us directly →
Can you extract specifications for every THK product series?

Yes. Our pipeline covers LM Guides, Ball Screws, Ball Splines, Actuators, Cross Roller Rings, and spherical plain bearings. We map the entire public catalogue.

How do you handle complex HTML tables?

THK uses heavily nested tables with row spans and column spans. We use custom Python middleware to reconstruct the DOM matrix, ensuring that a static load rating in column 8 correctly maps to the specific part number in column 1.

Do you download the actual CAD files?

No. We extract the metadata, availability flags, and the direct URLs to the CAD portal. Downloading raw STEP or IGES files at scale requires massive bandwidth and often sits behind authentication walls.

Are numeric values clean?

Yes. We strip text units like 'mm', 'kN', and 'kg', cast the values to strict floats, and output clean numerics. The unit type is defined in the schema header.

How often should we update this data?

Industrial catalogues change slowly. Most clients opt for monthly or quarterly pipeline runs to capture new product introductions and specification revisions.

Can you combine THK data with competitor catalogues?

Yes. We frequently build cross-reference databases by scraping multiple manufacturers (e.g., THK, HIWIN, NSK) and mapping their specifications to a unified schema.

$ dataflirt scope --new-project --source=thk.com ready

Tell us what
to extract.
We do the rest.

20-minute scoping call. Pilot dataset within the week. Production within two. Whether you need a full catalogue dump or continuous updates on linear motion specifications — we scope, build, and operate the pipeline. Tell us what you need.

hello@dataflirt.com · Bengaluru · IST · typical reply < 4h
Related Scrapers

More in industrial and mro

Services

Data Extraction for Every Industry

View All Services →