SYSTEM all green source trustatrader.com queue 12,492 profiles p99 latency 218ms dataflirt.com · scraper/trustatrader-com
RUN - 42 active pipelines - trustatrader.com live

Trustatrader data,
at warehouse scale.

We extract company profiles, service areas, contact details, qualifications, and granular customer reviews from Trustatrader. Delivered as clean JSON, CSV, or Parquet to S3, BigQuery, or Snowflake on your cadence.

Profiles extracted
48K /week
Review records
1.2M /month
Phone numbers
39K /run
Active pipelines
42
Uptime
99.94%
Data Dictionary

Every field we extract from trustatrader.com

Structured, schema-consistent data across all major object types — delivered clean, typed, and ready to query.

Complete list of extractable fields for Trader Profiles objects from trustatrader.com. All fields typed and schema-versioned.

trader_idcompany_nametrader_nameprimary_categorydescriptionphone_numbermobile_numberwebsite_urlemail_addressaddress_linepostcodemember_since
trader_profiles
● 200 OK
"trader_id": "TT-98432",
"company_name": "Smith & Sons Plumbing Ltd",
"primary_category": "Plumbers",
"phone_number": "020 7946 0192",
"website_url": "https://smithplumbinglondon.co.uk",
"postcode": "SW1A 1AA",
"member_since": "2018-04-12"
# trader_idcompany_nametrader_nameprimary_categorydescriptionphone_number
1
2
3

Complete list of extractable fields for Ratings & Reviews objects from trustatrader.com. All fields typed and schema-versioned.

review_idtrader_idauthor_namereview_dateoverall_ratinginitial_impressioncleanlinessvaluepunctualityqualityreview_body
ratings_& reviews
● 200 OK
"review_id": "REV-449210",
"trader_id": "TT-98432",
"overall_rating": 4.8,
"cleanliness": 5.0,
"value": 4.5,
"punctuality": 5.0,
"quality": 5.0,
"review_date": "2023-11-24"
# review_idtrader_idauthor_namereview_dateoverall_ratinginitial_impression
1
2
3

Complete list of extractable fields for Qualifications objects from trustatrader.com. All fields typed and schema-versioned.

trader_idqualification_nameissuing_bodyverification_statusinsurance_typeinsurance_providercoverage_amountexpiry_date
qualifications
● 200 OK
"trader_id": "TT-98432",
"qualification_name": "Gas Safe Registered",
"issuing_body": "Gas Safe Register",
"verification_status": "Verified",
"insurance_type": "Public Liability",
"coverage_amount": "2000000"
# trader_idqualification_nameissuing_bodyverification_statusinsurance_typeinsurance_provider
1
2
3

Complete list of extractable fields for Service Areas objects from trustatrader.com. All fields typed and schema-versioned.

trader_idprimary_locationradius_milespostcodes_coveredcounties_coveredcities_coveredmap_coordinates_latmap_coordinates_lng
service_areas
● 200 OK
"trader_id": "TT-98432",
"primary_location": "Central London",
"radius_miles": 15,
"counties_covered": "['Greater London', 'Surrey']",
"map_coordinates_lat": 51.5074,
"map_coordinates_lng": -0.1278
# trader_idprimary_locationradius_milespostcodes_coveredcounties_coveredcities_covered
1
2
3

Complete list of extractable fields for Search Results objects from trustatrader.com. All fields typed and schema-versioned.

search_termlocation_querypage_numberposition_indextrader_idcompany_nameaverage_ratingreview_countprofile_url
search_results
● 200 OK
"search_term": "Electrician",
"location_query": "Manchester",
"position_index": 3,
"trader_id": "TT-45129",
"company_name": "Sparky Electrics NW",
"average_rating": 4.9,
"review_count": 142
# search_termlocation_querypage_numberposition_indextrader_idcompany_name
1
2
3

Capabilities

Everything you need from Trustatrader - nothing you don't

Our Trustatrader scraper handles UK location routing, paginated category searches, dynamic contact detail rendering, and nested review extraction - with anti-bot circumvention built in.

Full Profile Extraction

Extract company names, descriptions, established dates, and primary trade categories across the entire directory.

Contact Detail Resolution

Execute JavaScript to extract phone numbers and email addresses hidden behind click-to-reveal elements.

Granular Review Scraping

Extract text reviews alongside specific rating criteria including punctuality, quality, value, and cleanliness.

Service Area Mapping

Extract covered postcodes, operating radius, and primary locations to map out trader coverage zones.

Qualification Verification

Scrape listed accreditations, Gas Safe registrations, and public liability insurance statuses.

Category & Location Sweeps

Iterate through all UK postcodes and trade categories to build a comprehensive national database.

Gallery Image Extraction

Extract URLs for portfolio work and previous job images uploaded by traders to their profiles.

Change Detection

Only update records when new reviews are posted or profile contact information changes.

Scheduled + Streaming Modes

Run one-off bulk exports or configure continuous pipelines at weekly or daily cadences.

// engagement pipeline

From postcode list to warehouse record

Brief in. Clean data out.

Define Scope
d 0

Provide postcodes, categories, or trader URLs. We design the extraction schema together.

Pipeline Build
d 2–4

We configure Scrapy / Playwright crawlers, proxy rotation, and session management for trustatrader.com.

Validation & QA
d 4–6

Schema validation, null-rate checks, and data normalisation before full launch.

Delivery
ongoing

JSON / CSV / Parquet pushed to your S3 bucket, BigQuery dataset, or Snowflake stage on agreed cadence.

Under the hood

How our Trustatrader pipeline handles the hard parts

Directory scraping requires navigating rate limits and dynamic element loading. Here is how we maintain stable extraction.

pipeline-monitor · trustatrader.com · live ● active
// fingerprinting
Identity rotation
TLS fingerprintrandomised
User-agentrotated
IP poolresidential
Challenges blocked0
// pagination
Page coverage
48,291 pages queued running
// observability
Pipeline health
99.9%
uptime
142ms
p99 lat
0.3%
null rate
2
alerts
Anti-bot layer
UK residential proxy rotation + fingerprint spoofing

Directory sites monitor request velocity and IP origins. Our crawlers use UK residential ISP proxies with realistic browser fingerprints and randomised request timing to prevent IP bans.

JavaScript rendering
Playwright execution for click-to-reveal elements

Trustatrader hides phone numbers behind JavaScript events to prevent basic scraping. We run full Playwright browser sessions to trigger these events and capture the rendered contact details.

Location simulation
Injecting UK postcodes for accurate search results

Search results vary heavily by location. We simulate searches across a comprehensive grid of UK postcodes to ensure complete coverage of all regional tradespeople.

Schema stability
Resilient selectors for directory layout updates

Directory layouts change frequently. Our selector strategy uses multiple fallback chains per field so a minor CSS update does not break your data pipeline.

Change detection
Only re-scrape what has changed

For continuous monitoring, we maintain a hash index of last-seen values. Subsequent runs only push diffs when new reviews are added or contact details change, reducing compute cost.

Applications

Who uses Trustatrader data - and how

Teams across industries use trustatrader.com data to build competitive products and smarter operations.

01
Lead Generation

B2B suppliers target specific trades with verified contact details to sell wholesale materials or software.

02
Market Research

Analysts map trade density and competition levels across UK postcodes to identify underserved regions.

03
Reputation Management

Agencies track client reviews and rating trends across multiple directory platforms for their contractor clients.

04
Insurance & Compliance

Firms verify stated qualifications, Gas Safe registrations, and public liability insurance coverage at scale.

05
Local SEO Aggregation

Marketing teams build secondary directories or local search tools using structured baseline data.

06
Pricing Intelligence

Researchers analyse the correlation between service quality scores and perceived value ratings across different trades.

Why DataFlirt

"Trustatrader holds the ground truth for UK local services, but extracting verified contact details and granular review data requires handling dynamic DOM elements and strict rate limits."

Most teams underestimate the investment required: reliable directory scraping requires UK residential proxies, JavaScript rendering for click-to-reveal contact details, and rigorous schema maintenance. DataFlirt absorbs that complexity so your engineers can focus on the analysis - not the infrastructure.

Technical Spec

Trustatrader scraper - technical capabilities

Everything supported by our trustatrader.com scraper — rendered SPA elements, auth walls, rate-limit evasion and beyond.

JavaScript rendering
Full Playwright sessions required for dynamic content and phone numbers
Supported
UK Residential proxies
ISP-grade residential IPs from UK pools to bypass geo-restrictions
Supported
Click-to-reveal phone numbers
Automated interaction to extract obfuscated contact details
Supported
Granular rating categories
Extraction of 6 specific sub-ratings per review
Supported
Postcode radius search
Iteration through UK postcode grid for comprehensive coverage
Supported
Historical review pagination
Full review corpus extraction across all paginated views
Supported
Change detection (diffs)
Hash-based diff to only emit records with new reviews or updates
Supported
Webhook delivery
HTTP POST per record for real-time downstream processing
Supported
Trader dashboard analytics
Profile view counts and lead metrics require trader account credentials
Partial
Direct messaging history
Private communication between customers and tradespeople
Partial
Infrastructure

Infrastructure powering the Trustatrader pipeline

Open-source tooling on proven cloud infra — no vendor lock-in, full observability.

ScrapyPlaywrightPython 3.12RedisPostgreSQLApache AirflowAWS LambdaS3CloudWatch2CaptchaCapSolverResidential ProxiesDockerKubernetesGrafanaPrometheus
Scrapy + Playwright Stack

Scrapy handles crawl orchestration and deduplication. Playwright handles JavaScript rendering for contact details and interaction flows.

Residential Proxy Infrastructure

We maintain pools of UK residential ISP proxies. Rotation happens per-request to prevent rate limiting and IP blocks.

Cloud-Native Orchestration

Pipelines run on AWS Lambda and ECS. Airflow handles scheduling, dependency management, and SLA alerting.

Output & Delivery

Your data, your destination

Data delivered to where your team already works — no new tooling required.

JSON
Newline-delimited or nested - schema versioned per run
CSV
Flat file with typed columns - Excel/Sheets compatible
Parquet
Columnar format for BigQuery, Snowflake, Athena
S3
Direct bucket delivery - compatible with any data lake
Webhook
HTTP POST per record for real-time downstream processing
API
REST endpoint for querying extracted data on demand
BigQuery
Streamed directly into your dataset with schema auto-detect
Snowflake
Stage + COPY INTO workflow - incremental or full-replace
Postgres
Upsert into your existing schema with conflict resolution
// faq

Common questions.

About trustatrader.com scraping, legality, and pipeline operations.

Ask us directly →
Is scraping Trustatrader legal?

Scraping publicly available information from directories is generally permissible under applicable UK law. DataFlirt targets only public, non-authenticated profile and review data. We do not extract private messages or circumvent authentication walls. Clients should review Trustatrader's ToS and consult legal counsel for specific use cases.

How do you extract phone numbers that require a click?

We use Playwright to render the page in a headless browser, locate the click-to-reveal element, trigger the JavaScript event, and extract the resulting phone number from the updated DOM.

Can you extract data for specific UK regions only?

Yes. We can scope the pipeline to specific postcodes, counties, or cities, reducing extraction time and focusing only on the geographic areas relevant to your business.

How fresh is the data?

For continuous monitoring pipelines, we can configure daily or weekly runs to capture new reviews and profile updates. Full directory refreshes typically complete within a 24-48 hour window depending on category depth.

Do you capture all the specific rating categories?

Yes. We extract the overall rating as well as the granular scores for initial impression, cleanliness, value, punctuality, and quality for every single review.

What is the minimum viable engagement?

Our smallest packages start at a defined category or regional list (typically 5,000-10,000 profiles) with monthly delivery. Contact us with your specific requirements for a scoped quote.

Can I request a sample dataset before committing?

Absolutely. We provide a sample run of up to 500 profiles as part of the pre-engagement scoping process so you can validate schema fit and data quality before signing a contract.

$ dataflirt scope --new-project --source=trustatrader.com ready

Tell us what
to extract.
We do the rest.

20-minute scoping call. Pilot dataset within the week. Production within two. Whether you need a one-off UK directory dump or a continuous review-monitoring feed - we scope, build, and operate the pipeline. Tell us what you need.

hello@dataflirt.com · Bengaluru · IST · typical reply < 4h
Services

Data Extraction for Every Industry

View All Services →