SYSTEM all green source clicks.co.za queue 12,409 pages p99 latency 312ms dataflirt.com · scraper/clicks-co.za
RUN - 42 active pipelines - clicks.co.za live

Clicks retail data,
extracted at scale.

We extract health, beauty, and pharmacy product listings, ClubCard pricing, store inventory, and brand catalogues from clicks.co.za. Delivered as clean JSON, CSV, or Parquet to S3 or BigQuery on your schedule.

Products extracted
85,214 /run
Price updates
112K /24h
Promo records
18,492 /week
Active pipelines
42
Uptime
99.98%
Data Dictionary

Every field we extract from clicks.co.za

Structured, schema-consistent data across all major object types — delivered clean, typed, and ready to query.

Complete list of extractable fields for Product Listings objects from clicks.co.za. All fields typed and schema-versioned.

skubarcodetitlebrandcategorysub_categorypriceclubcard_pricecurrencyin_stockdescriptioningredientsusage_instructionsimage_urlspage_url
product_listings
● 200 OK
"sku": "314159",
"title": "Eucerin DermoPurifyer Cleansing Gel 200ml",
"brand": "Eucerin",
"price": 249.0,
"clubcard_price": 199.2,
"currency": "ZAR",
"category": "Skincare",
"in_stock": true
# skubarcodetitlebrandcategorysub_category
1
2
3

Complete list of extractable fields for Pricing & Promotions objects from clicks.co.za. All fields typed and schema-versioned.

skubase_pricepromo_priceclubcard_exclusivepromo_typepromo_descriptionvalid_fromvalid_untilbulk_discount_qtybulk_discount_priceprice_timestampcurrency
pricing_& promotions
● 200 OK
"sku": "314159",
"base_price": 249.0,
"promo_price": 199.2,
"clubcard_exclusive": true,
"promo_type": "PERCENTAGE_OFF",
"promo_description": "Save 20% with ClubCard",
"price_timestamp": "2026-05-12T09:14:00Z"
# skubase_pricepromo_priceclubcard_exclusivepromo_typepromo_description
1
2
3

Complete list of extractable fields for Store Inventory objects from clicks.co.za. All fields typed and schema-versioned.

store_idstore_nameregionprovinceskuin_stockstock_quantityclick_and_collect_eligiblepharmacy_availablelast_updated
store_inventory
● 200 OK
"store_id": "CLK_012",
"store_name": "Clicks Sandton City",
"province": "Gauteng",
"sku": "314159",
"in_stock": true,
"stock_quantity": 14,
"click_and_collect_eligible": true
# store_idstore_nameregionprovinceskuin_stock
1
2
3

Complete list of extractable fields for Brand Catalogues objects from clicks.co.za. All fields typed and schema-versioned.

brand_namebrand_urlcategory_focustotal_productsactive_promotionsaverage_pricenew_arrivals_counttop_rated_sku
brand_catalogues
● 200 OK
"brand_name": "CeraVe",
"brand_url": "https://clicks.co.za/brands/cerave",
"category_focus": "Dermatological Skincare",
"total_products": 42,
"active_promotions": 5,
"average_price": 315.5,
"new_arrivals_count": 2
# brand_namebrand_urlcategory_focustotal_productsactive_promotionsaverage_price
1
2
3

Complete list of extractable fields for Reviews & Ratings objects from clicks.co.za. All fields typed and schema-versioned.

review_idskuauthor_namestar_ratingreview_titlereview_textreview_dateverified_buyerhelpful_votessyndicated_source
reviews_& ratings
● 200 OK
"review_id": "REV_98412",
"sku": "314159",
"star_rating": 5,
"review_title": "Excellent for acne-prone skin",
"verified_buyer": true,
"review_date": "2026-04-18",
"helpful_votes": 12
# review_idskuauthor_namestar_ratingreview_titlereview_text
1
2
3

Capabilities

Complete Clicks retail data extraction

Our scraper handles the specific complexities of South African pharmacy retail: ClubCard gated pricing, complex 3-for-2 promotional logic, and regional stock availability.

Full Catalogue Extraction

Extract every SKU across beauty, health, baby, and pharmacy categories. Capture barcodes, ingredients, and usage instructions.

ClubCard Pricing Logic

Capture standard retail prices alongside ClubCard exclusive prices, calculating exact discount percentages per item.

Complex Promotion Tracking

Extract multi-buy offers like 3-for-2, Buy 1 Get 1 Free, and linked product promotions accurately mapped to individual SKUs.

Store-Level Inventory

Query stock availability across Clicks physical locations using geographic coordinates to map regional supply.

Review & Sentiment Mining

Extract customer reviews, ratings, and verified buyer flags to monitor brand sentiment and product efficacy.

Pharmacy & OTC Data

Capture over-the-counter medication details, scheduled drug classifications, and active ingredient compositions.

Search Rank Tracking

Monitor organic search positions for high-value keywords within the Clicks internal search engine.

Geo-Targeted Crawling

Use South African residential proxies to bypass regional blocking and view accurate local pricing.

Delta Extraction

Run continuous pipelines that only output changed prices or stock statuses, reducing data warehouse load.

// engagement pipeline

From target category to warehouse record

Brief in. Clean data out.

Define Scope
d 0

Provide specific brands, categories, or search terms. We map the required data points and extraction frequency.

Pipeline Build
d 2–4

We configure crawlers with South African residential proxies, handle SPA rendering, and map the Clicks DOM.

Validation & QA
d 4–6

We verify ClubCard price calculations, check null rates on ingredient lists, and validate store stock logic.

Delivery
ongoing

Structured records pushed to your preferred endpoint via S3, BigQuery, or direct API integration.

Under the hood

Overcoming Clicks extraction challenges

Retail sites deploy aggressive caching and bot protection. We manage the infrastructure required for reliable data delivery.

pipeline-monitor · clicks.co.za · live ● active
// fingerprinting
Identity rotation
TLS fingerprintrandomised
User-agentrotated
IP poolresidential
Challenges blocked0
// pagination
Page coverage
48,291 pages queued running
// observability
Pipeline health
99.9%
uptime
142ms
p99 lat
0.3%
null rate
2
alerts
Regional access
South African proxy routing

Clicks.co.za often restricts or shapes traffic originating outside Southern Africa. We route all requests through ZA residential and mobile proxy pools to ensure consistent access and accurate regional pricing.

Dynamic pricing
ClubCard and promo hydration

Pricing on Clicks is heavily dependent on JavaScript hydration to display ClubCard savings and multi-buy offers. We execute full Playwright sessions to capture the final rendered price state.

Pagination limits
Deep category traversal

Large categories mask total product counts behind infinite scroll or strict pagination limits. Our crawlers use sub-category filtering and price-band bracketing to extract the complete catalogue without truncation.

Schema volatility
Adaptive DOM parsing

Retailers frequently update product page layouts for promotional events. We use multiple fallback selectors targeting JSON-LD and internal API endpoints to maintain data continuity.

Rate limiting
Controlled request concurrency

Aggressive crawling triggers WAF blocks. We distribute requests across thousands of IPs, managing concurrency and request delays to mimic legitimate user browsing patterns.

Applications

Who uses Clicks data and why

Teams across industries use clicks.co.za data to build competitive products and smarter operations.

01
Competitor Pricing Analysis

FMCG retailers and pharmacies track Clicks standard and ClubCard pricing to adjust their own promotional calendars.

02
Brand Compliance & MAP

Cosmetic and health brands monitor Clicks to ensure adherence to Minimum Advertised Price agreements.

03
Assortment Planning

Retail buyers analyze category depth, new brand introductions, and discontinued lines to optimise their own inventory.

04
Promotional Strategy

Marketing teams track the frequency and structure of 3-for-2 and percentage-off campaigns across specific categories.

05
Consumer Sentiment

Product managers aggregate review text and ratings to identify common complaints or highly praised formulations.

06
Supply Chain Visibility

Distributors monitor out-of-stock indicators across regional stores to forecast demand and adjust supply routes.

Why DataFlirt

"Clicks.co.za holds the definitive catalogue for South African health and beauty retail, but accessing accurate regional pricing requires dedicated infrastructure."

Extracting retail data at scale involves more than simple HTTP requests. Handling ClubCard logic, bypassing regional firewalls with ZA proxies, and parsing complex promotional structures requires a managed approach. DataFlirt handles the extraction layer so your team can focus entirely on retail analytics.

Technical Spec

Clicks scraper technical specifications

Everything supported by our clicks.co.za scraper — rendered SPA elements, auth walls, rate-limit evasion and beyond.

ClubCard pricing extraction
Captures standard price, ClubCard price, and calculates the discount delta.
Supported
Multi-buy promotions
Extracts 3-for-2, Buy 1 Get 1 Free, and category-wide discount text.
Supported
South African proxies
Requests routed through ZA residential IP pools to bypass geo-blocking.
Supported
Store inventory mapping
Queries stock levels across physical Clicks pharmacy locations.
Supported
Ingredient list parsing
Extracts full INCI ingredient lists for cosmetic and skincare products.
Supported
Delta extraction
Emits only records that have changed since the previous pipeline run.
Supported
Prescription script history
Patient-specific medication history and repeat prescription data.
Partial
Personal ClubCard points
Individual user point balances and targeted voucher data.
Partial
Infrastructure

Infrastructure powering the pipeline

Open-source tooling on proven cloud infra — no vendor lock-in, full observability.

ScrapyPlaywrightPython 3.12RedisPostgreSQLApache AirflowAWS LambdaS3CloudWatch2CaptchaCapSolverResidential ProxiesDockerKubernetesGrafanaPrometheus
Scrapy + Playwright Stack

Scrapy manages the crawl state and deduplication, while Playwright handles JavaScript hydration required for Clicks promotional pricing displays.

Regional Proxy Infrastructure

We maintain dedicated pools of South African residential IPs to ensure consistent access and prevent WAF blocking during large catalogue runs.

Cloud-Native Orchestration

Pipelines run on AWS infrastructure with Airflow managing scheduling, retries, and data delivery to your specified warehouse.

Output & Delivery

Your data, your destination

Data delivered to where your team already works — no new tooling required.

JSON
Nested schema ideal for complex promotional structures
CSV
Flat file delivery for immediate spreadsheet analysis
XLS
Excel format for business and category managers
Parquet
Columnar storage optimised for BigQuery and Athena
AWS S3
Direct upload to your corporate storage bucket
Webhook
HTTP POST delivery for real-time price change alerts
API
REST endpoint to query the latest extracted catalogue
PostgreSQL
Direct database upsert with primary key conflict handling
S3
Direct bucket delivery — compatible with any data lake
// faq

Common questions.

About clicks.co.za scraping, legality, and pipeline operations.

Ask us directly →
Can you extract ClubCard exclusive prices?

Yes. Our pipeline captures the standard retail price alongside any advertised ClubCard promotional price, allowing you to calculate the exact consumer saving.

How do you handle 3-for-2 or complex promotions?

Promotional text and logic are extracted into dedicated fields. We map the promotion type (e.g., MULTI_BUY, PERCENTAGE_OFF) and the qualifying conditions directly to the affected SKUs.

Do you use South African IP addresses?

Yes. To ensure accurate pricing and prevent access restrictions, all requests to clicks.co.za are routed through South African residential and mobile proxy networks.

Can we track inventory at specific Clicks stores?

Yes. We can configure the pipeline to query stock availability for specific SKUs across designated Clicks physical store locations using regional identifiers.

How frequently can the data be updated?

We support daily, weekly, or monthly runs. For specific high-priority categories, intraday tracking can be configured to monitor flash sales or rapid stock depletion.

Do you extract product ingredients and usage instructions?

Yes. We extract all available metadata including INCI ingredient lists, usage directions, warnings, and barcode data from the product detail pages.

$ dataflirt scope --new-project --source=clicks.co.za ready

Tell us what
to extract.
We do the rest.

20-minute scoping call. Pilot dataset within the week. Production within two. Specify your target brands, categories, or search terms. We will build and maintain the extraction infrastructure.

hello@dataflirt.com · Bengaluru · IST · typical reply < 4h
Related Scrapers

More in beauty and skincare

Services

Data Extraction for Every Industry

View All Services →