We extract medical-grade product listings, clinical trial metrics, formulation details, and physician directories from Obagi. Delivered as clean JSON, CSV, or Parquet to S3, BigQuery, or Snowflake on your cadence.
Structured, schema-consistent data across all major object types — delivered clean, typed, and ready to query.
Complete list of extractable fields for Product Listings objects from obagi.com. All fields typed and schema-versioned.
"sku": "OBG-1029", "title": "Professional-C Serum 20%", "product_line": "Professional-C", "price": 142.0, "currency": "USD", "size": "1 fl oz", "skin_type": "Normal to Oily", "skin_concern": "Fine Lines and Wrinkles"
| # | sku | title | product_line | price | currency | size |
|---|---|---|---|---|---|---|
| 1 | ||||||
| 2 | ||||||
| 3 |
Complete list of extractable fields for Ingredients & Formulations objects from obagi.com. All fields typed and schema-versioned.
"sku": "OBG-1029", "key_ingredients": "['L-ascorbic acid']", "ingredient_percentages": "20%", "formulation_type": "Serum", "fragrance_free": false, "full_ingredient_list": "Propylene glycol, water, L-ascorbic acid, alcohol, ascorbyl glucoside"
| # | sku | title | key_ingredients | ingredient_percentages | full_ingredient_list | formulation_type |
|---|---|---|---|---|---|---|
| 1 | ||||||
| 2 | ||||||
| 3 |
Complete list of extractable fields for Clinical Results objects from obagi.com. All fields typed and schema-versioned.
"sku": "OBG-1029", "study_type": "In-vivo", "participant_count": 35, "duration_weeks": 12, "metric_measured": "Reduction in appearance of fine lines", "improvement_percentage": 87, "before_after_images": "['https://obagi.com/media/ba-1029-pre.jpg', 'https://obagi.com/media/ba-1029-post.jpg']"
| # | sku | study_type | participant_count | duration_weeks | metric_measured | improvement_percentage |
|---|---|---|---|---|---|---|
| 1 | ||||||
| 2 | ||||||
| 3 |
Complete list of extractable fields for Reviews & Ratings objects from obagi.com. All fields typed and schema-versioned.
"review_id": "REV-9921", "sku": "OBG-1029", "rating": 5, "review_title": "Brightens skin instantly", "reviewer_skin_type": "Oily", "reviewer_age": "35-44", "helpful_votes": 12, "date_posted": "2023-11-14"
| # | review_id | sku | reviewer_name | rating | review_title | review_text |
|---|---|---|---|---|---|---|
| 1 | ||||||
| 2 | ||||||
| 3 |
Complete list of extractable fields for Physician Locator objects from obagi.com. All fields typed and schema-versioned.
"clinic_id": "LOC-482", "practice_name": "Advanced Dermatology", "physician_name": "Dr. Sarah Chen", "city": "Irvine", "state": "CA", "zip_code": "92618", "latitude": 33.6846, "longitude": -117.8265, "obagi_premier_partner": true
| # | clinic_id | practice_name | physician_name | address_line1 | city | state |
|---|---|---|---|---|---|---|
| 1 | ||||||
| 2 | ||||||
| 3 |
We extract the full Obagi catalogue, including complex formulation matrices, clinical trial imagery, regimen mappings, and physical clinic locations — bypassing bot protection and dynamic rendering.
Extract active ingredients, exact concentration percentages (e.g., 20% L-ascorbic acid), and full INCI lists from product description accordions.
Capture participant counts, study durations, measured metrics, improvement percentages, and before/after image URLs.
Map individual SKUs to multi-step clinical systems like Nu-Derm and CLENZIderm, preserving the sequence of application.
Extract clinic names, addresses, coordinates, and Obagi Premier Partner status across all geographic radii.
Map products to specific dermatological issues (hyperpigmentation, acne, fine lines) exactly as categorised by Obagi.
Extract review text alongside specific reviewer metadata, including skin type, age range, and verified buyer status.
Monitor availability and pricing across different volume sizes (e.g., 1 fl oz vs 2 fl oz) with daily diffs.
Extract data from obagi.com and its international variants to monitor global pricing and formulation differences.
Capture every SKU, title, product line, price, and descriptive element across the entire eCommerce storefront.
Brief in. Clean data out.
Provide specific product lines, ingredient targets, or geographic regions for the physician locator. We map the schema.
We configure Playwright crawlers to render dynamic clinical data and handle Obagi's specific DOM structures.
Schema validation, checking ingredient list completeness, and verifying coordinate accuracy for clinics.
JSON / CSV / Parquet pushed to your S3 bucket, BigQuery dataset, or Snowflake stage on agreed cadence.
Obagi's site relies on dynamic geospatial locators, complex variant structures, and anti-scraping layers. Here is how we maintain data integrity.
Obagi's physician locator restricts results to a specific radius per query. We programmatically generate a grid of coordinates across the target country, executing overlapping queries to extract the complete national directory of providers without missing clinics.
Critical data like full ingredient lists and clinical trial metrics are hidden within JavaScript-rendered accordions and tabs. We use Playwright to simulate user interactions, expanding all relevant DOM elements before extracting the structured text.
Ingredient naming conventions can vary between legacy product pages and new releases. We apply post-extraction normalisation to ensure active ingredients like 'L-ascorbic acid' and 'Vitamin C' are mapped consistently in your final dataset.
Obagi employs standard eCommerce WAFs to block automated traffic. Our crawlers route requests through US-based residential ISP proxies with realistic TLS fingerprints, ensuring uninterrupted extraction of pricing and inventory data.
Obagi frequently sells products as part of multi-step systems (e.g., Nu-Derm). Our pipeline captures the parent-child relationships between individual SKUs and their required system counterparts, preserving the clinical context of the product.
Cosmetic chemists and R&D teams extract exact active ingredient percentages to benchmark their own clinical formulations against Obagi's standards.
Medical spa operators and retail strategists track Obagi's pricing tiers across different product sizes and lines to optimise their own margins.
Market researchers analyse the correlation between specific skin concerns, formulated ingredients, and customer review demographics.
Medical device manufacturers and competing skincare brands use the physician locator data to build targeted lists of dermatology practices.
Retail buyers monitor Obagi's catalogue additions, discontinuations, and out-of-stock patterns to inform their own inventory purchasing.
Regulatory and marketing teams extract published clinical trial metrics (e.g., 87% reduction in fine lines) to establish baselines for their own product claims.
"Understanding medical-grade skincare requires parsing active ingredient concentrations and clinical outcomes — data that standard retail scrapers miss entirely."
Cosmeceutical data extraction requires domain-specific schema design. DataFlirt captures the exact chemical formulations, multi-step clinical regimens, and geospatial provider networks from Obagi, delivering structured intelligence for cosmetic chemists and retail strategists.
Everything supported by our obagi.com scraper — rendered SPA elements, auth walls, rate-limit evasion and beyond.
Open-source tooling on proven cloud infra — no vendor lock-in, full observability.
Scrapy handles crawl orchestration, deduplication, and retry logic. Playwright handles JavaScript rendering, cookie sessions, and interaction flows for the physician locator.
We maintain pools of residential ISP proxies. Rotation happens per-request with sticky sessions where required to prevent WAF blocking during deep catalogue crawls.
Pipelines run on AWS Lambda and ECS. Airflow handles scheduling, dependency management, and SLA alerting. All state stored in managed Postgres.
Data delivered to where your team already works — no new tooling required.
About obagi.com scraping, legality, and pipeline operations.
Ask us directly →Scraping publicly available information, such as product prices, ingredients, and clinic locations, is generally permissible. DataFlirt targets only public, non-authenticated data. We do not extract patient data or circumvent authentication walls. Clients should review terms of service and consult legal counsel.
The locator restricts results by radius. We programmatically generate a coordinate grid across the target region and execute overlapping queries, ensuring all clinics are captured without hitting the per-query display limits.
Yes. Where Obagi publishes the concentration (e.g., 20% L-ascorbic acid), we parse the text and deliver it as a distinct, typed numerical field in the output schema.
Our schema includes relationship mapping. We extract the individual SKUs and map them to their parent system, including their designated step number in the regimen.
We support one-off extractions, daily runs for inventory and pricing, or weekly runs for catalogue and locator updates depending on your requirements.
Yes. We extract the absolute URLs for before-and-after imagery associated with clinical trial results, delivering them in an array within the product record.
20-minute scoping call. Pilot dataset within the week. Production within two. Whether you need a complete formulation matrix or a continuously updated directory of Obagi providers — we scope, build, and operate the pipeline. Tell us what you need.
