We extract product listings, membership pricing, ingredient specifications, and reviews from Public Goods. Delivered as clean JSON, CSV, or Parquet to S3, BigQuery, or Snowflake on your cadence.
Structured, schema-consistent data across all major object types — delivered clean, typed, and ready to query.
Complete list of extractable fields for Product Listings objects from publicgoods.com. All fields typed and schema-versioned.
"sku": "PG-GRO-001", "title": "Organic Oats", "category": "Grocery", "retail_price": 6.5, "member_price": 4.5, "in_stock": true, "rating": 4.8, "review_count": 412
| # | sku | title | category | sub_category | retail_price | member_price |
|---|---|---|---|---|---|---|
| 1 | ||||||
| 2 | ||||||
| 3 |
Complete list of extractable fields for Pricing & Membership objects from publicgoods.com. All fields typed and schema-versioned.
"sku": "PG-GRO-001", "retail_price": 6.5, "member_price": 4.5, "subscription_price": 4.27, "subscription_discount": 5, "in_stock": true, "price_timestamp": "2026-05-12T09:14:00Z"
| # | sku | retail_price | member_price | subscription_price | subscription_discount | in_stock |
|---|---|---|---|---|---|---|
| 1 | ||||||
| 2 | ||||||
| 3 |
Complete list of extractable fields for Ingredients & Specs objects from publicgoods.com. All fields typed and schema-versioned.
"sku": "PG-GRO-001", "ingredients_list": "['Organic whole grain rolled oats']", "allergens": "['None']", "vegan": true, "gluten_free": true, "organic": true, "origin_country": "USA"
| # | sku | ingredients_list | allergens | vegan | gluten_free | organic |
|---|---|---|---|---|---|---|
| 1 | ||||||
| 2 | ||||||
| 3 |
Complete list of extractable fields for Reviews & Ratings objects from publicgoods.com. All fields typed and schema-versioned.
"review_id": "REV-98213", "sku": "PG-GRO-001", "reviewer_name": "Sarah M.", "rating": 5, "review_title": "Great quality", "review_body": "These oats are perfect for overnight oats.", "review_date": "2026-04-18", "verified_buyer": true
| # | review_id | sku | reviewer_name | rating | review_title | review_body |
|---|---|---|---|---|---|---|
| 1 | ||||||
| 2 | ||||||
| 3 |
Complete list of extractable fields for Category Taxonomy objects from publicgoods.com. All fields typed and schema-versioned.
"category_id": "CAT-102", "parent_category": "Pantry", "name": "Grains & Pasta", "url": "https://www.publicgoods.com/collections/grains-pasta", "product_count": 24, "scraped_at": "2026-05-12T09:14:33Z"
| # | category_id | parent_category | name | url | product_count | description |
|---|---|---|---|---|---|---|
| 1 | ||||||
| 2 | ||||||
| 3 |
Our scraper handles the specific structure of Public Goods: dual-tier pricing, deep ingredient lists, and subscription logic.
Title, description, images, and category mapping scraped at the SKU level.
Capture standard retail price alongside member-only pricing and subscription discounts.
Extract structured lists of ingredients, allergens, and eco-friendly certifications.
Full review text, star ratings, and verified buyer flags paginated across all products.
Monitor inventory status and stock depth indicators to track supply chain health.
Map the entire site hierarchy from top-level departments down to specific product collections.
Run daily or weekly pipelines to track pricing adjustments and catalogue expansions.
Identify newly added products or discontinued items automatically.
Extract serving sizes, calories, and macronutrient breakdowns from product images and text.
Brief in. Clean data out.
Provide category URLs or target ranges. We design the extraction schema together.
We configure Scrapy / Playwright crawlers, proxy rotation, and session management for publicgoods.com.
Schema validation, null-rate checks, and price-outlier detection before full launch.
JSON / CSV / Parquet pushed to your S3 bucket, BigQuery dataset, or Snowflake stage on agreed cadence.
DTC sites like Public Goods use dynamic frontends and API-driven pricing. Here is how we extract clean data reliably.
Public Goods displays different prices for guests and members. We extract both data points simultaneously by parsing the underlying JSON state objects used by their frontend framework.
Instead of clicking through visual pagination, we map the backend GraphQL or REST endpoints that populate product grids, ensuring zero missed items and faster extraction.
Ingredient lists and nutritional facts are often stored as raw HTML blocks. We apply regex and NLP parsing to convert these blocks into queryable arrays and key-value pairs.
For regular monitoring, we maintain a hash index of last-seen values per field. Subsequent runs only push diffs, reducing compute cost and downstream processing load.
Every run emits structured logs to our observability stack. We alert on null-rate spikes and schema drift, responding before you notice.
DTC brands and retailers monitor membership pricing models to optimise their own subscription tiers.
FMCG researchers analyse ingredient trends, vegan alternatives, and organic formulations.
Consultancies track the prevalence of eco-friendly packaging and certifications across categories.
Retail buyers analyse category depth and new product launches to inform merchandising strategy.
Analysts track review velocity and rating distributions to estimate product popularity and sales volume.
Suppliers audit pricing to ensure minimum advertised price compliance across channels.
"Public Goods offers a masterclass in DTC membership economics, but analysing their strategy requires structured data extraction at scale."
Extracting data from modern headless commerce sites requires more than simple HTML parsing. It requires intercepting API calls, handling dynamic state, and structuring messy ingredient blocks. DataFlirt absorbs that complexity so your analysts can focus on strategy.
Everything supported by our publicgoods.com scraper — rendered SPA elements, auth walls, rate-limit evasion and beyond.
Open-source tooling on proven cloud infra — no vendor lock-in, full observability.
Scrapy handles crawl orchestration and retry logic. Playwright handles JavaScript rendering and interaction flows.
We maintain pools of residential ISP proxies to bypass bot detection. Rotation happens per-request.
Pipelines run on AWS Lambda and ECS. Airflow handles scheduling and dependency management.
Data delivered to where your team already works — no new tooling required.
About publicgoods.com scraping, legality, and pipeline operations.
Ask us directly →No. We extract the publicly visible retail prices and the advertised member prices directly from the product pages without requiring authenticated sessions.
Ingredient data is often unstructured. We use custom parsers to split comma-separated lists, remove filler text, and flag key allergens or certifications.
Yes. By running daily diffs against the category pages, we can flag newly introduced SKUs and discontinued items.
We use US-based residential proxies and manage browser fingerprints to ensure high success rates without triggering rate limits.
Yes, we paginate through all available reviews for a given product, capturing the text, rating, and verified status.
We support JSON, CSV, Parquet, and direct integrations with S3, Snowflake, and PostgreSQL.
20-minute scoping call. Pilot dataset within the week. Production within two. Get structured DTC product and pricing data delivered directly to your warehouse. Tell us your requirements.
