Engineering Blog
Data Intelligence
Scraping toys and games product data — fields, sources and quirks
Safety certification data for toys is often not machine-readable. It is in images or PDFs linked from the product page.
Scraping variant-level pricing — size and color premiums
Variant pricing is hidden until you select the specific combination. How do you capture it at scale?.
Seeding a product database for a new ecommerce platform — bulk extraction blueprint
How many products does a new platform need to be useful at launch and how do you get them without a supplier relationship?.
Sourcing coupon and deal data for aggregation platforms
Coupon codes expire so fast that scraped data is often stale before it is even delivered. How do deal sites solve this?.
The product data a recommendation engine actually needs
Recommendation engines trained on thin or inconsistent product data produce embarrassing results. What is the minimum viable attribute set?.
Should you use a UPC database or custom scraping to get product identifier data?
UPC databases claim full coverage but often have stale or incorrect data. When is custom scraping worth the extra cost?.