Engineering Blog
Data Intelligence
Scraping every review of a product line for sentiment analysis
Amazon ToS bans scraping. Is getting a review dataset for research actually legal?.
Scraping footwear and sneakers product data — fields, sources and quirks
Footwear size grids differ across countries EU UK US India. How do I normalize them in a scraped dataset?.
Scraping furniture and home decor product data — fields, sources and quirks
Furniture product pages have hundreds of specifications across wildly different schemas. How do I get consistent attribute data at scale?.
Scraping personal data vs product data — where the legal lines sit
The product data vs personal data distinction sounds clear in theory. In practice with ecommerce seller data where exactly does the line fall?.
Scraping pharmacy and OTC health product data — fields, sources and quirks
Pharmacy product data includes dosage and usage instructions. Does extracting this create any liability?.
Scraping product identifiers — GTIN, UPC, MPN and ASIN extraction
Product pages often do not show GTINs publicly. How do I get them at scale?.