Engineering Blog
Data Intelligence
Estimating inventory from public listings — methods and caveats
Inventory estimates from public data are inherently uncertain. At what point do they become reliable enough to act on?.
From one-off scrape to live API — productizing your ecommerce data feed
The step from a batch file delivery to a live API is enormous in engineering cost. When does it actually justify itself?.
GTIN, UPC, EAN, ASIN, MPN — product identifiers explained for data projects
Which identifier should I use when a product exists on multiple platforms each with their own ID system?.
How much does a one-time ecommerce scrape cost?
Why does one project get quoted $50 on Fiverr and $3,000 from an agency for apparently the same job?.
How to brief a scraping vendor — a one-page spec that gets accurate quotes
I sent three vendors the same vague brief and got quotes from $200 to $4000. How do I write a brief that gets consistent accurate quotes?.
Is it legal to scrape a competitor catalog?
A competitor ToS says no scraping. Does that mean I am breaking the law if I do it anyway?.