I scraped 10M Shopify products to build an API

Hacker News

Hi HN! I'm Param, founder of Agora. The Agora API enables developers to search, purchase, and track orders for 10 million products sold on 25,000 Shopify and WooCommerce stores. You can search by text, image, URL, or location to find products. Every Shopify store has several public JSON files that are available on the same URL route. The file for general store information appears at [Base URL]/meta.json. Product information appears at [Base URL]/products.json. Variant and inventory information appears at [Base URL]/[Product Route].js. Every WooCommerce store has a similar file that has a different data structure. The store information appears at [Base URL]/wp-json/. Product information appears at [Base URL]/wp-json/wc/v1/products. I bought a list of e-commerce stores and built a crawler to index the store and product information. The crawler runs every day to add, edit, and delete product information for all stores. When you retrieve product details via the API, we dynamically check the price, stock, and variant information. This ensures that we only sell products that are currently available, at the real-time price. We're starting with 25,000 Shopify and WooCommerce stores and will soon have products from other e-commerce platforms and marketplaces including Amazon, Walmart, Etsy, Wix, Squarespace, and more. I'd love your feedback!

Visit product View on Hacker NewsJan 30, 2025

Share card

Actual performance

1points

1comments

Did not reach leaderboard

Launch Intel predictions

Analyze your own launch →

Indie HackersFits the IH revenue-focused audience · Strong signals: para, including · Missing: supports, reddit linkedin, podcasting

91%91% predicted probability of success on Indie Hackers, based on ML models trained on real launch data.

best fitHighest predicted score across all platforms for this description.

Product HuntOn track for Day 1 leaderboard · Missing: mac, agents, macos

70%70% predicted probability of success on Product Hunt, based on ML models trained on real launch data.

Hacker NewsStrong engagement from HN community · Strong signals: 000, io, including · Missing: https docs, excited, just released

56%56% predicted probability of success on Hacker News, based on ML models trained on real launch data.

nativeThis product was originally launched on this platform.

TrustMRRLess likely to generate early MRR · Strong signals: para · Missing: mobile apps, ios, personal

45%45% predicted probability of success on TrustMRR, based on ML models trained on real launch data.

AppSumoMay struggle as an AppSumo deal · Strong signals: platform, soon · Missing: plus, intuitive, reviews

17%17% predicted probability of success on AppSumo, based on ML models trained on real launch data.

Acquire.comPre-revenue stage for this audience · Strong signals: shopify · Missing: arr, mrr, revenue

16%16% predicted probability of success on Acquire.com, based on ML models trained on real launch data.

BetaListMay not resonate with beta-testers · Missing: web3, chat, crypto

0%0% predicted probability of success on BetaList, based on ML models trained on real launch data.

Incorrect prediction on native model

Similar products

Build API with Rails Chapter 5 Released42%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Build API with Rails Chapter 5 Released

Hacker News1

I scraped 25M Shopify products to build a search engine51%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

I scraped 25M Shopify products to build a search engine

Hacker News317

I scraped 200M Shopify products to build a search engine62%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

I scraped 200M Shopify products to build a search engine

Hacker News23

Top Shopify Vendors31%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Top Shopify Vendors

Hacker News2

Courate43%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Faire, Shopify, and Cameo in one.

Indie Hackerscommitment-full-time

Kiri27%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

"Shopify-ing" how we get haircuts

Product Hunt+8

Agora API74%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

API to search, purchase, and track 10M Shopify products

Product Hunt+378API

Star Ratings for Shopify Products38%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Star Ratings for Shopify Products

Hacker News11

newCo54%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Build products without code via screencasts

Indie Hackerscommitment-side-project

DropVoice | Shopify App54%Launch Intel prediction score: how likely this product is to succeed on its source platform, based on its name, tagline, and description.

Attach A Voice Note To Your Products

Indie Hackers1$100/mob2c

Browse all products Analyze your launch