Shopify's Open Secret: Every Store Exposes /products.json Build in public: how I turned a 10-line trick into a working Shopify scraper — no login, no CAPTCHA, no anti-bot. If you've ever tried scraping an e-commerce site, you know the drill: Cloudflare walls, CAPTCHAs, session tokens, cat-and-mouse games with anti-bot teams. Then I discovered that most Shopify stores hand you their entire product catalog on a silver platter. The trick Every Shopify store has a public JSON endpoint: https://STORE.com/products.json?limit=250&page=1 No auth. No CAPTCHA. Just clean JSON — title, price, variants, SKUs, inventory, tags. For the store, it's the API behind their own product pages. For us, it's a gift. The whole scraper in 10 lines import requests def get_products ( store_url , max_pages = 4 ): base = store_url . rstrip ( " / " ) + " /products.json " products = [] for page in range ( 1 , max_pages + 1 ): data = requests . get ( f " { base } ?limit=250&page= { page } " , timeout = 20 ). json () items = data . get ( " products " , []) if not items : break products . extend ( items ) return products That's it. Paginate until empty, and you have a store's full catalog. Real result: kith.com I ran it against a real store while writing this. One page, 250 products, 215 variants in the response — including this: { "title" : "Nike WMNS Moon Shoe - Sail / Chlorophyll" , "price" : 105.0 , "sku" : "14318102" , "inventory" : null , "available" : false , "tags" : "sneaker, nike, footwear, ..." } Every variant has its own SKU, price, and compare-at price. That's competitor intelligence data — prices, stock, product launches — sitting behind a single GET request. Try it yourself (30 seconds) Don't take my word for it — run this and see the live response: curl -s "https://kith.com/products.json?limit=5&page=1" | head -c 2000 If you get JSON back, the store is scrapeable the easy way. (Not all stores leave it open — test before you commit to a project.) What's it good for? Competitor monitoring — track when a rival changes prices or restocks Dropshipping / product research — find what's trending across stores Catalog snapshots — for analytics, dashboards, or AI training data The honest limits Only works on Shopify stores (non-Shopify sites return nothing — check https://store.com/products.json first) Some big stores disable it or rate-limit aggressively (usually the ones with the most aggressive bot protection) Inventory data is sometimes null — the store decides what to expose The polished version Full disclosure: I built this and I maintain it — it's the tool I use for my own competitor monitoring. If you want this packaged and ready-to-run, I published it as a free-to-try Apify actor — handles pagination, normalization, and exports clean CSV/JSON/Excel. No Docker setup, no proxy management, runs on demand. Otherwise the 10 lines above are all you need. If you're doing competitor research or building a price tracker, try the endpoint first — you might not need a battle against anti-bot at all. Have you found other public endpoints like this? Drop them in the comments — the good ones deserve a thread.