Open-source web scrapers for stockx. Extract product data, search results, and category listings with Python and Node.js implementations using Playwright, Puppeteer, and more.
This repository contains production-ready web scrapers for stockx, available in both Python and Node.js. Whether you're building a price tracker, conducting market research, or automating sneaker data collection, these scrapers provide a solid foundation for your projects.
- Choose your language: Python or Node.js
- Select a framework based on your needs
- Get your ScrapeOps API key from https://scrapeops.io/app/register/ai-scraper
- Follow the framework-specific README for installation and usage
These scrapers extract data from stockx.com:
- Product Category: Extract category pages with product listings and navigation
- Product Data: Extract detailed product information including title, price, description, images, and specifications
- Product Search: Scrape search results with product listings, filters, and pagination
All scrapers can integrate with ScrapeOps to help handle stockx's anti-bot measures:
- Proxy Rotation: May help distribute requests across multiple IP addresses
- Request Header Optimization: May optimize headers to reduce detection
- Rate Limiting Management: Built-in rate limiting and retry logic
Note: Anti-bot measures vary by site and may change over time. CAPTCHA challenges may occur and cannot be guaranteed to be resolved automatically. Using proxies and browser automation can help reduce blocking, but effectiveness depends on the target site's specific anti-bot measures.
Free Tier Available: ScrapeOps offers a generous free tier perfect for testing and small-scale scraping.
Get your API key at https://scrapeops.io/app/register/ai-scraper
All scrapers output data in JSONL format (one JSON object per line):
- Efficient: Each line is a complete JSON object
- Streamable: Process line-by-line without loading entire file
- Database-Friendly: Easy to import into databases
- Large Dataset Support: Handles millions of records efficiently
- ✅ You prefer Python ecosystem
- ✅ You need Python-specific libraries
- ✅ You're working in a Python environment
- ✅ You prefer JavaScript/TypeScript
- ✅ You're working in a Node.js environment
- ✅ You want to leverage JavaScript ecosystem
This scraper is provided as-is for educational and commercial use. Please ensure compliance with stockx's Terms of Service and robots.txt when using these scrapers.
See LICENSE for full license details.
This software is provided for educational and commercial purposes. Users are responsible for ensuring their use complies with:
- stockx's Terms of Service
- stockx's robots.txt
- Applicable laws and regulations
- Rate limiting and respectful scraping practices
The authors and contributors are not responsible for any misuse of this software.