Alternatives to apify/crawlee
26.3k stars · TypeScript · back to the repository
Two measured signals: repositories that share topics (at least two), and repositories discussed in the same threads. Cards are ranked by stars gained this week.
Shares topics with
Repositories with at least two topics in common: most shared topics first. Topics are labels maintainers put on their own repositories, so they say what a project claims to be, not what its code does.
apify/crawlee-python
Crawlee—A web scraping and browser automation library for Python to build reliable crawlers. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Parsel, BeautifulSoup, Playwright, and raw HTTP. Both headful and headless mode. With proxy rotation.
Shared: apify, automation, crawler, crawling +8 more
jo-inc/camofox-browser
Stealth headless browser for AI agents — bypass Cloudflare, bot detection, and anti-scraping. Drop-in Puppeteer/Playwright replacement.
Shared: automation, javascript, nodejs, playwright +3 more
scrapfly/scrapfly-scrapers
Scalable Python web scraping scripts for +40 popular domains
Shared: automation, crawler, crawling, scraper +3 more
D4Vinci/Scrapling
🕷️ The BEST Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDceNQ and follow here for daily tips and tricks: https://x.com/Scrapling_dev
Shared: automation, crawler, crawling, playwright +2 more
unclecode/crawl4ai
Open-source web crawler and scraper for LLMs and AI agents: any website into clean, LLM-ready Markdown. Run it yourself, or use Crawl4AI Cloud with one key. Join our Discord https://discord.gg/VuxzM8mtf
Shared: crawler, playwright, scraper, web-crawler +2 more
getmaxun/maxun
Turn any website into a structured API. Extract, automate, search and monitor the web.
Shared: automation, crawler, crawling, playwright +2 more
spider-rs/spider
Foundational low latency web data collecting in Rust
Shared: automation, crawler, headless-chrome, scraping +2 more
saifyxpro/HeadlessX
The undetected self-hosted browser automation platform. Powered by Camoufox (Firefox) for 0% detection rates. Built for speed, privacy, and scalability.
Shared: automation, headless, headless-chrome, playwright +2 more
microlinkhq/browserless
The headless Chrome/Chromium driver on top of Puppeteer. Take screenshots, generate PDFs, extract text and HTML with a production-ready API.
Shared: automation, headless, javascript, nodejs +2 more
Everything we measure about apify/crawlee · stars over time, growth, contributors, issues and pull requests.