Crawlee
Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
Crawlee scores 7.4/10 (Strong) in Crawl & Search.
Language TypeScript License Apache-2.0 Stars 24.5k★ Type library Self-host Yes Repo apify/crawlee Homepage https://crawlee.dev
Quality
Strong 7.4
Adoption 60
Activity 78
Maturity 100
Community 55
Capability 50
Show the math
Overall 7.4/10
value = 7.4/10
score = value
Adoption 6.4/10
value = 59.7/100
score = 1 + 9 * value / 100
Activity 8.1/10
value = 78.4/100
score = 1 + 9 * value / 100
Maturity 10/10
value = 100/100
score = 1 + 9 * value / 100
Community 6/10
value = 55.4/100
score = 1 + 9 * value / 100
Capability 5.5/10
value = 50/100
score = 1 + 9 * value / 100
Key metrics
24.4k★ GitHub stars
120/90d Recent commits
22 devs/90d Recent contributors
9.9y Project age
active Last commit
Gotchas
No gotchas documented yet. Contribute one if you know a constraint we missed.
Labels
- Self-hosted
Self-hosted
You deploy and operate it yourself; there is no hosted option here.
crawler scraper nodejs typescript playwright