crawl4ai
LLM FrameworksAn open‑source web crawler that produces LLM‑ready Markdown for retrieval‑augmented generation and data pipelines.
Features
- Generates clean, structured Markdown optimized for large language models
- Fast async browser pool with caching and adaptive URL discovery
- Full control via sessions, proxies, cookies, user scripts, and hooks
- Deployable anywhere – CLI, Docker image, or cloud‑friendly setup
Recent releases
View all 8 releases →No releases yet
We'll surface new releases as they're published — check back soon.
Weekly OSS security release digest.
The CVE patches and breaking changes that affected production tools this week. One email, every Sunday.
No spam, unsubscribe anytime.
About
Stars
73,210
Forks
7,526
Languages
Python
JavaScript
Shell
Downloads/week
3
↑38%
NPM Maintainers
1
Contributors
88
TypeScript
Types included ✓
Install & Platforms
Install via
pip
