pragmar/mcp-server-webcrawl
MCP Data & StorageAdvanced search and retrieval server for web crawler data that lets AI clients filter, analyze, and build knowledge bases from crawled content.
Features
- Claude Desktop ready
- Multi‑crawler compatible (supports ArchiveBox, HTTrack, InterroBot, Katana, SiteOne, WARC, wget, etc.)
- Powerful boolean search with field filters (type, HTTP status, …)
- Provides prompt routines for SEO audits, 404 detection, performance checks, file organization, and a Gopher‑style interface
Recent releases
View all 2 releases →Weekly OSS security release digest.
The CVE patches and breaking changes that affected production tools this week. One email, every Sunday.
No spam, unsubscribe anytime.
Install & Platforms
Install via
pip
Platforms
linux
macos
windows
