Skip to content

pragmar/mcp-server-webcrawl

MCP Data & Storage

Advanced search and retrieval server for web crawler data, letting AI clients filter and analyze crawled content via a boolean‑enabled API.

Python Latest v0.15.1 · 4d ago Security brief →

Features

  • Full‑text search with Boolean operators
  • Filter results by type, HTTP status, URL patterns, etc.
  • Multi‑crawler compatibility (ArchiveBox, HTTrack, InterroBot, Katana, SiteOne, WARC, wget)
  • Prompt‑driven routines for SEO audits, 404 detection, performance checks, and more
  • Claude Desktop integration for LLM‑powered querying

Recent releases

View all 2 releases →
No immediate action
v0.15.0 Breaking

Test fixtures relocation

Weekly OSS security release digest.

The CVE patches and breaking changes that affected production tools this week. One email, every Sunday.

No spam, unsubscribe anytime.

About

Stars
41
Forks
16
Languages
Python XSLT HTML

Install & Platforms

Install via
pip
Platforms
linux macos windows

Beta — feedback welcome: [email protected]