Skip to content

0xMassi/webclaw

v0.1.3 Feature

This release adds 3 notable features for engineering teams evaluating rollout.

Published 2mo MCP Developer Tools
✓ No known CVEs patched
Read the diff → Tool health → What is this tool? →

✓ No known CVEs patched in this version

Topics

ai ai-agents ai-scraping cli crawler data-extraction
+13 more
firecrawl-alternative html-to-markdown llm markdown mcp mcp-server rust self-hosted tls-fingerprinting web-crawler web-extraction web-scraper web-scraping

Summary

AI summary

Added real-time crawl progress streaming, resume/cancel support with saved state, and MCP proxy configuration.

Full changelog

Added

  • Crawl streaming: real-time progress on stderr as pages complete ([2/50] OK https://... (234ms, 1523 words))
  • Crawl resume/cancel: --crawl-state <path> saves visited URLs and pending frontier on Ctrl+C. Resume with the same flag to continue from where you left off
  • MCP proxy support: reads WEBCLAW_PROXY (single proxy) and WEBCLAW_PROXY_FILE (pool file) env vars. Also configurable in Claude Desktop MCP config via env block

Changed

  • Crawl results now expose visited set and remaining frontier for accurate state persistence

Full changelog: https://github.com/0xMassi/webclaw/blob/main/CHANGELOG.md

Full Changelog: https://github.com/0xMassi/webclaw/compare/v0.1.2...v0.1.3

View diff on GitHub

Weekly OSS security release digest.

The CVE patches and breaking changes that affected production tools this week. One email, every Sunday.

No spam, unsubscribe anytime.

Share this release

Share on X Share on Bluesky

Track 0xMassi/webclaw

Get notified when new releases ship.

Sign up free

About 0xMassi/webclaw

Web content extraction for AI agents. 10 tools: scrape, crawl, map, batch, extract, summarize, diff, brand, search, research. TLS fingerprinting bypasses anti-bot without a browser. 67% fewer tokens than raw HTML. `npx create-webclaw` auto-configures Claude, Cursor, Windsurf, Codex, OpenCode.

All releases →

Related context

Beta — feedback welcome: [email protected]