Skip to content

0xMassi/webclaw

v0.1.6 Feature

This release adds 2 notable features for engineering teams evaluating rollout.

Published 2mo MCP Developer Tools
✓ No known CVEs patched
Read the diff → Tool health → What is this tool? →

✓ No known CVEs patched in this version

Topics

ai ai-agents ai-scraping cli crawler data-extraction
+13 more
firecrawl-alternative html-to-markdown llm markdown mcp mcp-server rust self-hosted tls-fingerprinting web-crawler web-extraction web-scraper web-scraping

Summary

AI summary

Added watch mode with diffing and webhook notifications for crawl/watch events.

Full changelog

Added

Watch Mode

Monitor any URL for content changes with automatic diffing:

# Check every 5 minutes
webclaw https://example.com/pricing --watch --watch-interval 300

# Run a script when changes are detected
webclaw https://example.com --watch --on-change "./notify.sh"

# With proxy rotation to avoid rate limits
webclaw https://example.com --watch --proxy-file proxies.txt

Outputs unified diffs to stdout. Status messages to stderr. Ctrl+C stops cleanly.

Webhook Notifications

POST JSON payloads on crawl/batch complete and watch changes:

# Discord
webclaw https://example.com --crawl --webhook "https://discord.com/api/webhooks/..."

# Slack
webclaw https://example.com --watch --webhook "https://hooks.slack.com/..."

# Any endpoint
webclaw https://example.com --crawl --webhook "https://your-api.com/hook"

Auto-detects Discord and Slack URLs and formats payloads as embeds/blocks. Generic endpoints receive raw JSON.

Also available via WEBCLAW_WEBHOOK_URL env var.

Full changelog: https://github.com/0xMassi/webclaw/blob/main/CHANGELOG.md

Full Changelog: https://github.com/0xMassi/webclaw/compare/v0.1.5...v0.1.6

View diff on GitHub

Weekly OSS security release digest.

The CVE patches and breaking changes that affected production tools this week. One email, every Sunday.

No spam, unsubscribe anytime.

Share this release

Share on X Share on Bluesky

Track 0xMassi/webclaw

Get notified when new releases ship.

Sign up free

About 0xMassi/webclaw

Web content extraction for AI agents. 10 tools: scrape, crawl, map, batch, extract, summarize, diff, brand, search, research. TLS fingerprinting bypasses anti-bot without a browser. 67% fewer tokens than raw HTML. `npx create-webclaw` auto-configures Claude, Cursor, Windsurf, Codex, OpenCode.

All releases →

Related context

Beta — feedback welcome: [email protected]