Skip to content
Release history
AIMLPM/markcrawl releases
Crawl websites into clean Markdown, search pages, and extract structured data with LLMs. Built-in MCP server for web research and RAG pipelines.
No immediate action
v0.11.1
Breaking risk
·
Reject print aggregator URLs
Review required
v0.11.0
Breaking risk
·
Dependencies
Binary downloads + filters
Config change
v0.10.6
Breaking risk
·
Auth
Respect robots flag and audit
No immediate action
v0.10.5
Breaking risk
·
Auto‑scope broadening
No immediate action
v0.10.4
Breaking risk
·
Idle‑timeout reset behavior
No immediate action
v0.10.3
Breaking risk
·
Recovery + stall detection + diagnostics
No immediate action
v0.10.2
Bug fix
·
Sitemap discovery timeout fix
No immediate action
v0.10.1
Breaking risk
·
Local default embedder, zero API cost
No immediate action
v0.10.0
Breaking risk
·
Chunker defaults flipped
No immediate action
v0.9.3
New feature
·
Ecommerce path‑scope detection
No immediate action
v0.9.2
Breaking risk
·
Auto‑path scope + priority
Upgrade now
v0.9.1
Breaking risk
·
Breaking upgrade
Defaults reverted
No immediate action
v0.9.0
Breaking risk
·
MRR boost + auto SPA rendering
No immediate action
v0.8.0
New feature
·
Full-page screenshots
No immediate action
v0.7.0
Maintenance
·
Routine maintenance and dependency updates.
No immediate action
v0.6.0
New feature
·
RAG recipe + bug fixes
No immediate action
v0.5.0
New feature
·
Extraction backends + features
No immediate action
v0.4.1
New feature
·
Alt‑text preservation + pages API
No immediate action
v0.4.0
New feature
·
Smart sample clustering
No immediate action
v0.3.1
New feature
·
--include-path filtering
No immediate action
v0.3.0
New feature
·
--exclude-path + --dry-run
No immediate action
v0.2.0
New feature
·
Performance improvement
No immediate action
v0.1.1
Maintenance
·
Routine maintenance and dependency updates.
Search tools, categories, lists, and users
Use ↑↓ to navigate, Enter to open, Esc to close
No results for ""
⌘K to open
↑↓ navigate
⏎ open