Skip to content

Release history

AIMLPM/markcrawl releases

Crawl websites into clean Markdown, search pages, and extract structured data with LLMs. Built-in MCP server for web research and RAG pipelines.

All releases

23 shown

No immediate action
v0.11.1 Breaking risk

Reject print aggregator URLs

Review required
v0.11.0 Breaking risk
Dependencies

Binary downloads + filters

Config change
v0.10.6 Breaking risk
Auth

Respect robots flag and audit

No immediate action
v0.10.5 Breaking risk

Auto‑scope broadening

No immediate action
v0.10.4 Breaking risk

Idle‑timeout reset behavior

No immediate action
v0.10.3 Breaking risk

Recovery + stall detection + diagnostics

No immediate action
v0.10.2 Bug fix

Sitemap discovery timeout fix

No immediate action
v0.10.1 Breaking risk

Local default embedder, zero API cost

No immediate action
v0.10.0 Breaking risk

Chunker defaults flipped

No immediate action
v0.9.3 New feature

Ecommerce path‑scope detection

No immediate action
v0.9.2 Breaking risk

Auto‑path scope + priority

Upgrade now
v0.9.1 Breaking risk
Breaking upgrade

Defaults reverted

No immediate action
v0.9.0 Breaking risk

MRR boost + auto SPA rendering

No immediate action
v0.8.0 New feature

Full-page screenshots

No immediate action
v0.7.0 Maintenance

Routine maintenance and dependency updates.

No immediate action
v0.6.0 New feature

RAG recipe + bug fixes

No immediate action
v0.5.0 New feature

Extraction backends + features

No immediate action
v0.4.1 New feature

Alt‑text preservation + pages API

No immediate action
v0.4.0 New feature

Smart sample clustering

No immediate action
v0.3.1 New feature

--include-path filtering

No immediate action
v0.3.0 New feature

--exclude-path + --dry-run

No immediate action
v0.2.0 New feature

Performance improvement

No immediate action
v0.1.1 Maintenance

Routine maintenance and dependency updates.

Beta — feedback welcome: [email protected]