Features
- Persistent shared‑prefix KV cache for reusable prompt prefixes across sessions
- Palimpsest: on‑disk n‑gram archive that drafts from previously generated content at zero cost
- Il Suggeritore: grammar‑as‑draft source proposing constrained tokens during decoding
- Self‑regulating speculative decoding that automatically disables when not beneficial
- The Conclave: consensus‑based multi‑candidate generation to improve answer quality
Recent releases
View all 7 releases →Weekly OSS security release digest.
The CVE patches and breaking changes that affected production tools this week. One email, every Sunday.
No spam, unsubscribe anytime.
Install & Platforms
Platforms
linux
arm64
