This release adds 1 notable feature for engineering teams evaluating rollout.
✓ No known CVEs patched in this version
Topics
+5 more
Summary
AI summaryInline chain‑of‑thought reasoning is now captured on vLLM and Ollama.
Full changelog
[0.7.6] — 2026-06-20
A bug-fix release for the Ollama backend and inline reasoning capture. Multi-turn tool sessions and multi-part message content no longer 400 against Ollama's native API, and chain-of-thought emitted inline in content is now captured on vLLM and Ollama as it already was on the structured-field path.
Added
- 16GB-tier MoE models in the published eval set and dashboard (gen-3 regeneration). #107
Changed
- Think-tag parsing consolidated into one shared helper (
forge.prompts.think_tags), de-duplicating inline-reasoning extraction across the llamafile client and prompt templates. #112 - Scripted test doubles consolidated into a shared
conftestfixture, replacing the per-moduleMockClientstand-ins. #76 (thanks @SuperMarioYL).
Fixed
- Inline
<think>reasoning is captured on vLLM and Ollama. When a reasoning model emits its chain-of-thought inline incontent(<think>…</think>) instead of a structured reasoning field, that reasoning is now extracted onto the first tool call — matching the behavior already present for structured reasoning fields. #110 - Ollama's native
/api/chataccepts OpenAI-wire message shapes. On the proxy's native-passthrough path the client's verbatim OpenAI messages reach Ollama's stricter native endpoint. Multi-part arraycontentis now flattened to text, and assistanttool_calls[].function.argumentssent as a JSON string are coerced to objects — fixing 400s on multi-turn tool sessions and on clients that send array-shaped content. #111, #115
Weekly OSS security release digest.
The CVE patches and breaking changes that affected production tools this week. One email, every Sunday.
No spam, unsubscribe anytime.
Share this release
About Forge
All releases →Related context
Related tools
Earlier breaking changes
- v0.7.5 Changes default behavior to replay no reasoning blocks.
- v0.7.4 Deprecates pydantic `.model_*` API on `ToolCall` and `TextResponse` dataclasses; construction no longer validates argument shape.
- v0.7.3 Renames `--mode {native,prompt}` to `--backend-capability {native,prompt}`; no deprecation alias.
- v0.7.0 Unknown‑tool handling now replies with [UnknownToolError] on the tool channel instead of user nudges.
- v0.7.0 Changes error reporting: step enforcement and prerequisite violations now emit tool‑channel messages with [StepEnforcementError] / [PrereqError].
Beta — feedback welcome: [email protected]