Skip to content

Forge

v0.7.6 Feature

This release adds 1 notable feature for engineering teams evaluating rollout.

✓ No known CVEs patched
Read the diff → Tool health → What is this tool? →

✓ No known CVEs patched in this version

Topics

agentic-ai agentic-workflow agents function-calling llama-cpp llamafile
+5 more
llm ollama python self-hosted tool-calling

Summary

AI summary

Inline chain‑of‑thought reasoning is now captured on vLLM and Ollama.

Full changelog

[0.7.6] — 2026-06-20

A bug-fix release for the Ollama backend and inline reasoning capture. Multi-turn tool sessions and multi-part message content no longer 400 against Ollama's native API, and chain-of-thought emitted inline in content is now captured on vLLM and Ollama as it already was on the structured-field path.

Added

  • 16GB-tier MoE models in the published eval set and dashboard (gen-3 regeneration). #107

Changed

  • Think-tag parsing consolidated into one shared helper (forge.prompts.think_tags), de-duplicating inline-reasoning extraction across the llamafile client and prompt templates. #112
  • Scripted test doubles consolidated into a shared conftest fixture, replacing the per-module MockClient stand-ins. #76 (thanks @SuperMarioYL).

Fixed

  • Inline <think> reasoning is captured on vLLM and Ollama. When a reasoning model emits its chain-of-thought inline in content (<think>…</think>) instead of a structured reasoning field, that reasoning is now extracted onto the first tool call — matching the behavior already present for structured reasoning fields. #110
  • Ollama's native /api/chat accepts OpenAI-wire message shapes. On the proxy's native-passthrough path the client's verbatim OpenAI messages reach Ollama's stricter native endpoint. Multi-part array content is now flattened to text, and assistant tool_calls[].function.arguments sent as a JSON string are coerced to objects — fixing 400s on multi-turn tool sessions and on clients that send array-shaped content. #111, #115

Weekly OSS security release digest.

The CVE patches and breaking changes that affected production tools this week. One email, every Sunday.

No spam, unsubscribe anytime.

Share this release

Track Forge

Get notified when new releases ship.

Sign up free

About Forge

All releases →

Related context

Earlier breaking changes

  • v0.7.5 Changes default behavior to replay no reasoning blocks.
  • v0.7.4 Deprecates pydantic `.model_*` API on `ToolCall` and `TextResponse` dataclasses; construction no longer validates argument shape.
  • v0.7.3 Renames `--mode {native,prompt}` to `--backend-capability {native,prompt}`; no deprecation alias.
  • v0.7.0 Unknown‑tool handling now replies with [UnknownToolError] on the tool channel instead of user nudges.
  • v0.7.0 Changes error reporting: step enforcement and prerequisite violations now emit tool‑channel messages with [StepEnforcementError] / [PrereqError].

Beta — feedback welcome: [email protected]