ypollak2/llm-router

v7.6.0 Feature

This release adds 5 notable features for engineering teams evaluating rollout.

Published 1mo LLM Frameworks

View tool

✓ No known CVEs patched

Read the diff → Tool health → What is this tool? →

✓ No known CVEs patched in this version

Topics

ai-routing anthropic claude claude-code cost-optimization gemini

+7 more

litellm llm llm-router mcp-server model-router ollama openai

Summary

AI summary

Complete agent resource budgeting system with session allocation, tracking, reconciliation and cost estimation.

Full changelog

Agent Resource Budgeting

Complete agent resource budgeting system with provisional tracking and reconciliation.

Key Features

Session Budget Allocation — Smart budget carving based on quota pressure (30% allocation)
Provisional Spend Tracking — Real-time budget management preventing budget over-commitment
Budget Reconciliation — 50% refunds on failure, final cost on success
Cost Estimation — Accurate estimates by complexity (simple $0.15, moderate $1.00, complex $4.00)
Hard Limits — Per-agent max $5.00, session max $50.00

What's Changed

src/llm_router/hooks/agent-route.py: Session budget initialization + provisional tracking
src/llm_router/hooks/agent-error.py: Budget reconciliation with smart refunds
tests/test_agent_resource_budgeting.py: 12 comprehensive tests (all passing)

Fixed

Test helper bug where budget file was reinitializing on every call instead of persisting

See CHANGELOG.md for full details.

View diff on GitHub

Weekly OSS security release digest.

The CVE patches and breaking changes that affected production tools this week. One email, every Sunday.

No spam, unsubscribe anytime.

Share this release

Share on X Share on Bluesky

Track ypollak2/llm-router

Get notified when new releases ship.

About ypollak2/llm-router

Subscription-aware LLM router for Claude Code. Routes tasks to 20+ providers (OpenAI, Gemini, Groq, Ollama, Codex) based on complexity classification, Claude subscription pressure, and cost. Free tasks stay on Claude subscription; expensive tasks fall back to the cheapest capable model. Includes 30 MCP tools, 6 auto-routing hooks, semantic dedup cache, prompt caching, daily spend cap, and a live web dashboard.

All releases →

Related context

Related tools

Earlier breaking changes

v9.2.0 Changes auto‑route directive from advisory "DO NOT SKIP" to hard constraint with explicit blocked tools list.
v9.2.0 Breaks permanent downgrade of enforcement after first Edit/Write; v13 now requires per‑turn routing.