Skip to content

ypollak2/llm-router

v5.4.0 Breaking

This release includes breaking changes for platform teams planning a safe upgrade.

Published 1mo LLM Frameworks
✓ No known CVEs patched
Read the diff → Tool health → What is this tool? →

✓ No known CVEs patched in this version

Topics

ai-routing anthropic claude claude-code cost-optimization gemini
+7 more
litellm llm llm-router mcp-server model-router ollama openai

Affected surfaces

breaking_upgrade

Summary

AI summary

Added a comprehensive test suite with 27 new tests covering all v5.0‑v5.3 features.

Full changelog

What's New

Phase 5: Comprehensive Test Suite & Release

  • Added 27 comprehensive tests for all v5.0-v5.3 features
  • Covers Ollama discovery injection, live API enumeration (OpenAI/Gemini), always-on dynamic routing, and /score endpoint
  • Removed obsolete feature flags from test suite
  • Fixed all code quality issues (ruff linting)

Architecture Highlights

  • Live discovery cache with 30-minute TTL
  • Fallback-safe routing when discovery empty
  • Graceful degradation on API failures
  • Free-first model ordering (Ollama/Codex before paid APIs)
  • Production-ready error handling and timeouts

Files Changed

  • 16 files modified
  • 1,041 insertions(+), 141 deletions(-)
  • 27 new comprehensive tests in test_adaptive_router.py

Installation

Upgrade to the latest version:
```bash
pip install --upgrade claude-code-llm-router==5.4.0
llm-router install
```

Or via Claude Code:
```bash
claude plugin reinstall llm-router
```

What Changed Since v5.3.2

  • Phase 1: Ollama discovery injection — cache hit with env var fallback
  • Phase 2: Live API enumeration — OpenAI and Gemini models auto-discovered
  • Phase 3: Always-on dynamic routing — feature flag removed, routing always adaptive
  • Phase 4: Sidecar /score endpoint — HTTP API for model scoring/ranking
  • Phase 5: Comprehensive test suite + release validation

Test Coverage

  • 27 new adaptive router tests
  • Backward compatibility verified
  • All existing tests updated and passing
  • Code quality: ruff linting 100% compliant

Weekly OSS security release digest.

The CVE patches and breaking changes that affected production tools this week. One email, every Sunday.

No spam, unsubscribe anytime.

Share this release

Track ypollak2/llm-router

Get notified when new releases ship.

Sign up free

About ypollak2/llm-router

Subscription-aware LLM router for Claude Code. Routes tasks to 20+ providers (OpenAI, Gemini, Groq, Ollama, Codex) based on complexity classification, Claude subscription pressure, and cost. Free tasks stay on Claude subscription; expensive tasks fall back to the cheapest capable model. Includes 30 MCP tools, 6 auto-routing hooks, semantic dedup cache, prompt caching, daily spend cap, and a live web dashboard.

All releases →

Related context

Earlier breaking changes

  • v9.2.0 Changes auto‑route directive from advisory "DO NOT SKIP" to hard constraint with explicit blocked tools list.
  • v9.2.0 Breaks permanent downgrade of enforcement after first Edit/Write; v13 now requires per‑turn routing.

Beta — feedback welcome: [email protected]