ypollak2/llm-router

v5.3.1 Feature

This release adds 2 notable features for engineering teams evaluating rollout.

Published 1mo LLM Frameworks

View tool

✓ No known CVEs patched

Read the diff → Tool health → What is this tool? →

✓ No known CVEs patched in this version

Topics

ai-routing anthropic claude claude-code cost-optimization gemini

+7 more

litellm llm llm-router mcp-server model-router ollama openai

Summary

AI summary

Introduces a new FastAPI sidecar routing service and context‑aware routing exemptions.

Full changelog

What's New

Sidecar Routing Service

New FastAPI service running on localhost:7337 with intelligent classification
Non-blocking HTTP client hooks with 0.5s timeout
Graceful degradation: if service unavailable, all tools allowed
Eliminates previous routing hangs and deadlock scenarios

Context-Aware Routing

Infrastructure operations (MCP tools, system operations) are automatically exempted from routing
Serena, Obsidian, and other MCP servers work independently
Zero interference with existing MCP ecosystem

Bug Fixes

Fixed missing asyncio import in llm_fs_analyze_context()
Hook architecture refactored for reliability (auto-route: 1256→60 lines)
Enforce-route changed to observation-only mode (never blocks)

Upgrade

pip install --upgrade claude-code-llm-router && llm-router install

Test Results

✅ 897 tests pass with sidecar service fully integrated
✅ Zero deadlock risk (hooks non-blocking, service optional)
✅ Full backward compatibility maintained

View diff on GitHub

Weekly OSS security release digest.

The CVE patches and breaking changes that affected production tools this week. One email, every Sunday.

No spam, unsubscribe anytime.

Share this release

Share on X Share on Bluesky

Track ypollak2/llm-router

Get notified when new releases ship.

About ypollak2/llm-router

Subscription-aware LLM router for Claude Code. Routes tasks to 20+ providers (OpenAI, Gemini, Groq, Ollama, Codex) based on complexity classification, Claude subscription pressure, and cost. Free tasks stay on Claude subscription; expensive tasks fall back to the cheapest capable model. Includes 30 MCP tools, 6 auto-routing hooks, semantic dedup cache, prompt caching, daily spend cap, and a live web dashboard.

All releases →

Related context

Related tools

Earlier breaking changes

v9.2.0 Changes auto‑route directive from advisory "DO NOT SKIP" to hard constraint with explicit blocked tools list.
v9.2.0 Breaks permanent downgrade of enforcement after first Edit/Write; v13 now requires per‑turn routing.