Skip to content

ypollak2/llm-router

v8.0.0 Breaking

This release includes breaking changes for platform teams planning a safe upgrade.

Published 29d LLM Frameworks
✓ No known CVEs patched
Read the diff → Tool health → What is this tool? →

✓ No known CVEs patched in this version

Topics

ai-routing anthropic claude claude-code cost-optimization gemini
+7 more
litellm llm llm-router mcp-server model-router ollama openai

Summary

AI summary

Automatic quality scoring added for routed responses with a per-model threshold.

Full changelog

Major release: Automatic quality scoring, developer-first README rewrite, documentation consistency pass, stale asset cleanup.

Added

  • Quality Feedback Loop (Sprint 4)src/llm_router/quality_feedback.py
    • Auto-scores every routed response using content heuristics (code blocks, structure, refusals, citations)
    • Per-model quality tracking with minimum-calls threshold (3) before trusting signal
    • should_skip_model() — routing engine skips models with avg quality < 0.4 for specific task patterns
    • Integrated into router.py dispatch loop and all text.py tools (query, research, generate, analyze, code)
    • 23 new tests in tests/test_quality_feedback.py

Changed

  • Complete README rewrite — developer-first, text-based, high-trust landing page
    • No images/SVGs — shields.io badges only
    • Honest "Use this if / Don't use this if" section
    • Accurate tool count (60 MCP tools), package names, provider list
    • ASCII architecture diagram, markdown tables throughout
  • Documentation consistency pass — corrected "48 tools" → "60 tools" across 10+ docs
  • Package name correctionspip install llm-routing consistently referenced
  • Tool count standardized — 60 MCP tools (56 llm_* + 4 agoragentic_*) across all docs

Removed

  • 18 orphaned SVG assets from docs/readme/ (stale claims, zero references)

Fixed

  • SECURITY.md referenced wrong package name (claude-code-llm-routerllm-routing)
  • HOST_SUPPORT_MATRIX.md referenced wrong install command
  • server.py and docs/TOOLS.md had outdated tool counts

Weekly OSS security release digest.

The CVE patches and breaking changes that affected production tools this week. One email, every Sunday.

No spam, unsubscribe anytime.

Share this release

Track ypollak2/llm-router

Get notified when new releases ship.

Sign up free

About ypollak2/llm-router

Subscription-aware LLM router for Claude Code. Routes tasks to 20+ providers (OpenAI, Gemini, Groq, Ollama, Codex) based on complexity classification, Claude subscription pressure, and cost. Free tasks stay on Claude subscription; expensive tasks fall back to the cheapest capable model. Includes 30 MCP tools, 6 auto-routing hooks, semantic dedup cache, prompt caching, daily spend cap, and a live web dashboard.

All releases →

Related context

Earlier breaking changes

  • v9.2.0 Changes auto‑route directive from advisory "DO NOT SKIP" to hard constraint with explicit blocked tools list.
  • v9.2.0 Breaks permanent downgrade of enforcement after first Edit/Write; v13 now requires per‑turn routing.

Beta — feedback welcome: [email protected]