Skip to content

ypollak2/llm-router

v7.1.0 Feature

This release adds 3 notable features for engineering teams evaluating rollout.

Published 1mo LLM Frameworks
✓ No known CVEs patched
Read the diff → Tool health → What is this tool? →

✓ No known CVEs patched in this version

Topics

ai-routing anthropic claude claude-code cost-optimization gemini
+7 more
litellm llm llm-router mcp-server model-router ollama openai

Summary

AI summary

Automatically balance usage across Claude, Gemini CLI, and Codex subscriptions with a new QUOTA_BALANCED routing profile.

Full changelog

v7.1.0 — Quota-Balanced Routing & Cross-Subscription Load Balancing (2026-04-21)

New feature: Automatically balance usage across Claude, Gemini CLI, and Codex subscriptions.

Added

  • QUOTA_BALANCED Routing Profile — Dynamically reorder chains to balance quota consumption across three subscription providers

    • Monitors real-time pressure: Claude (session/weekly limits), Gemini CLI (daily), Codex (daily)
    • Within ±10% band → use free-first tiebreak order (codex → gemini_cli → claude)
    • Imbalance > ±10% → route to least-used provider first
    • Prevents one subscription from being exhausted while others remain underutilized
  • llm_quota_status MCP Tool — Real-time visibility into subscription quota balance

    • Shows usage % for each provider
    • Route priority recommendations
    • Time to next reset (UTC midnight for Gemini CLI/Codex, custom for Claude)
    • Balance metrics and reordering decisions
  • Codex Daily Quota Tracking — Local counter for OpenAI free tier (1000 req/day)

    • Persisted in ~/.llm-router/codex_quota.json
    • Auto-resets at UTC midnight
    • Integrated with quota-balance calculations
  • Gemini CLI Quota Recording — Increment counter on successful requests

    • Alias record_gemini_request() for router integration
    • Complements existing get_gemini_pressure() monitoring

Configuration

# Use QUOTA_BALANCED to automatically balance subscriptions
llm_router_profile = "quota_balanced"

# Or configure via env:
export LLM_ROUTER_PROFILE=quota_balanced

# Codex daily limit (default 1000 for free tier):
export CODEX_DAILY_LIMIT=1000

Technical

  • New module: src/llm_router/quota_balance.py (quota tracking + chain reordering)
  • Router integration: _build_and_filter_chain() applies quota-aware reordering when profile == QUOTA_BALANCED
  • Request recording: Added after successful Codex/Gemini CLI calls in _dispatch_model_loop()
  • Type definition: Added QUOTA_BALANCED = "quota_balanced" to RoutingProfile enum

Performance

  • Quota checks are async and cached per request

Weekly OSS security release digest.

The CVE patches and breaking changes that affected production tools this week. One email, every Sunday.

No spam, unsubscribe anytime.

Share this release

Track ypollak2/llm-router

Get notified when new releases ship.

Sign up free

About ypollak2/llm-router

Subscription-aware LLM router for Claude Code. Routes tasks to 20+ providers (OpenAI, Gemini, Groq, Ollama, Codex) based on complexity classification, Claude subscription pressure, and cost. Free tasks stay on Claude subscription; expensive tasks fall back to the cheapest capable model. Includes 30 MCP tools, 6 auto-routing hooks, semantic dedup cache, prompt caching, daily spend cap, and a live web dashboard.

All releases →

Related context

Earlier breaking changes

  • v9.2.0 Changes auto‑route directive from advisory "DO NOT SKIP" to hard constraint with explicit blocked tools list.
  • v9.2.0 Breaks permanent downgrade of enforcement after first Edit/Write; v13 now requires per‑turn routing.

Beta — feedback welcome: [email protected]