LLM Frameworks OSS tools — 5 tracked with release & CVE alerts

ypollak2/llm-router Healthy open source

Subscription-aware LLM router for Claude Code. Routes tasks to 20+ providers (OpenAI, Gemini, Groq, Ollama, Codex) based on complexity classification, Claude subscription pressure, and cost. Free tasks stay on Claude subscription; expensive tasks fall back to the cheapest capable model. Includes 30 MCP tools, 6 auto-routing hooks, semantic dedup cache, prompt caching, daily spend cap, and a live web dashboard.

FastGPT Healthy open source

open-webui Healthy open source 1 tracking

User-friendly AI Interface (Supports Ollama, OpenAI API, ...)

LLM Harbor Healthy open source

Containerized LLM toolkit. Run LLM backends, APIs, frontends, and additional services via a concise CLI. `Apache-2.0` `Docker/Shell`

OmniRoute open source

Self-hostable AI gateway with 4-tier cascading fallback and multi-provider load balancing. Supports 200+ models across OpenAI, Anthropic, Google, and local providers.

Tools