Features
- Routes AI provider requests across multiple backends with lossless protocol translation
- Built‑in fault‑aware circuit breaking and in‑flight failover for high availability
- Weighted request pools, session affinity, and concurrency caps for load balancing
Recent releases
View all 37 releases →Weekly OSS security release digest.
The CVE patches and breaking changes that affected production tools this week. One email, every Sunday.
No spam, unsubscribe anytime.
Install & Platforms
Install via
shell-script
Similar tools
Alternative to
LiteLLM
OpenRouter