Nenya

v0.7.1 Feature

This release adds 2 notable features for engineering teams evaluating rollout.

Published 16d LLM Frameworks

View tool

✓ No known CVEs patched

Read the diff → Tool health → What is this tool? →

✓ No known CVEs patched in this version

Topics

ai ai-gateway ai-governance ai-proxy ai-safety ai-security

+14 more

ai-tools anthropic deepseek litellm-alternative llm llm-gateway observability ollama openai openai-compatible-api openai-proxy opencode-zen proxy zhipu-ai

Summary

AI summary

Fixes stream backpressure, resilience callbacks on disconnect, and proxy MCP scanner buffer limits.

Changes in this release

Type	Severity	Summary	CVE
Feature	Low	Add SSE transformed-output backpressure guard Add SSE transformed-output backpressure guard Source: llm_adapter@2026-07-15 Confidence: high	—
Feature	Low	Add pooling to reduce streaming allocations Add pooling to reduce streaming allocations Source: llm_adapter@2026-07-15 Confidence: high	—
Bugfix
Bugfix	Medium	Prevent CB pollution on client disconnect during failover Prevent CB pollution on client disconnect during failover Source: llm_adapter@2026-07-15 Confidence: high	—
Bugfix	Medium	Prevent half-open inflight leak on client disconnect Prevent half-open inflight leak on client disconnect Source: llm_adapter@2026-07-15 Confidence: high	—
Bugfix	Medium	Fix MCP bufferStreamResponse scanner limit Fix MCP bufferStreamResponse scanner limit Source: llm_adapter@2026-07-15 Confidence: high	—
Bugfix	Medium	Prevent pool pollution and fix drain timeout in stream module Prevent pool pollution and fix drain timeout in stream module Source: llm_adapter@2026-07-15 Confidence: high	—
Refactor	Low	Extract convertToAnthropicFormat to reduce routing complexity Extract convertToAnthropicFormat to reduce routing complexity Source: llm_adapter@2026-07-15 Confidence: high	—

Full changelog

Changelog

2edba97219fea0bd9c971d6c8e3a6b9ba06850c4 Merge phase-010-failover-ctx-cancel: prevent CB pollution on client disconnect during failover
dfd79e0574219df7891ef6be161e91662928aedf Merge phase-011-cb-inflight-leak: prevent half-open inflight leak on client disconnect
c54264d441057601ca12b76ff2cec250a46fd22b Merge phase-012-sse-backpressure: SSE transformed-output backpressure guard
d45441730509f94cebe6faf620df71f75a5bdd93 Merge phase-013-mcp-scanner-fix: MCP scanner buffer fix
8a47ba5ae1701b920e5d212df0f1e5b1793e0d63 feat(stream): add SSE transformed-output backpressure guard
8b14ec7b41006651b63a59e26d119475614a03a1 feat(stream): add pooling to reduce streaming allocations
eb121e52c237b31ef6d66fd0feb3b07f316dfbcd fix(proxy): fix MCP bufferStreamResponse scanner limit
2aa6ea658a37862688c0ad4ec7f032c04fe698ec fix(resilience): prevent CB pollution on client disconnect during failover
70a53bd248c1a6e9c6091911ed24679bd2875294 fix(resilience): prevent half-open inflight leak on client disconnect
e343930c8c2703aa04dea8661c60f7d8798df21e fix(stream): prevent pool pollution and fix drain timeout
914e36d0badf9b76f06e95572aa384e9a63d8035 refactor(routing): extract convertToAnthropicFormat to reduce complexity