This release adds 2 notable features for engineering teams evaluating rollout.
✓ No known CVEs patched in this version
Topics
Summary
AI summaryPaid chat calls now stream to prevent idle‑timeout failures and empty length‑exceeded responses are explicitly reported as errors.
Full changelog
Paid chat calls now stream. A non-streaming request to a slow reasoning model
(Kimi K3 with a large prompt generates for minutes) moves ZERO bytes between
"request accepted" and "body ready", so the edge in front of the gateway kills
the idle connection at ~100s and returns 524 — AFTER the x402 payment settled.
Charged, nothing delivered. Observed live 2026-07-21, twice.
fix(chat)— paid EVM paths use SSE streaming and assemble server-side.
All three paid call shapes (explicit model, multi-turnmessages, paid
routing tiers) switch to the SDK'schatCompletionStreamand concatenate
deltas; bytes flow from the first chunk (reasoning models emit keepalive
chunks while thinking), so the idle timer never fires. Verified live: a
125s kimi-k3 generation that 524'd on the old path completes. The free
NVIDIA tier keeps the non-streaming client whose short timeout its
deadline loop depends on; Solana clients have no streaming API and keep
the old path (capability-checked, not assumed).- Empty answer +
finish_reason:"length"is now an explicit error.
Reasoning tokens count towardmax_tokens; a hard task with a small budget
can burn the whole budget thinking and emit zero visible text (measured:
kimi-k3, 8000 max_tokens, 0 chars). That surfaced as a silent empty reply —
indistinguishable from success. It now throws with the cause and the fix
(raisemax_tokens). - Guards that keep the stream honest: a non-SSE response (a route that ignores
stream:true) is parsed as a plain JSON completion instead of yielding "";
an in-banderrorevent throws instead of returning partial text; a stream
with no data for 120s aborts with a stall error (the SDK clears its fetch
timeout once headers arrive, so this idle guard is the only backstop). - x402 accounting is unchanged: the SDK's streaming method runs the same
payment flow and increments the same spend counter the budget ledger reads. - 234 tests (11 new pinning SSE assembly, fallbacks, stall, and the
reasoning-exhaustion diagnosis), typecheck, build green. Server-side half
(settle-on-success / refund on 5xx at the gateway) is tracked separately.
Weekly OSS security release digest.
The CVE patches and breaking changes that affected production tools this week. One email, every Sunday.
No spam, unsubscribe anytime.
Share this release
About blockrunai/blockrun-mcp
Live data for AI agents — search, research, markets, crypto, X/Twitter. Pay-per-call via x402 micropayments.
Related context
Beta — feedback welcome: [email protected]