This release adds 3 notable features for engineering teams evaluating rollout.
Published 2mo
Model Serving & MLOps
✓ No known CVEs patched
✓ No known CVEs patched in this version
Topics
docker
flakes
go
hosting
http
inference
+9 more
llm
multiplexer
nix
nixos
openai
proxy
router
sglang
vllm
Summary
AI summaryAdded NixOS options to serve llama-cpp, sglang, and vllm.
Weekly OSS security release digest.
The CVE patches and breaking changes that affected production tools this week. One email, every Sunday.
No spam, unsubscribe anytime.
Share this release
About LLMhop
All releases →Beta — feedback welcome: [email protected]