Llmff
LLM FrameworksA command‑line and library tool that builds FFmpeg‑style, typed pipelines for LLM inference workflows using YAML manifests
Features
- Typed pipeline graph defined in reproducible YAML manifests
- Backend adapters (e.g., OpenAI) and local retrieval support
- JSON validation, repair, and JSONL trace output
- Built‑in stage inspection and listing utilities
- Plugin system for extending stages, backends, and transports
Recent releases
View all 12 releases →Weekly OSS security release digest.
The CVE patches and breaking changes that affected production tools this week. One email, every Sunday.
No spam, unsubscribe anytime.
Install & Platforms
Install via
cargo
Platforms
linux
macos
windows
arm64
