Skip to content

LLM Harbor

LLM Frameworks

Containerized LLM toolkit. Run LLM backends, APIs, frontends, and additional services via a concise CLI. `Apache-2.0` `Docker/Shell`

Python Latest v0.5.4 · 6d ago Security brief →

Features

  • CLI tool to spin up a complete local LLM stack
  • Supports back‑end engines such as Ollama, llama.cpp, vLLM
  • Provides front‑ends like Open WebUI with web RAG and TTS/STT capabilities
  • Includes supporting services (e.g., SearXNG for search)

Recent releases

View all 33 releases →
No immediate action
v0.5.4 Bug fix

Boot fixes + LiteLLM routing

Review required
v0.5.3 Breaking risk
RBAC RCE / SSRF Breaking upgrade

Removes presets & keel

No immediate action
v0.5.2 Bug fix

.env fixes + doctor hang

No immediate action
v0.5.1 Breaking risk

Registry check removal + timeout guard

Config change
v0.5.0 Breaking risk
Breaking upgrade

llamacpp default backend

Weekly OSS security release digest.

The CVE patches and breaking changes that affected production tools this week. One email, every Sunday.

No spam, unsubscribe anytime.

About

Stars
3,143
Forks
213
Languages
Python Shell TypeScript

Community & Support

Beta — feedback welcome: [email protected]