Skip to content

LLM Harbor

v0.5.4 Feature

This release adds 2 notable features for engineering teams evaluating rollout.

Published 6d LLM Frameworks
✓ No known CVEs patched
Read the diff → Tool health → What is this tool? →

✓ No known CVEs patched in this version

Topics

ai automation shell cli container docker
+10 more
self-hosted llm local mcp npm package pypi safetensors server tools

Summary

AI summary

First‑boot failures across many services are fixed and LiteLLM gains ready‑made llama.cpp/optillm routing configs.

Full changelog

Misc

A hardening release: a runnable integration suite now exercises 40 Harbor services end-to-end, and everything it caught is fixed.

  • New tests/services-integration.sh runs the whole service integration suite (grouped, with --groups/--list), backed by a written spec in tests/services-integration.md.
  • First-boot failures fixed across many services: SearXNG (stale settings crash-loop), Langflow and AnythingLLM (storage permissions), LibreChat (RAG database race and a broken Ollama endpoint URL), LibreTranslate, Plandex (install source, server image, port, postgres pin), webtop builds, fabric, cmdh, and metamcp headless start.
  • chat-ui works with Harbor backends again on current upstream versions.
  • LDR's SearXNG search integration and persistent data storage now work; Presenton reaches Ollama and no longer requires login setup.
  • Bifrost restarts cleanly with a persisted config; optillm is reachable on its published port; mcp-inspector no longer spawns runaway processes.
  • LiteLLM gains ready-made llama.cpp and optillm routing configs.
  • harbor up accepts cross-file service selectors like harbor up mcpo mcp-server-time.
  • Boost now returns the backend's real HTTP status and error body instead of an empty 200 when a request is rejected, and logs handled backend errors as a single concise line.
  • harbor pull rejects unknown service names with a clear error instead of starting Ollama.
  • ROCm GPU variants (llama.cpp, Ollama, LocalAI, Lemonade) verified with real inference on AMD hardware, with the runner detecting ROCm hosts automatically.

Full Changelog: https://github.com/av/harbor/compare/v0.5.3...v0.5.4

Weekly OSS security release digest.

The CVE patches and breaking changes that affected production tools this week. One email, every Sunday.

No spam, unsubscribe anytime.

Share this release

Track LLM Harbor

Get notified when new releases ship.

Sign up free

About LLM Harbor

Containerized LLM toolkit. Run LLM backends, APIs, frontends, and additional services via a concise CLI. `Apache-2.0` `Docker/Shell`

All releases →

Related context

Earlier breaking changes

  • v0.5.3 Removes built-in Boost workflow presets and keel/sightline modules.
  • v0.5.0 llamacpp becomes default backend, replacing Ollama.

Beta — feedback welcome: [email protected]