LLM Harbor releases

Lemonade

AMD Lemonade inference server for ROCm GPUs.

harbor up lemonade

Tokscale

Token-level autoscaling proxy for LLM backends.

harbor up tokscale

Misc

• TabbyAPI switched to official image with updated default model and hfdownloader fix

• fix(profile): validate remotely downloaded profiles to prevent command injection (CWE-78) by @sebastiondev in https://github.com/av/harbor/pull/236

• Lint exclusions for vendored third-party caches

Full Changelog: https://github.com/av/harbor/compare/v0.4.14...v0.4.15

Bifrost

Fast OpenAI-compatible AI gateway with provider routing, failover, observability, and Harbor backend bootstrapping.

harbor up bifrost

SurfSense

Private NotebookLM-style research workspace with RAG, citations, browser capture, reports, and podcast generation.

harbor up surfsense

Misc

• Added Harbor CLI sidecar integrations for local agent/editor workflows.
• Added Open WebUI and Harbor Boost integration paths through Bifrost.
• Fixed Unsloth Studio bootstrap portability and Docker Compose run argument passthrough.

Full Changelog: https://github.com/av/harbor/compare/v0.4.13...v0.4.14

Unsloth Studio

No-code fine-tuning UI for the Unsloth library, with a zero-click API key bootstrap that registers Studio as an OpenAI-compatible backend across other Harbor services.

harbor up unsloth-studio

Cross-integrations ready out of the box: Open WebUI, Boost, Aider, OpenCode, Hermes, OpenClaw.

Misc

• Workspace bind mounts on 17 services now stay owned by your host user — recoverable without sudo.
• harbor up no longer errors with invalid spec when HARBOR_HF_CACHE is empty.
• unsloth notebooks now see models pulled by other Harbor services through the shared HF cache.
• langfuse analytics and queue state persist across harbor down/up.
• Aider connects to several cross-integration backends that were previously broken by a bad config mount path.

Full Changelog: https://github.com/av/harbor/compare/v0.4.12...v0.4.13

Beszel

Lightweight server monitoring with Docker stats, pre-provisioned to track the Harbor host on first run.

harbor up beszel

DBHub

Universal database gateway exposed as MCP, pre-connected to Open WebUI via native MCP for zero-click chat-with-your-database.

harbor up dbhub

Misc

• Container-based test matrix runner with per-row HARBOR_HOME isolation, env-file robustness, and a git-reset hook (harbor dev test).
• New 3-pass source linter combining shellcheck, custom HARBORxxx rules, and compose validation (harbor dev lint).
• Manual integration test rewrite focused on end-user outcomes for Beszel and DBHub.
• Hardening fixes: host-user permissions, key validation, and sibling teardown across services.
• Cleared shellcheck warnings flagged by the new lint workflow.

Full Changelog: https://github.com/av/harbor/compare/v0.4.10...v0.4.12

Misc

• Fixed SearXNG settings.yml not enabling JSON format, causing WebUI web search to return 403.
• Fixed SearXNG workspace pointing away from the service template directory.
• Fixed seed-cdi script incorrectly processing .build.yml variant files.

Full Changelog: https://github.com/av/harbor/compare/v0.4.9...v0.4.10

Misc

• New Boost module analogical: generates analogies to ground LLM responses.
• New Boost module deaf: humorously misinterprets user queries and responds to the warped version.
• Open WebUI now defaults to native function calling mode.
• Fixed CLI validation to accept variant-backed services.
• Fixed deaf module to use a clean intermediate LLM instance for misheard calls.

Full Changelog: https://github.com/av/harbor/compare/v0.4.8...v0.4.9

Solo CLI

Local-first AI agent for automating tasks and deploying Physical AI on edge devices, with support for Ollama, vLLM, and llama.cpp backends.

harbor build solo
harbor up solo

ROS MCP Server

MCP bridge that lets LLMs interact with Robot Operating System (ROS) nodes, topics, and services via rosbridge.

harbor build ros-mcp-server
harbor up ros-mcp-server

Misc

• feat: add MiniMax as first-class cloud LLM provider (M2.7 default) by @octo-patch in https://github.com/av/harbor/pull/221
• feat: add solo-cli and ros-mcp-server services by @ddiddi in https://github.com/av/harbor/pull/227
• Remove deprecated VLLM_ATTENTION_BACKEND env var and docs by @genevera in https://github.com/av/harbor/pull/228

• Comprehensive documentation correctness pass across all services and backends.
• Fixed multiple CLI edge-cases: TTY handling, stats hanging, config update data loss, and command bubbling.
• Fixed restart to preserve all active services; fixed SillyTavern init script and server_urls merging.
• Added Tauri E2E automated testing with WebdriverIO.

New Contributors

• @octo-patch made their first contribution in https://github.com/av/harbor/pull/221
• @ddiddi made their first contribution in https://github.com/av/harbor/pull/227

Full Changelog: https://github.com/av/harbor/compare/v0.4.7...v0.4.8

Hermes Agent

Autonomous AI agent by Nous Research with persistent memory, extensible skills, multi-platform gateway, and OpenAI-compatible API.

harbor up hermes

Misc

• llamacpp can now be built from source with harbor llamacpp build on (CUDA and ROCm supported).
• Rewrote llamacpp documentation with updated model management workflow.
• Added rocm and build as recognized service capabilities.

Full Changelog: https://github.com/av/harbor/compare/v0.4.6...v0.4.7

SillyTavern

Feature-rich, locally-installed web UI for interacting with LLMs with support for multiple backends, personas, lorebooks, and extensions.

harbor up sillytavern

Misc

• Fixed llama.cpp cache location in a container.
• Added Jupyter workspace to fixfs for proper permissions handling.
• Removed deprecated configuration files for uWSGI and tool settings.

Full Changelog: https://github.com/av/harbor/compare/v0.4.5...v0.4.6

Harbor App Updates

This release introduces multiple QoL improvements in the Harbor desktop app.

• You can pin favorite services, service cards are cleaner
• UI for harbor models - download llama.cpp, HuggingFace and Ollama models through the app
• Globally available terminal pane with a global (Ctrl + `) shortcut
• Service details page allows to open and tail service logs
• Application sidebar shows shortcuts to currently running active services
• new harbor log aliaas for harbor logs or harbor l
• Fix: concurrent harbor ls during harbor down causing overly high CPU usage
• Fix: model pulling logic for llama.cpp now uses run_llamacpp_pull.

Full Changelog: https://github.com/av/harbor/compare/v0.4.4...v0.4.5

Open Terminal

Lightweight remote shell and file-management API for AI agents — works with Open WebUI out of the box.

harbor up openterminal

harbor models

You can now manage your llama.cpp, HuggingFace and Ollama models in a single concise CLI.

$ ▼ harbor models ls
SOURCE  MODEL                                          SIZE      DETAILS
ollama  qwen3.5:35b                                    23.9 GB   qwen35moe 36.0B Q4_K_M
hf      hexgrad/Kokoro-82M                             358 MB    
hf      Systran/faster-distil-whisper-large-v3         1.5 GB    
llamacpp unsloth/Qwen3-Next-80B-A3B-Instruct-GGUF:Q4_0  45.3 GB   Q4_0

# Use programmatically with jq and other tools
harbor models ls --json

# Pull Ollama models or HF repos
harbor models pull qwen3:8b
harbor models pull bartowski/Llama-3.2-1B-Instruct-GGUF

# Use same ID you can see in `ls` for removing the models
harbor models rm qwen3:8b

Misc

• Add integration tests and mock OpenAI service for CI.
• Fix workspace paths in default.env to point to services directory.
• Fix JSON merger output path in Open WebUI start script.
• Fabric docs updates and CLI fixes.

Full Changelog: https://github.com/av/harbor/compare/v0.4.3...v0.4.4

Cognee

Open-source knowledge engine that transforms raw data into persistent, dynamic AI memory — combines vector search, graph databases, and relational storage. Includes API server and a direct-mode MCP server for IDE integration.

harbor build cognee
harbor up cognee

harbor config search <query>

Built-in config field/value search to supplement native grep workflow:

$ ▼ h config search cache
hf.cache                       /home/everlier/.cache/huggingface
llamacpp.cache                 ~/.cache/llama.cpp
ollama.cache                   ~/.ollama
vllm.cache                     ~/.cache/vllm
txtai.cache                    ~/.cache/txtai
nexa.cache                     ~/.cache/nexa
parllama.cache                 ~/.parllama
lmeval.cache                   ./lmeval/cache

harbor config <service>

You can now manage environment variables of a given service directly with harbor config. This is very similar in functionality to harbor env.

$ ▼ h config ollama ls
OLLAMA_CONTEXT_LENGTH          16384
OLLAMA_NUM_PARALLEL            2
OLLAMA_ORIGINS                 *

$ ▼ h config ollama get ollama.context_length
16384

The command supports same naming convention as the harbor config.

Misc

• harbor size - skip opencode workspaces
• harbor up - print URLs after start
• fix "open" in Harbor App on Linux
• CLI suggestions after typo in a command

Full Changelog: https://github.com/av/harbor/compare/v0.4.2...v0.4.3

OpenFang

Rust-based Agent Operating System that runs autonomous AI agents on schedules with 27 LLM providers and 40 channel adapters.

harbor up openfang

Misc

• llama.cpp: Added ROCm image support and updated image variables for CPU/NVIDIA/ROCM configurations.
• Improved AMD GPU support with better automatic ROCm detection.
• Added migration system with CLI support for managing version transitions.
• harbor doctor now checks Docker without requiring sudo.
• Hands-off installation improvements and updated install documentation.
• Various fixes for harbor link, harbor update, and Docker checks.

Full Changelog: https://github.com/av/harbor/compare/v0.4.1...v0.4.2

Misc

• Fixing incorrect CLI versioning

Full Changelog: https://github.com/av/harbor/compare/v0.4.0...v0.4.1

⚠️ Breaking Change: Services Folder Structure

Harbor v0.4.0 reorganizes the repository structure by moving all service-related files from the root to a dedicated services/ directory. Existing installations require migration.

# Preview changes
harbor migrate --dry-run

# Run migration (creates automatic backup)
harbor migrate

nanobot

An ultra-lightweight personal AI assistant with gateway mode for multi-channel messaging (Telegram, Discord, WhatsApp, Feishu).

harbor up nanobot

Pre-configured to work together with most of inference backends included in Harbor.

Postiz

An open-source, AI-powered social media scheduling tool that supports X, LinkedIn, Reddit, Facebook, Instagram, and more.

harbor up postiz

Misc

• Services are in services folder
• open-webui folder renamed to webui to match the rule of service handles
• Documentation improvements and typo corrections.

Full Changelog: https://github.com/av/harbor/compare/v0.3.41...v0.4.0

Misc

• Renamed Moltbot to OpenClaw across compose files, docs, and assets.

Full Changelog: https://github.com/av/harbor/compare/v0.3.40...v0.3.41

Misc

• Rename Clawdbot to Moltbot (handle changed to moltbot).

Full Changelog: https://github.com/av/harbor/compare/v0.3.39...v0.3.40

Clawdbot

Personal AI assistant that connects to your chat channels through a self-hosted gateway.

harbor up clawdbot

Misc

• Added support for llamacpp model pulls via harbor pull <model>, where <model> is same model ID as used by llama.cpp for HuggingFace

Full Changelog: https://github.com/av/harbor/compare/v0.3.38...v0.3.39

OpenCode

AI-powered coding assistant with server API, terminal UI, and multi-provider LLM support.

harbor up opencode

Misc

• TypeScript-based compose transforms for dynamic configuration
• Update PostgreSQL data volume path in litellm compose file by @genevera in https://github.com/av/harbor/pull/208
• Service logos added to App sidebar
• LiteLLM PostgreSQL pinned to v18 for stability
• Routines path discovery fixes
• Documentation updates for router mode in llamacpp

Full Changelog: https://github.com/av/harbor/compare/v0.3.37...v0.3.38

Misc

• Added logprobs workflow module for Harbor Boost with interactive HTML visualization.
• Updated CLI Reference documentation to reflect harbor.sh commands.
• Fixed ask harbor link in textclip badges.
• landing service for Harbor's future landing page

Full Changelog: https://github.com/av/harbor/compare/v0.3.35...v0.3.37

Photoprism

AI-powered photo management app with face recognition, image classification, and automatic organization.

harbor up photoprism

Khoj

Open-source personal AI "second brain" with chat, semantic search, and RAG for your documents.

harbor up khoj

Misc

• Better initial setup for Omarchy: NVIDIA Container Toolkit installation instructions, Docker Compose version detection for modern non-semver versions

Full Changelog: https://github.com/av/harbor/compare/v0.3.34...v0.3.35

DeerFlow

DeerFlow is a community-driven deep research framework that combines LLMs with web search, web crawling, and multi-agent workflows to generate comprehensive research reports.

harbor up deerflow

ActivePieces

activepieces is an open-source workflow automation tool that allows you to connect apps and automate workflows with AI capabilities. It provides a visual workflow builder similar to Zapier or n8n, with 200+ app connectors and built-in AI features.

harbor up activepieces

Full Changelog: https://github.com/av/harbor/compare/v0.3.33...v0.3.34

AstrBot

Probably the easiest way to bring your local LLM into Discord/Slack and other messengers.

harbor up astrbot

Full Changelog: https://github.com/av/harbor/compare/v0.3.32...v0.3.33

MCP Forge

A decent MCP Proxy / Gateway to manage many MCPs at once with some extra functionality for agents, auth management.

harbor up mcpforge

Misc

• harbor llamacpp models - CURL /v1/models endpoint in running llamacpp service

Full Changelog: https://github.com/av/harbor/compare/v0.3.31...v0.3.32