Dream Server

v2.0.0 Feature

This release adds 3 notable features for engineering teams evaluating rollout.

Published 4mo AI Agents & Assistants

View tool

✓ No known CVEs patched

Read the diff → Tool health → What is this tool? →

✓ No known CVEs patched in this version

Topics

ai-agents amd comfyui docker llama-cpp llm

+9 more

local-ai n8n nvidia open-webui self-hosted speech-to-text strix-halo text-to-speech workflow-automation

Summary

AI summary

Updates Highlights, local/cloud/hybrid, and A100/H100 across a mixed release.

Full changelog

Dream Server v2.0.0 — Strix Halo

One command to a full local AI stack. Buy hardware. Run installer. AI running.

Highlights

AMD Strix Halo support — ROCm 7.2 with unified memory tiers (SH_LARGE, SH_COMPACT), running Qwen3 Coder Next 80B MoE on a single APU
NVIDIA ultra tier — NV_ULTRA for 90GB+ multi-GPU setups (A100/H100)
Modular installer — 2591-line monolith rewritten as 6 libraries + 13 phases, each in its own file
Bootstrap mode — chat in under 2 minutes with a tiny model while the full model downloads in the background
Extension system — every service is a manifest + compose fragment, hot-pluggable via dream enable/disable
13 integrated services — LLM inference, chat UI, voice (STT + TTS), AI agents, workflow automation, RAG, web search, deep research, image generation, and privacy tools
Management dashboard — real-time GPU metrics, service health, model info, all in one view
dream-cli — full stack management with mode switching (local/cloud/hybrid), model swapping, presets

What's Included

| Service | Purpose |
|---------|---------|
| llama-server | LLM inference (CUDA + ROCm) |
| Open WebUI | Chat interface |
| LiteLLM | API gateway (local/cloud/hybrid) |
| OpenClaw | Autonomous AI agents |
| n8n | Workflow automation (400+ integrations) |
| Whisper | Speech-to-text |
| Kokoro | Text-to-speech |
| Qdrant | Vector database for RAG |
| SearXNG | Self-hosted web search |
| Perplexica | Deep research engine |
| ComfyUI | Image generation |
| Privacy Shield | PII scrubbing proxy |
| Dashboard | GPU metrics + service health |

Hardware Auto-Detection

The installer detects your GPU and picks the optimal model:

| Hardware | VRAM | Model |
|----------|------|-------|
| NVIDIA 8-11 GB | RTX 4060 Ti | Qwen 2.5 7B |
| NVIDIA 12-20 GB | RTX 3090 | Qwen 2.5 14B |
| NVIDIA 20-40 GB | RTX 4090 | Qwen 2.5 32B |
| NVIDIA 40+ GB | A100 | Qwen 2.5 72B |
| NVIDIA 90+ GB | Multi-GPU | Qwen3 Coder Next 80B |
| AMD Strix Halo 64 GB | Ryzen AI MAX+ 395 | Qwen3 30B-A3B |
| AMD Strix Halo 96 GB | Ryzen AI MAX+ 395 | Qwen3 Coder Next 80B |

Install

curl -fsSL https://raw.githubusercontent.com/Light-Heart-Labs/DreamServer/main/dream-server/get-dream-server.sh | bash

Full Changelog

See CHANGELOG.md for the complete list of changes.

View diff on GitHub

Weekly OSS security release digest.

The CVE patches and breaking changes that affected production tools this week. One email, every Sunday.

No spam, unsubscribe anytime.

Share this release

Share on X Share on Bluesky

Track Dream Server

Get notified when new releases ship.

About Dream Server

All releases →