monolabsdev/openbench-ai

Features

Chat & Messaging

• Multi-model conversations: Chat with multiple local LLMs simultaneously with real-time, side-by-side streaming responses
• Smart conversation titles: Chats are automatically titled after the first reply
• Guest mode: Start temporary conversations that won't be saved to disk
• Archive conversations: Keep your chat history organized by archiving old conversations

Model Management

• One-click model discovery: Browse and pull models directly from Ollama
• Download progress tracking: Monitor pull progress as models download
• Switch models mid-conversation: Change between different models without starting a new chat
• Custom system prompts: Set custom system prompts on a per-model basis

User Interface

• Theme support: Choose between dark and light themes
• Collapsible sidebar: Full conversation search with a smooth, space-conscious design
• Settings panel: Accessible via Ctrl+, for quick access to preferences
• Polished animations: Smooth transitions, loading spinners, and clean notifications throughout the app

Privacy and Local-First Design

• Your data, your models: All conversations and models stay on your machine, nothing leaves your computer without your explicit action
• Works offline: No internet connection required
• Optional user accounts: Sign in with email and password to keep chats separate across devices, or use guest mode to keep everything ephemeral

Known Limitations

This is an early release. Some features and refinements are still in progress:

• Additional LLM providers (OpenAI, Anthropic) are on the roadmap
• Slash command support (/skills) is planned for a future release
• Performance optimizations for large conversation histories are in development

System Requirements

• OS: Windows
• Ollama: Required for local LLM support (download from ollama.ai)

[!IMPORTANT]
Currently unavailable for MacOS and Linux.

Report issues on the GitHub Issues page.