LLM Frameworks OSS tools — 17 tracked with release & CVE alerts

Onyx Community Edition Healthy open source

Chat UI that works with any LLM. It comes loaded with advanced features like agents, web search, RAG, MCP, deep research, Connectors to 40+ knowledge sources, and more.

gpt4free Healthy open source

Agenta Healthy open source

LLMOps platform for prompt management, LLM evaluation, and observability. Build, evaluate, and monitor production-grade LLM applications with collaborative prompt engineering.

genkit Healthy open source

Open-source framework for building AI-powered apps in JavaScript, Go, and Python, built and used in production by Google

FastGPT Healthy open source

Local Deep Research Healthy open source

AI-powered deep research tool with multi-source search (arXiv, PubMed, web)

Transformers Healthy open source

LLM Harbor Healthy open source

Containerized LLM toolkit. Run LLM backends, APIs, frontends, and additional services via a concise CLI. `Apache-2.0` `Docker/Shell`

haystack Healthy open source

Open-source AI orchestration framework for building context-engineered, production-ready LLM applications. Design modular pipelines and agent workflows with explicit control over retrieval, routing, memory, and generation. Built for scalable agents, RAG, multimodal applications, semantic search, and conversational systems.

ludwig Healthy open source

Low-code framework for building custom LLMs, neural networks, and other AI models

crawl4ai Healthy open source

open-webui Healthy open source 1 tracking

User-friendly AI Interface (Supports Ollama, OpenAI API, ...)

Guardrails Healthy open source

NeMo Guardrails is an open-source toolkit for easily adding programmable guardrails to LLM-based conversational systems.

ypollak2/llm-router Healthy open source

Subscription-aware LLM router for Claude Code. Routes tasks to 20+ providers (OpenAI, Gemini, Groq, Ollama, Codex) based on complexity classification, Claude subscription pressure, and cost. Free tasks stay on Claude subscription; expensive tasks fall back to the cheapest capable model. Includes 30 MCP tools, 6 auto-routing hooks, semantic dedup cache, prompt caching, daily spend cap, and a live web dashboard.

big-AGI Healthy open source

AI suite powered by state-of-the-art models and providing advanced AI/AGI functions. Includes AI personas, AGI functions, world-class Beam multi-model chats, text-to-image, voice, response streaming, code highlighting and execution, PDF import, presets for developers, much more. Deploy on-prem or in the cloud.

SillyTavern Healthy open source

LLM Frontend for Power Users.

chat-ui Healthy open source

The open source codebase powering HuggingChat

Tools