Skip to content

Tools

LLM Frameworks tools 15 tools

Submit tool
Category
Health
#llm

15 tools

ypollak2/llm-router Healthy open source

Subscription-aware LLM router for Claude Code. Routes tasks to 20+ providers (OpenAI, Gemini, Groq, Ollama, Codex) based on complexity classification, Claude subscription pressure, and cost. Free tasks stay on Claude subscription; expensive tasks fall back to the cheapest capable model. Includes 30 MCP tools, 6 auto-routing hooks, semantic dedup cache, prompt caching, daily spend cap, and a live web dashboard.

Onyx Community Edition Healthy open source

Chat UI that works with any LLM. It comes loaded with advanced features like agents, web search, RAG, MCP, deep research, Connectors to 40+ knowledge sources, and more.

ludwig Healthy open source

Low-code framework for building custom LLMs, neural networks, and other AI models

genkit Mixed open source

Open-source framework for building AI-powered apps in JavaScript, Go, and Python, built and used in production by Google

FastGPT Healthy open source
gpt4free Healthy open source
open-webui Healthy open source 1 tracking

User-friendly AI Interface (Supports Ollama, OpenAI API, ...)

Transformers Healthy open source
LLM Harbor Healthy open source

Containerized LLM toolkit. Run LLM backends, APIs, frontends, and additional services via a concise CLI. `Apache-2.0` `Docker/Shell`

haystack Healthy open source

Open-source AI orchestration framework for building context-engineered, production-ready LLM applications. Design modular pipelines and agent workflows with explicit control over retrieval, routing, memory, and generation. Built for scalable agents, RAG, multimodal applications, semantic search, and conversational systems.

chat-ui At Risk open source

The open source codebase powering HuggingChat

big-AGI At Risk open source

AI suite powered by state-of-the-art models and providing advanced AI/AGI functions. Includes AI personas, AGI functions, world-class Beam multi-model chats, text-to-image, voice, response streaming, code highlighting and execution, PDF import, presets for developers, much more. Deploy on-prem or in the cloud.

AdalFlow At Risk open source

AdalFlow: The library to build & auto-optimize LLM applications.

Happy LLM At Risk open source
SillyTavern Healthy open source

LLM Frontend for Power Users.

Beta — feedback welcome: [email protected]