Skip to content

Tools

LLM Frameworks tools 26 tools

Submit tool
Category
Health

26 tools

ypollak2/llm-router Healthy open source

Subscription-aware LLM router for Claude Code. Routes tasks to 20+ providers (OpenAI, Gemini, Groq, Ollama, Codex) based on complexity classification, Claude subscription pressure, and cost. Free tasks stay on Claude subscription; expensive tasks fall back to the cheapest capable model. Includes 30 MCP tools, 6 auto-routing hooks, semantic dedup cache, prompt caching, daily spend cap, and a live web dashboard.

Agenta Healthy open source

LLMOps platform for prompt management, LLM evaluation, and observability. Build, evaluate, and monitor production-grade LLM applications with collaborative prompt engineering.

Onyx Community Edition Healthy open source

Chat UI that works with any LLM. It comes loaded with advanced features like agents, web search, RAG, MCP, deep research, Connectors to 40+ knowledge sources, and more.

ludwig Healthy open source

Low-code framework for building custom LLMs, neural networks, and other AI models

genkit Mixed open source

Open-source framework for building AI-powered apps in JavaScript, Go, and Python, built and used in production by Google

FastGPT Healthy open source
Local Deep Research Healthy open source

AI-powered deep research tool with multi-source search (arXiv, PubMed, web)

LLM Harbor Healthy open source

Containerized LLM toolkit. Run LLM backends, APIs, frontends, and additional services via a concise CLI. `Apache-2.0` `Docker/Shell`

Transformers Healthy open source
open-webui Healthy open source 1 tracking

User-friendly AI Interface (Supports Ollama, OpenAI API, ...)

gpt4free Healthy open source
haystack Healthy open source

Open-source AI orchestration framework for building context-engineered, production-ready LLM applications. Design modular pipelines and agent workflows with explicit control over retrieval, routing, memory, and generation. Built for scalable agents, RAG, multimodal applications, semantic search, and conversational systems.

crawl4ai At Risk open source
Text Generation Web UI Healthy open source

The original local LLM interface. Text, vision, tool-calling, training, and more. 100% offline.

Guardrails At Risk open source

NeMo Guardrails is an open-source toolkit for easily adding programmable guardrails to LLM-based conversational systems.

big-AGI At Risk open source

AI suite powered by state-of-the-art models and providing advanced AI/AGI functions. Includes AI personas, AGI functions, world-class Beam multi-model chats, text-to-image, voice, response streaming, code highlighting and execution, PDF import, presets for developers, much more. Deploy on-prem or in the cloud.

chat-ui At Risk open source

The open source codebase powering HuggingChat

Anthropic vendor

Frontier large language models — Claude Opus, Sonnet, and Haiku. Long context, tool use, vision, and computer use. Accessible via the Claude API, AWS Bedrock, and Google Vertex AI.

Google Gemini vendor

Google's Gemini model family — multimodal (text, vision, audio, video), long context, and code execution. Accessible via the Gemini API, Google AI Studio, and Vertex AI.

OpenAI vendor

GPT family of models — GPT-5, GPT-5 mini, o-series reasoning, Whisper, embeddings, and image generation. Accessible via the OpenAI API, Azure OpenAI, and partner platforms.

OpenClaw Zero Token Healthy open source
SillyTavern Healthy open source

LLM Frontend for Power Users.

AdalFlow At Risk open source

AdalFlow: The library to build & auto-optimize LLM applications.

Happy LLM At Risk open source
Cursor vendor

AI-first code editor built on top of VS Code. Tab completions, agentic edits across files, and a chat that can run commands and edit code. Subscription-based; supports multiple model backends.

OmniRoute open source

Self-hostable AI gateway with 4-tier cascading fallback and multi-provider load balancing. Supports 200+ models across OpenAI, Anthropic, Google, and local providers.

Beta — feedback welcome: [email protected]