Skip to content

Discover

Find tools for your stack. Pick an audience — we handle the noise.

Discover picks for LLM Frameworks

See all tools in LLM Frameworks →

On Hacker News

Ranked by discussion

See all →
  1. ypollak2/llm-router

    Subscription-aware LLM router for Claude Code. Routes tasks to 20+ providers (OpenAI, Gemini, Groq, Ollama, Codex) based on complexity classification, Claude subscription pressure, and cost. Free tasks stay on Claude subscription; expensive tasks fall back to the cheapest capable model. Includes 30 MCP tools, 6 auto-routing hooks, semantic dedup cache, prompt caching, daily spend cap, and a live web dashboard.

    Healthy
    13
  2. Agenta

    LLMOps platform for prompt management, LLM evaluation, and observability. Build, evaluate, and monitor production-grade LLM applications with collaborative prompt engineering.

    Healthy
    7
  3. Onyx Community Edition

    Chat UI that works with any LLM. It comes loaded with advanced features like agents, web search, RAG, MCP, deep research, Connectors to 40+ knowledge sources, and more.

    Healthy
    6
  4. ludwig

    Low-code framework for building custom LLMs, neural networks, and other AI models

    Healthy
    3
  5. genkit

    Open-source framework for building AI-powered apps in JavaScript, Go, and Python, built and used in production by Google

    Mixed
    2
  6. Local Deep Research

    AI-powered deep research tool with multi-source search (arXiv, PubMed, web)

    Healthy
    1
  7. LLM Harbor

    Containerized LLM toolkit. Run LLM backends, APIs, frontends, and additional services via a concise CLI. `Apache-2.0` `Docker/Shell`

    Healthy
    1
  8. open-webui

    User-friendly AI Interface (Supports Ollama, OpenAI API, ...)

    Healthy
    1
  9. haystack

    Open-source AI orchestration framework for building context-engineered, production-ready LLM applications. Design modular pipelines and agent workflows with explicit control over retrieval, routing, memory, and generation. Built for scalable agents, RAG, multimodal applications, semantic search, and conversational systems.

    Healthy
    1
  10. Guardrails

    NeMo Guardrails is an open-source toolkit for easily adding programmable guardrails to LLM-based conversational systems.

    At Risk
    0
  11. Text Generation Web UI

    The original local LLM interface. Text, vision, tool-calling, training, and more. 100% offline.

    Healthy
    0
  12. big-AGI

    AI suite powered by state-of-the-art models and providing advanced AI/AGI functions. Includes AI personas, AGI functions, world-class Beam multi-model chats, text-to-image, voice, response streaming, code highlighting and execution, PDF import, presets for developers, much more. Deploy on-prem or in the cloud.

    At Risk
    0

Beta — feedback welcome: [email protected]