Tools
Model Serving & MLOps tools 30 tools
30 tools
LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.
Build, Manage and Deploy AI/ML Systems
Get up and running with Kimi-K2.5, GLM-5, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.
Jan is an open source alternative to ChatGPT that runs 100% offline on your computer.
ZenML : One AI Platform from Pipelines to Agents. https://zenml.io.
Data Infrastructure providing a declarative, incremental approach for multimodal AI workloads.
The most powerful and modular diffusion model GUI, api and backend with a graph/nodes interface.
Generate audiobooks from e-books, voice cloning & 1158+ languages!
A high-throughput and memory-efficient inference and serving engine for LLMs
A gallery that showcases on-device ML/GenAI use cases and allows people to try and use models locally.
SGLang is a high-performance serving framework for large language models and multimodal models.
⚡SwanLab - an open-source, modern-design AI training tracking and visualization tool. Supports Cloud / Self-hosted use. Integrated with PyTorch / Transformers / verl / LLaMA Factory / ms-swift / Ultralytics / MMEngine / Keras etc.
An open source DevOps tool from the CNCF for packaging and versioning AI/ML models, datasets, code, and configuration into an OCI Artifact.
Free and Open Source Machine Translation API. Self-hosted, offline capable and easy to setup.
Training PyTorch models with differential privacy
The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!
Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.
OpenAI API-compatible server for streaming transcription, translation, and speech generation
BirdNET analyzer for scientific audio data processing.
MLX native implementations of state-of-the-art generative image models
The open-source voice synthesis studio