Tools
Model Serving & MLOps tools 30 tools
30 tools
Get up and running with Kimi-K2.5, GLM-5, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.
LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.
Generate audiobooks from e-books, voice cloning & 1158+ languages!
⚡SwanLab - an open-source, modern-design AI training tracking and visualization tool. Supports Cloud / Self-hosted use. Integrated with PyTorch / Transformers / verl / LLaMA Factory / ms-swift / Ultralytics / MMEngine / Keras etc.
A high-throughput and memory-efficient inference and serving engine for LLMs
SGLang is a high-performance serving framework for large language models and multimodal models.
Data Infrastructure providing a declarative, incremental approach for multimodal AI workloads.
ZenML : One AI Platform from Pipelines to Agents. https://zenml.io.
Jan is an open source alternative to ChatGPT that runs 100% offline on your computer.
The most powerful and modular diffusion model GUI, api and backend with a graph/nodes interface.
Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.
An open source DevOps tool from the CNCF for packaging and versioning AI/ML models, datasets, code, and configuration into an OCI Artifact.
Build, Manage and Deploy AI/ML Systems
The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!
The open-source voice synthesis studio
Training PyTorch models with differential privacy
A gallery that showcases on-device ML/GenAI use cases and allows people to try and use models locally.
MLX native implementations of state-of-the-art generative image models
OpenAI API-compatible server for streaming transcription, translation, and speech generation
Free and Open Source Machine Translation API. Self-hosted, offline capable and easy to setup.
BirdNET analyzer for scientific audio data processing.