Portkey AI Gateway

MCP Developer Tools

An open‑source AI gateway that routes requests to over 250 LLMs via a single fast, low‑latency API.

TypeScript Latest v1.15.2 · 4mo ago Security brief →

Features

Blazing‑fast routing with sub‑millisecond latency and tiny footprint (≈122 KB)
Enterprise‑ready security, auto‑retries, fallbacks, load balancing and conditional routing
Support for multi‑modal models (text, vision, audio, image) and agentic workflows

View all 1 releases →

v1.15.2 Bug fix 4mo

Notable features

Full changelog

Qualifire | Update Guardrails by @yuval-qf in https://github.com/Portkey-AI/gateway/pull/1483
feat: update readme by removing 2024 report and AI engineering hours by @siddharthsambharia-portkey in https://github.com/Portkey-AI/gateway/pull/1493
fix: support azure blob for batches by @b4s36t4 in https://github.com/Portkey-AI/gateway/pull/1496
fix: allow custom scope work with azure agents by @b4s36t4 in https://github.com/Portkey-AI/gateway/pull/1495
make anthropic beta header usage consistent by @narengogi in https://github.com/Portkey-AI/gateway/pull/1491
[bug/behaviour] only execute enabled checks when sequential guardrails are enabled by @narengogi in https://github.com/Portkey-AI/gateway/pull/1492
fix: Bump Vercel Cookbook package versions by @beast-nev in https://github.com/Portkey-AI/gateway/pull/1497
1.15.2 by @VisargD in https://github.com/Portkey-AI/gateway/pull/1499