Skip to content

Transformers

LLM Frameworks

A library that provides unified model definitions for state‑of‑the‑art text, vision, audio, video, and multimodal models across training and inference frameworks

Python Latest v5.14.1 · 10d ago Security brief →

Features

  • Unified model definition for PyTorch, TensorFlow, JAX and other frameworks
  • Supports text, vision, audio, video, and multimodal models
  • Compatible with major training libraries (Axolotl, DeepSpeed, FSDP, etc.)
  • Works with popular inference engines (vLLM, SGLang, TGI, llama.cpp, etc.)
  • Access to over 1 million pretrained model checkpoints on the Hugging Face Hub

Recent releases

View all 30 releases →
No immediate action
v5.14.1 Bug fix

sdpa prefill + assisted decoding fixes

Review required
v5.14.0 Breaking risk
Breaking upgrade

Inkling + TIPSv2 + breaking changes

No immediate action
v5.13.1 Bug fix

Fixes legacy/new linear layer name handling

No immediate action
v5.13.0 Breaking risk

Routine maintenance and dependency updates.

No immediate action
v5.10.3 Bug fix

Multiple bug fixes

Weekly OSS security release digest.

The CVE patches and breaking changes that affected production tools this week. One email, every Sunday.

No spam, unsubscribe anytime.

About

Stars
162,711
Forks
33,929
Languages
Python Dockerfile Makefile

Install & Platforms

Install via
pip

Beta — feedback welcome: [email protected]