Skip to content

LocalAI

v4.5.1 Feature

This release adds 5 notable features for engineering teams evaluating rollout.

Published 1mo Model Serving & MLOps
✓ No known CVEs patched
Read the diff → Tool health → What is this tool? →

✓ No known CVEs patched in this version

Topics

agents ai api audio-generation decentralized distributed
+12 more
image-generation libp2p llama llm mamba mcp musicgen object-detection rerank stable-diffusion text-generation tts

Affected surfaces

auth

Summary

AI summary

Broad release touches Other Changes, chore, backends, and model gallery.

Full changelog

What's Changed

Other Changes

  • chore(model gallery): :robot: add 1 new models via gallery agent by @localai-bot in https://github.com/mudler/LocalAI/pull/10472
  • chore: :arrow_up: Update ikawrakow/ik_llama.cpp to 7ccf1d209588962b96eacca325b37e9b3e8faf5e by @localai-bot in https://github.com/mudler/LocalAI/pull/10456
  • chore: :arrow_up: Update CrispStrobe/CrispASR to 96b2a6ee31d30389fed8a7ef1a54239b75231ddc by @localai-bot in https://github.com/mudler/LocalAI/pull/10465
  • chore: :arrow_up: Update ggml-org/llama.cpp to be4a6a63eb2b848e19c277bdcf2bd399e8af76d9 by @localai-bot in https://github.com/mudler/LocalAI/pull/10467
  • chore: :arrow_up: Update ggml-org/whisper.cpp to 43d78af5be58f41d6ffbc227d608f104577741ea by @localai-bot in https://github.com/mudler/LocalAI/pull/10466
  • chore: :arrow_up: Update mudler/parakeet.cpp to 89f5e2977b4d8bccd45e7bcc6f2ef7c4ed49e89a by @localai-bot in https://github.com/mudler/LocalAI/pull/10468
  • fix(agents): URL-decode collection/agent name path params (#10443) by @localai-bot in https://github.com/mudler/LocalAI/pull/10471
  • fix(distributed): track in-flight for SoundDetection requests by @localai-bot in https://github.com/mudler/LocalAI/pull/10475
  • refactor(distributed): make in-flight tracking coverage a compile-time contract by @localai-bot in https://github.com/mudler/LocalAI/pull/10476
  • fix(pii): load default detectors at startup + add LOCALAI_PII_DEFAULT_DETECTORS by @richiejp in https://github.com/mudler/LocalAI/pull/10474
  • i18n(id): update and complete Indonesian translations by @dedyf5 in https://github.com/mudler/LocalAI/pull/10480
  • fix(realtime): resolve model aliases for pipeline sub-models by @localai-bot in https://github.com/mudler/LocalAI/pull/10484
  • fix(backends): darwin/metal support for supertonic by @localai-bot in https://github.com/mudler/LocalAI/pull/10488
  • feat(backends): add darwin/metal build for liquid-audio by @localai-bot in https://github.com/mudler/LocalAI/pull/10486
  • chore(model-gallery): :arrow_up: update checksum by @localai-bot in https://github.com/mudler/LocalAI/pull/10495
  • docs: :arrow_up: update docs version mudler/LocalAI by @localai-bot in https://github.com/mudler/LocalAI/pull/10491
  • feat(ui): usage & UX enhancements (last-used model, polling, starter models, usage cost, a11y) by @localai-bot in https://github.com/mudler/LocalAI/pull/10496
  • fix(config): per-device VRAM headroom for Blackwell defaults (#10485) by @localai-bot in https://github.com/mudler/LocalAI/pull/10494
  • feat(ui): data-driven hardware model recommendations + gallery surfacing by @localai-bot in https://github.com/mudler/LocalAI/pull/10500
  • chore: :arrow_up: Update ikawrakow/ik_llama.cpp to d5507e33ae7ee2b7b41475f08044d3bde3b839ee by @localai-bot in https://github.com/mudler/LocalAI/pull/10498
  • chore: :arrow_up: Update ServeurpersoCom/omnivoice.cpp to 0f37401bebe9b20c0160a888e592108fc1d17607 by @localai-bot in https://github.com/mudler/LocalAI/pull/10492
  • fix(backends): darwin/metal support across purego Go backends by @localai-bot in https://github.com/mudler/LocalAI/pull/10481
  • feat(backends): add darwin/metal (MPS) build for trl by @localai-bot in https://github.com/mudler/LocalAI/pull/10487
  • feat(llama-cpp): cpu_moe/n_cpu_moe options + generic upstream-flag passthrough by @localai-bot in https://github.com/mudler/LocalAI/pull/10490
  • chore: :arrow_up: Update ServeurpersoCom/qwentts.cpp to 9dbe7ea26a01b30fccb117ae5e86807c1dc23d42 by @localai-bot in https://github.com/mudler/LocalAI/pull/10499
  • fix: correct scheme/host on self-referential URLs behind an HTTPS reverse proxy (#10482) by @localai-bot in https://github.com/mudler/LocalAI/pull/10504
  • chore: :arrow_up: Update ggml-org/llama.cpp to 8be759e6f70d629638a7eb70db3824cbdcea370b by @localai-bot in https://github.com/mudler/LocalAI/pull/10501
  • chore: :arrow_up: Update leejet/stable-diffusion.cpp to 8caa3f908ae6d4a4bef531e73b9a969f266a3d1f by @localai-bot in https://github.com/mudler/LocalAI/pull/10493
  • chore(model gallery): :robot: add 1 new models via gallery agent by @localai-bot in https://github.com/mudler/LocalAI/pull/10505
  • feat(vllm): macOS/Metal support via vllm-metal (MLX) by @localai-bot in https://github.com/mudler/LocalAI/pull/10489
  • feat: single-build ggml CPU_ALL_VARIANTS for llama-cpp + turboquant (x86/arm64/apple) by @localai-bot in https://github.com/mudler/LocalAI/pull/10497
  • fix(config): gate parallel-slot default on per-device VRAM too (#10485) by @localai-bot in https://github.com/mudler/LocalAI/pull/10507
  • fix(auth): make advisory locks dialect-aware and harden SQLite DSN by @localai-bot in https://github.com/mudler/LocalAI/pull/10509
  • feat(backends): darwin/Metal builds for vision C++/ggml backends (depth-anything, locate-anything, rfdetr-cpp, sam3-cpp) by @localai-bot in https://github.com/mudler/LocalAI/pull/10511
  • feat(backends): darwin build for the localvqe backend (acoustic echo cancellation) by @localai-bot in https://github.com/mudler/LocalAI/pull/10512
  • docs(backends): make OS coverage explicit + require darwin support for new backends by @localai-bot in https://github.com/mudler/LocalAI/pull/10516
  • chore: :arrow_up: Update ikawrakow/ik_llama.cpp to b84902d2ad27c34f989f23947200c4b91b1568fd by @localai-bot in https://github.com/mudler/LocalAI/pull/10515
  • chore: bump localrecall for postgres per-connection timeouts by @localai-bot in https://github.com/mudler/LocalAI/pull/10517
  • chore: pin localrecall to tagged v0.6.3 by @localai-bot in https://github.com/mudler/LocalAI/pull/10518
  • fix(backends): quote $CURDIR in run.sh (fixes backends in paths with spaces) by @localai-bot in https://github.com/mudler/LocalAI/pull/10519
  • chore: :arrow_up: Update CrispStrobe/CrispASR to 8f1218141b792b8868861c1af17ba1e361b05dc0 by @localai-bot in https://github.com/mudler/LocalAI/pull/10502
  • chore: :arrow_up: Update ggml-org/llama.cpp to 9d5d882d8cd0f0a9283d87ed5e6fe3ee0d925fb1 by @localai-bot in https://github.com/mudler/LocalAI/pull/10514
  • feat(backends): darwin/Metal build for the privacy-filter backend by @localai-bot in https://github.com/mudler/LocalAI/pull/10513
  • feat(backends): make PreferDevelopmentBackends install the development image as primary by @localai-bot in https://github.com/mudler/LocalAI/pull/10520
  • chore(model gallery): :robot: add 1 new models via gallery agent by @localai-bot in https://github.com/mudler/LocalAI/pull/10521
  • fix(backends): ship the package/ dir for darwin go backend images by @localai-bot in https://github.com/mudler/LocalAI/pull/10522

Full Changelog: https://github.com/mudler/LocalAI/compare/v4.5.0...v4.5.1

View diff on GitHub

Weekly OSS security release digest.

The CVE patches and breaking changes that affected production tools this week. One email, every Sunday.

No spam, unsubscribe anytime.

Share this release

Share on X Share on Bluesky

Track LocalAI

Get notified when new releases ship.

Sign up free

About LocalAI

LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.

All releases →

Related context

Related tools

Beta — feedback welcome: [email protected]