Find the best local LLM for your hardware, ranked by benchmarks

v0.5.15 Feature

This release adds 1 notable feature for engineering teams evaluating rollout.

Published 23d LLM Frameworks

✓ No known CVEs patched

✓ No known CVEs patched in this version

Topics

ai apple-silicon benchmarks cli gguf gpu

+7 more

huggingface inference llm local-llm ollama python vram

Summary

AI summary

Validates ranking flags before running the ranker.

Full changelog

Resolves ranked GGUF recommendations to the actual downloadable artifact repo and filename when the ranked base model and runnable GGUF live in different Hugging Face repos.
Retunes AA index normalization and refreshes the fallback snapshot for the reworked Artificial Analysis scale.
Validates ranking flags such as --top, --min-speed, and --min-params before ranking.
Splits the Hugging Face fetcher into focused modules while keeping the existing whichllm.models.fetcher import surface.

Weekly OSS security release digest.

The CVE patches and breaking changes that affected production tools this week. One email, every Sunday.

No spam, unsubscribe anytime.

Share this release

Track Find the best local LLM for your hardware, ranked by benchmarks

Get notified when new releases ship.

About Find the best local LLM for your hardware, ranked by benchmarks