Skip to content

Glq

v0.1.2 Feature

This release adds 1 notable feature for engineering teams evaluating rollout.

Published 2mo Model Serving & MLOps
✓ No known CVEs patched
Read the diff → Tool health → What is this tool? →

✓ No known CVEs patched in this version

Topics

inference llm model-compression pytorch quantization

Summary

AI summary

Added Triton fused dequant+matmul inference kernel supporting 3/4 bits per weight.

Full changelog
  • Fix state_dict loading for two-stage buffers (Qidxs2, inv_resid_scale)
  • Add Triton fused dequant+matmul inference kernel with 3/4bpw support
  • Update README with Triton kernel docs, quantization and inference examples
  • Update SmolLM2-360M 2bpw perplexity: 18.29 → 17.70
View diff on GitHub

Weekly OSS security release digest.

The CVE patches and breaking changes that affected production tools this week. One email, every Sunday.

No spam, unsubscribe anytime.

Share this release

Share on X Share on Bluesky

Track Glq

Get notified when new releases ship.

Sign up free

About Glq

All releases →

Related context

Beta — feedback welcome: [email protected]