This release adds 3 notable features for engineering teams evaluating rollout.
Published 10mo
AI Agents & Assistants
✓ No known CVEs patched
✓ No known CVEs patched in this version
Topics
ai-evaluation
ai-safety
confidence-estimation
confidence-score
hallucination
hallucination-detection
+8 more
hallucination-evaluation
hallucination-mitigation
llm
llm-evaluation
llm-hallucination
llm-safety
uncertainty-estimation
uncertainty-quantification
Summary
AI summaryFixes the Judge prompt escape‑character usage.
Full changelog
Highlights
- improved handling of missing logprobs
- adds warning when logprobs missing
- removes benign transformers warning for NLI instantiation and BERTScore scoring
- Add flaky and skip logic for unit tests to avoid benign failures
- Fix escape character usage in Judge prompt
- Update version of LangChain per Dependabot suggestion
What's Changed
- Release/v0.2.0 by @dylanbouchard in https://github.com/cvs-health/uqlm/pull/118
- Release/v0.2.0 by @dylanbouchard in https://github.com/cvs-health/uqlm/pull/128
- v0.2.1 updates by @dylanbouchard in https://github.com/cvs-health/uqlm/pull/131
- Bump langchain from 0.3.26 to 0.3.27 by @dependabot[bot] in https://github.com/cvs-health/uqlm/pull/121
- Db/missing logprobs unittest skip by @dylanbouchard in https://github.com/cvs-health/uqlm/pull/132
- Add missing logprobs warning and update version by @dylanbouchard in https://github.com/cvs-health/uqlm/pull/133
- fix escape character in judge prompt by @dylanbouchard in https://github.com/cvs-health/uqlm/pull/134
- Fix logprobs syntax error and judge prompt escape character by @dylanbouchard in https://github.com/cvs-health/uqlm/pull/137
- suppress benign transformers warnings by @dylanbouchard in https://github.com/cvs-health/uqlm/pull/138
- Patch release: v0.2.2 by @dylanbouchard in https://github.com/cvs-health/uqlm/pull/139
Full Changelog: https://github.com/cvs-health/uqlm/compare/v0.2.1...v0.2.2
Weekly OSS security release digest.
The CVE patches and breaking changes that affected production tools this week. One email, every Sunday.
No spam, unsubscribe anytime.
Share this release
About UQLM
All releases →Related context
Related tools
Beta — feedback welcome: [email protected]