trulens

Monitoring & Metrics

A systematic evaluation and tracking framework for LLM applications that instruments stack‑agnostic feedback functions and provides detailed observability via OpenTelemetry.

Track releases GitHub Website

Python Latest trulens-2.9.0 · 3d ago Security brief →

Features

OpenTelemetry‑based tracing of every function, LLM call, retrieval, and tool invocation
Seven purpose‑built agentic evaluators (LogicalConsistency, ExecutionEfficiency, etc.)
Inline and batch evaluation via a simple Run API

Security Response History

2 CVEs

CVE	Severity	Disclosed	Patched (this tool)	vs Ecosystem Median
CVE-2026-42271 KEV	high CVSS 8.8	2026-06-08	2026-07-23	46d
CVE-2026-42208 KEV	critical CVSS 9.8	2026-05-08	2026-05-14	7d

Recent releases

View all 8 releases →

No immediate action

trulens-2.9.0 New feature 3d

Ensemble judges, AB test, memory recall, OTEL trace

Open

No immediate action

trulens-2.8.1 Security relevant 2mo

library‑skills convention

patches CVE-2026-42208 patches CVE-2026-42271

Open

trulens-2.8.0 New feature 2mo

Notable features

Add SchemaValidation: non-LLM programmatic feedback for JSON schema / Pydantic output validation
Dashboard Performance: SQL-level aggregation for dashboard leaderboard
Batch Evals for TruLens + generalize existing trulens-core code for Run

Full changelog

What's Changed

Add SchemaValidation: non-LLM programmatic feedback for JSON schema / Pydantic output validation by @bashward in https://github.com/truera/trulens/pull/2427
[fix]Generate testset examples and usage details addition by @lucifertrj in https://github.com/truera/trulens/pull/2384
Add OpenAI Agent SDK examples by @sfc-gh-jreini in https://github.com/truera/trulens/pull/2388
Dashboard Performance: SQL-level aggregation for dashboard leaderboard by @sfc-gh-jreini in https://github.com/truera/trulens/pull/2396
Batch Evals for TruLens + generalize existing trulens-core code for Run by @sfc-gh-jreini in https://github.com/truera/trulens/pull/2391
Fast and quiet TruSession startup by @sfc-gh-jreini in https://github.com/truera/trulens/pull/2394
Add GOVERNANCE.md and update MAINTAINERS.md by @sfc-gh-jreini in https://github.com/truera/trulens/pull/2401
Move contributing guide to CONTRIBUTING.md and add help wanted link by @joshreini1 in https://github.com/truera/trulens/pull/2425

Bug Fixes

Bump the npm_and_yarn group across 3 directories with 6 updates by @dependabot[bot] in https://github.com/truera/trulens/pull/2398
fix: convert Arrow-backed DataFrame columns to object dtype in run.compute_metrics by @sfc-gh-jreini in https://github.com/truera/trulens/pull/2387
Fix CI pipeline timeouts with pip dependency caching by @sfc-gh-jreini in https://github.com/truera/trulens/pull/2395
Fix duplicate Alembic revision 11 and relax importlib-resources bound by @sfc-gh-jreini in https://github.com/truera/trulens/pull/2429