Skip to content

trulens

Monitoring & Metrics

A systematic evaluation and tracking framework for LLM applications that instruments with OpenTelemetry and provides agentic evaluators.

Python Latest trulens-2.8.1 · 20d ago Security brief →

Features

  • OpenTelemetry‑based tracing of every function call, LLM generation, retrieval, and tool invocation
  • Seven purpose‑built agentic evaluators (LogicalConsistency, ExecutionEfficiency, PlanAdherence, PlanQuality, ToolSelection, ToolCalling, ToolQuality)
  • Support for inline evaluation during runtime and offline batch evaluation via the Run API

Security Response History

1 CVE
CVE Severity Disclosed Patched (this tool) vs Ecosystem Median
CVE-2026-42208 KEV critical
CVSS 9.8
2026-05-08 2026-05-14 7d

Recent releases

View all 7 releases →
No immediate action
trulens-2.8.1 Security relevant

library‑skills convention

patches CVE-2026-42208
Open
trulens-2.8.0 New feature
Notable features
  • Add SchemaValidation: non-LLM programmatic feedback for JSON schema / Pydantic output validation
  • Dashboard Performance: SQL-level aggregation for dashboard leaderboard
  • Batch Evals for TruLens + generalize existing trulens-core code for Run
Full changelog

What's Changed

  • Add SchemaValidation: non-LLM programmatic feedback for JSON schema / Pydantic output validation by @bashward in https://github.com/truera/trulens/pull/2427
  • [fix]Generate testset examples and usage details addition by @lucifertrj in https://github.com/truera/trulens/pull/2384
  • Add OpenAI Agent SDK examples by @sfc-gh-jreini in https://github.com/truera/trulens/pull/2388
  • Dashboard Performance: SQL-level aggregation for dashboard leaderboard by @sfc-gh-jreini in https://github.com/truera/trulens/pull/2396
  • Batch Evals for TruLens + generalize existing trulens-core code for Run by @sfc-gh-jreini in https://github.com/truera/trulens/pull/2391
  • Fast and quiet TruSession startup by @sfc-gh-jreini in https://github.com/truera/trulens/pull/2394
  • Add GOVERNANCE.md and update MAINTAINERS.md by @sfc-gh-jreini in https://github.com/truera/trulens/pull/2401
  • Move contributing guide to CONTRIBUTING.md and add help wanted link by @joshreini1 in https://github.com/truera/trulens/pull/2425

Bug Fixes

  • Bump the npm_and_yarn group across 3 directories with 6 updates by @dependabot[bot] in https://github.com/truera/trulens/pull/2398
  • fix: convert Arrow-backed DataFrame columns to object dtype in run.compute_metrics by @sfc-gh-jreini in https://github.com/truera/trulens/pull/2387
  • Fix CI pipeline timeouts with pip dependency caching by @sfc-gh-jreini in https://github.com/truera/trulens/pull/2395
  • Fix duplicate Alembic revision 11 and relax importlib-resources bound by @sfc-gh-jreini in https://github.com/truera/trulens/pull/2429

New Contributors

  • @bashward made their first contribution in https://github.com/truera/trulens/pull/2427

Full Changelog: https://github.com/truera/trulens/compare/trulens-2.7.2...trulens-2.8.0

trulens-2.7.2 New feature
Notable features
  • Python 3.14 support
  • Password-free Snowflake authentication parameters
  • Cortex model cost tracking updates
trulens-2.7.0 New feature
Notable features
  • Unified Metric class API for evaluations
  • Native OpenTelemetry span integration
  • Backward-compatible deprecation warnings
trulens-2.6.0 New feature
Notable features
  • Postgres database support
  • Agent skills framework for AI coding
  • Evaluation completion waiting

Weekly OSS security release digest.

The CVE patches and breaking changes that affected production tools this week. One email, every Sunday.

No spam, unsubscribe anytime.

About

Stars
3,354
Forks
284
Languages
Python Jupyter Notebook TypeScript

Install & Platforms

Install via
pip

Beta — feedback welcome: [email protected]