# trulens

> Evaluation and Tracking for LLM Experiments and AI Agents

- **URL**: https://www.freshcrate.ai/projects/trulens
- **Author**: truera
- **Category**: Testing
- **Latest version**: `trulens-2.8.1` (2026-05-14)
- **License**: MIT
- **Source**: https://github.com/truera/trulens
- **Homepage**: https://www.trulens.org/
- **Language**: Python
- **GitHub**: 3,261 stars, 265 forks
- **Registry**: github
- **Tags**: `agent-evaluation`, `agentops`, `ai-agents`, `ai-monitoring`, `ai-observability`, `evals`, `explainable-ml`, `llm-eval`, `python`

## Description

Evaluation and Tracking for LLM Experiments and AI Agents

## Recent releases

| Version | Date | Urgency | Changes |
| --- | --- | --- | --- |
| `trulens-2.8.1` | 2026-05-14 | High | ## What's Changed * feat: GEPA (Genetic Prompt Optimization) Integration by @bashward in https://github.com/truera/trulens/pull/2464 * update default models for bedrock, cortex, and litellm providers by @ykd007 in https://github.com/truera/trulens/pull/2511 * add py.typed markers to otel/semconv and hotspots; add SpanType.GUARDRAIL by @ykd007 in https://github.com/truera/trulens/pull/2512 * refactor: decouple Snowflake-specific logic from trulens-core by @joshreini1 in https://github.com/tru |
| `trulens-2.8.0` | 2026-04-30 | High | ## What's Changed * Add SchemaValidation: non-LLM programmatic feedback for JSON schema / Pydantic output validation by @bashward in https://github.com/truera/trulens/pull/2427 * [fix]Generate testset examples and usage details addition by @lucifertrj in https://github.com/truera/trulens/pull/2384 * Add OpenAI Agent SDK examples by @sfc-gh-jreini in https://github.com/truera/trulens/pull/2388 * Dashboard Performance: SQL-level aggregation for dashboard leaderboard by @sfc-gh-jreini in https: |
| `trulens-2.7.2` | 2026-04-09 | High | ## What's Changed * Python 3.14 support: Traversable import path changed from `importlib.abc` to `importlib.resources.abc` by @rudolfolah in https://github.com/truera/trulens/pull/2386 * Add password-free auth params to SnowflakeConnector, rewrite Snowflake auth docs and block starting trulens dashboard when connected to snowflake by @sfc-gh-jreini in https://github.com/truera/trulens/pull/2380 * Deprecate run_dashboard_sis by @sfc-gh-jreini in https://github.com/truera/trulens/pull/2370  # |
| `trulens-2.7.1` | 2026-03-10 | Low | ## Bug Fixes * Fix papercuts with Metric API by @sfc-gh-jreini in https://github.com/truera/trulens/pull/2362  ## Tech Debt Reduction - refactor "v2" feedback organization from monorepo by @sfc-gh-jreini in https://github.com/truera/trulens/pull/2354  ## Test Fixes * Fix race condition for otel test db creation by @sfc-gh-jreini in https://github.com/truera/trulens/pull/2368  ## Docs and Examples * update experimental examples and test with metricconfig by @sfc-gh-jreini in https://git |
| `trulens-2.7.0` | 2026-02-19 | Low | ## New Unified Metric API  We're introducing the `Metric` class as the new primary API for evaluation metrics in TruLens. This unified interface replaces both `Feedback` and `MetricConfig` with a cleaner, more explicit design.  ### Why This Matters  - **Clearer, more readable code**: Replace chained `.on_*()` methods with an explicit `selectors={}` dictionary—no more guessing which argument maps to which selector - **Single unified class**: No need to choose between `Feedback` and `Metric |
| `trulens-2.6.0` | 2026-02-04 | Low | ## What's Changed  ### Agent Skills and Agents.MD * agents.md and skills by @sfc-gh-jreini in https://github.com/truera/trulens/pull/2337 * Skill and helpers for more beautiful tracing by @sfc-gh-jreini in https://github.com/truera/trulens/pull/2340  ### Support for waiting for evaluation completion * Fix bug and allow waiting in otel by @sfc-gh-jreini in https://github.com/truera/trulens/pull/2339  ### Postgres Support * Postgres support by @sfc-gh-jreini in https://github.com/truera/ |
| `trulens-2.5.3` | 2026-01-15 | Low | ## What Changed  * Direct registration of LangGraph graph compatibility with AI Observability Run by @sfc-gh-dhuang in https://github.com/truera/trulens/pull/2311 * Additional Instructions for all feedback functions by @sfc-gh-ajia in https://github.com/truera/trulens/pull/2313 * Loosen trace compression by @sfc-gh-jreini in https://github.com/truera/trulens/pull/2312  ## Bug Fixes * [Minor fix] Remove staticmethod descriptor for trace_with_run by @sfc-gh-dhuang in https://github.com/true |
| `trulens-2.5.2` | 2025-12-11 | Low | ## What's Changed * fix: add additionalProperties: false to structured output schemas for Databricks compatibility by @debu-sinha in https://github.com/truera/trulens/pull/2308 * Make command for updating meta.yaml files by @sfc-gh-jreini in #2309   ## New Contributors * @debu-sinha made their first contribution in https://github.com/truera/trulens/pull/2308  **Full Changelog**: https://github.com/truera/trulens/compare/trulens-2.5.1...trulens-2.5.2 |
| `trulens-2.5.1` | 2025-11-21 | Low | # TruLens 2.5.1 Patch Release  ## Bug Fixes  * [Snowflake] Enable get_records to fetch serverside metrics. by @sfc-gh-dkurokawa in https://github.com/truera/trulens/pull/2293 * [Snowflake] Enable serverside metric computation kickoff from .py scripts by @sfc-gh-dhuang in https://github.com/truera/trulens/pull/2297 * Fix internal method to comply with pydantic change introduced in pydantic 2.10 by @sfc-gh-jreini in https://github.com/truera/trulens/pull/2296 |
| `trulens-2.5.0` | 2025-11-14 | Low | ##  What's Changed * Langchain 1.0 support by @sfc-gh-jreini in https://github.com/truera/trulens/pull/2279 * Update pip install in notebook command with version constraints for langchain packages by @sfc-gh-jreini in https://github.com/truera/trulens/pull/2275 * Remove noisy log msg  by @sfc-gh-dhuang in https://github.com/truera/trulens/pull/2277 * track eval costs, surface total costs on leaderboard by @sfc-gh-jreini in https://github.com/truera/trulens/pull/2278  ## New examples * Exa |

## Citation

- HTML: https://www.freshcrate.ai/projects/trulens
- Markdown: https://www.freshcrate.ai/projects/trulens.md
- Dependencies JSON: https://www.freshcrate.ai/api/projects/trulens/deps

_Generated by freshcrate.ai. Indexes github releases for AI-agent ecosystem packages._