freshcrate
Home > Testing > trulens

trulens

Evaluation and Tracking for LLM Experiments and AI Agents

Description

Evaluation and Tracking for LLM Experiments and AI Agents

README

PyPI - Version Azure Build Status GitHub PyPI - Downloads Discourse Docs Open In Colab Ask DeepWiki

🦑 Welcome to TruLens!

TruLens

Don't just vibe-check your LLM app! Systematically evaluate and track your LLM experiments with TruLens. As you develop your app including prompts, models, retrievers, knowledge sources and more, TruLens is the tool you need to understand its performance.

Fine-grained, stack-agnostic instrumentation and comprehensive evaluations help you to identify failure modes & systematically iterate to improve your application.

Read more about the core concepts behind TruLens including Feedback Functions, The RAG Triad, and Honest, Harmless and Helpful Evals.

TruLens in the development workflow

Build your first prototype then connect instrumentation and logging with TruLens. Decide what feedbacks you need, and specify them with TruLens to run alongside your app. Then iterate and compare versions of your app in an easy-to-use user interface 👇

Architecture Diagram

Installation and Setup

Install the trulens pip package from PyPI.

    pip install trulens

Quick Usage

Walk through how to instrument and evaluate a RAG built from scratch with TruLens.

Open In Colab

💡 Contributing & Community

Interested in contributing? See our contributing guide for more details.

The best way to support TruLens is to give us a ⭐ on GitHub and join our discourse community!

Release History

VersionChangesUrgencyDate
trulens-2.7.2## What's Changed * Python 3.14 support: Traversable import path changed from `importlib.abc` to `importlib.resources.abc` by @rudolfolah in https://github.com/truera/trulens/pull/2386 * Add password-free auth params to SnowflakeConnector, rewrite Snowflake auth docs and block starting trulens dashboard when connected to snowflake by @sfc-gh-jreini in https://github.com/truera/trulens/pull/2380 * Deprecate run_dashboard_sis by @sfc-gh-jreini in https://github.com/truera/trulens/pull/2370 #High4/9/2026

Dependencies & License Audit

Loading dependencies...

Similar Packages

phoenixAI Observability & Evaluationarize-phoenix-v14.9.1
giskard-oss🐢 Open-Source Evaluation & Testing library for LLM Agentsgiskard-checks/v1.0.2b1
ai-lead-qualifier🧠 Qualify leads with an AI-driven system that understands intent, asks key questions, and structures quality leads without hardcoding processes.main@2026-04-21
agent-actionsDeclarative framework for orchestrating multi-model LLM pipelines with context engineering and quality gates.v0.1.12
logfireAI observability platform for production LLM and agent systems.v4.32.1