# RagaAI-Catalyst

> Python SDK for Agent AI Observability, Monitoring and Evaluation Framework. Includes features like agent, llm and tools tracing, debugging multi-agentic system, self-hosted dashboard and advanced anal

- **URL**: https://www.freshcrate.ai/projects/RagaAI-Catalyst
- **Author**: raga-ai-hub
- **Category**: Frameworks
- **Latest version**: `v2.2.4` (2025-06-23)
- **License**: Apache-2.0
- **Source**: https://github.com/raga-ai-hub/RagaAI-Catalyst
- **Homepage**: https://catalyst.raga.ai/
- **Language**: Python
- **GitHub**: 16,141 stars, 3,616 forks
- **Registry**: github
- **Tags**: `agentic-ai`, `agentic-ai-development`, `agentneo`, `agents`, `ai-agent-monitoring`, `ai-application-debugging`, `ai-evaluation-tools`, `ai-performance-optimization`, `python`

## Description

Python SDK for Agent AI Observability, Monitoring and Evaluation Framework. Includes features like agent, llm and tools tracing, debugging multi-agentic system, self-hosted dashboard and advanced analytics with timeline and execution graph view

## Recent releases

| Version | Date | Urgency | Changes |
| --- | --- | --- | --- |
| `v2.2.4` | 2025-06-23 | Low | # Changes  - Bug-fix: Updation of external_id, metadata not working as expected while updating dataset_name - Bug-fix: logs getting missed in load testing using Locust - Bug-fix: Error in SDG while generating dataset - Feat: Update project name in tracer on runtime |
| `v2.2.3` | 2025-06-02 | Low | # Changes  - Bug-fix: Fix cost calculation coming from litellm - Bug-fix: Safeguarding application workflow - Bug-fix: exclude vital columns while masking like model_name, cost, latency, span_id, trace_id etc. - Feat: set model_cost as no op function - Bug-fix: export all columns without any filter - Bug-fix: fix total cost value in the trace details |
| `v2.2.1` | 2025-05-16 | Low | # Changes  - Feat: Unify the trace format for RAG, Agentic Traces - Feat: Add feature to automatically refresh token after every 6 hrs - Feat: Add greater support to capture errors  - Bug: Fix for CSV upload of numerical, categorical values - Bug: Fix for metric execution error with "_" in column names - Bug: Fix external_id inconsistencies - Bug: Fix Add proper span hash ids    **Full Changelog**: https://github.com/raga-ai-hub/RagaAI-Catalyst/compare/v2.1.7.4...v2.2.1 |
| `v2.1.7.4` | 2025-05-05 | Low | # Changes: - add_metadata - mask traces - support for error capturing for RAG - Improve fallback for token counting  **Full Changelog**: https://github.com/raga-ai-hub/RagaAI-Catalyst/compare/v2.1.7.1...v2.1.7.4 |
| `v2.1.7.1` | 2025-04-17 | Low | # Changes - Feat: Support adding external_id - Feat: Add  post-processing hook, PII removal hook - Feat: Trace Upload Consistency on Load - Feat: RAG-Tracing using OpenInference - Feat: Test cases, CI/CD. Pipeline - Bug-fix: list_dataset() to work for large number of datasets - Bug-fix: Indexing Error in Agentic Tracing - Bug-fix: Check for crashed when defining tracer without metadata key. - Bug-fix: add_context not working for langchain rag  **Full Changelog**: https://github.com/ra |
| `2.1.6.4` | 2025-04-01 | Low | ## What's Changed 1. **fix**: Corrected total_cost and total_token calculation in custom agentic traces     - Previously, these values were being incorrectly calculated or displayed.    - Now, the logic ensures accurate display of total cost and token usage.  2. **feat**: Associate model with response and add model_name metadata     - Associated the LLM model used with its corresponding response to align with backend changes and provide a more complete data structure.    - Introduced a |
| `2.1.6.3` | 2025-03-28 | Low | ## What's Changed * Bump litellm from 1.42.12 to 1.61.15 by @dependabot in https://github.com/raga-ai-hub/RagaAI-Catalyst/pull/193 * Bump langchain-core from 0.2.11 to 0.2.43 by @dependabot in https://github.com/raga-ai-hub/RagaAI-Catalyst/pull/194 * Make timeout configurable for `agentic/<framework>`, Add support for set custom model cost for langchain RAG by @kiranscaria in https://github.com/raga-ai-hub/RagaAI-Catalyst/pull/204   **Full Changelog**: https://github.com/raga-ai-hub/RagaAI |
| `2.1.6.2` | 2025-03-28 | Low | # Changes - Add support for tracing OpenAI Agents SDK - Update trace schema to:     - moved recorded_on  to schema_type `timestamp`     - add total_cost, total_tokens as numerical metadata     - add model_name as categorical metadata - Bug-fix in input_guardrails related to trace_id is None |
| `2.1.6` | 2025-03-19 | Low | ## What's Changed - Add auto-instrumentation support for:    - Langgraph    - Langchain    - CrewAI    - Haystack    - SmolAgents  - Add support for workflow (data collection) for auto-instrumentation  - Improved the guardrails flow  - Relaxed the dependencies, removed stale dependencies  - Add examples for multiple agentic frameworks  - Multiple bug-fixes |
| `2.1.5` | 2025-03-11 | Low | # Changes:  - Improve synthetic data generation - Update redteaming - Multiple bug-fixes - Improve support for llamaindex tracing |

## Dependency audit

- **Score**: 0/100
- **Total deps**: 125
- **Resolved**: 57
- **Unresolved**: 68
- **License conflicts**: 0
- **Warnings**: 89
- **Scanned**: 2026-05-04

## Citation

- HTML: https://www.freshcrate.ai/projects/RagaAI-Catalyst
- Markdown: https://www.freshcrate.ai/projects/RagaAI-Catalyst.md
- Dependencies JSON: https://www.freshcrate.ai/api/projects/RagaAI-Catalyst/deps

_Generated by freshcrate.ai. Indexes github releases for AI-agent ecosystem packages._