freshcrate
Skin:/
Home > Testing > Observal

Observal

Observal is an AI agent registry with first in class observabilty and eval framework

Why this rank:Strong adoptionRecent releaseHealthy release cadence

Description

Observal is an AI agent registry with first in class observabilty and eval framework

README

Observal

Discover, share, and monitor AI coding agents with full observability built in.

LicensePythonStatusStarsIf you find Observal useful, please consider giving it a star. It helps others discover the project and keeps development going.


Observal is a self-hosted AI agent registry with built-in observability. Think Docker Hub, but for AI coding agents.

Browse agents created by others, publish your own, and pull complete agent configurations โ€” all defined in a portable YAML format that templates out to Claude Code, Kiro CLI, Cursor, Gemini CLI, and more. Every agent bundles its MCP servers, skills, hooks, prompts, and sandboxes into a single installable package. One command to install, zero manual config.

Every interaction generates traces, spans, and sessions that flow into a telemetry pipeline. The built-in eval engine scores agent sessions so you can measure performance and make your agents better over time.

Full docs live at observal.gitbook.io (sourced from /docs in this repo).

Start here Go to
5-minute install and first trace Quickstart
Understand the data model Core Concepts
Instrument your existing MCP servers Observe MCP traffic
Run Observal on your infrastructure Self-Hosting
Look up a CLI command CLI Reference

See CHANGELOG.md for recent updates.

Quick start

git clone https://github.com/BlazeUp-AI/Observal.git
cd Observal
cp .env.example .env

docker compose -f docker/docker-compose.yml up --build -d
uv tool install --editable .
observal auth login            # auto-creates admin on fresh server

Eight services start (API, web UI, Postgres, ClickHouse, Redis, worker, OTEL collector, Grafana). Full walkthrough in Quickstart; operator guide in Self-Hosting โ†’ Docker Compose setup.

Already have MCP servers in your IDE? Instrument them in one command:

observal scan                       # auto-detect, register, and instrument everything
observal pull <agent> --ide cursor  # install a complete agent

This detects MCP servers from your IDE config files and wraps them with observal-shim for telemetry without breaking your existing setup. A timestamped backup is created automatically. Everything happens locally โ€” nothing is uploaded to the server.

Supported IDEs

IDE Support
Claude Code Full โ€” skills, hooks, MCP, rules, OTLP telemetry
Kiro CLI Full โ€” superpowers, hooks, MCP, steering files, OTLP telemetry
Gemini CLI Native OTEL + shim telemetry
Codex CLI Native OTEL + shim telemetry
GitHub Copilot Shim telemetry
OpenCode Shim telemetry
Cursor MCP + shim telemetry

Compatibility matrix and per-IDE setup: Integrations.

Tech stack

Component Technology
Frontend Next.js 16, React 19, Tailwind CSS 4, shadcn/ui, Recharts
Backend Python 3.11+, FastAPI, Strawberry GraphQL, Uvicorn
Databases PostgreSQL 16 (registry), ClickHouse (telemetry)
Queue Redis + arq
CLI Python, Typer, Rich
Eval engine AWS Bedrock / OpenAI-compatible LLMs
Telemetry OpenTelemetry Collector
Deployment Docker Compose (8 services)

Contributing

See CONTRIBUTING.md. The short version:

  1. Fork and clone
  2. make hooks to install pre-commit hooks
  3. Create a feature branch
  4. Run make lint and make test
  5. Open a PR

See AGENTS.md for internal codebase context.

Running tests

make test      # quick
make test-v    # verbose

All tests mock external services. No Docker needed.

Community

Have a question, idea, or want to share what you've built? Head to GitHub Discussions. Please use Discussions for questions; open Issues for confirmed bugs and concrete feature requests.

Join the Observal Discord to chat directly with the maintainers and other community members.

Security

To report a vulnerability, please use GitHub Private Vulnerability Reporting or email contact@blazeup.app. Do not open a public issue. See SECURITY.md.

License

Apache License 2.0. See LICENSE.

Star history

Star History Chart

Release History

VersionChangesUrgencyDate
v1.13.1<!-- SPDX-FileCopyrightText: 2026 Hari Srinivasan <harisrini21@gmail.com> --> <!-- SPDX-License-Identifier: Apache-2.0 --> This release includes 6 change groups through `9a8eef6`. ## Features - add configurable usage reporting ([#1701](https://github.com/Observal/Observal/pull/1701)) ## Fixes - keep UUIDs as text in SQLite tests ([#1704](https://github.com/Observal/Observal/pull/1704)) - use npm trusted publishing ([#1715](https://github.com/Observal/Observal/pull/1715)) - bundle harness moHigh9/5/2026
v1.12.1<!-- SPDX-FileCopyrightText: 2026 Hari Srinivasan <harisrini21@gmail.com> --> <!-- SPDX-License-Identifier: Apache-2.0 --> This release includes 4 change groups through `9ab4b6b`. ## Fixes - validate current notes format ([#1681](https://github.com/Observal/Observal/pull/1681)) - update gitsign verification ([#1682](https://github.com/Observal/Observal/pull/1682)) - correct teamspace lifecycle access ([#1683](https://github.com/Observal/Observal/pull/1683)) - harden diagnostics and CodeQL ([#High8/9/2026
v1.11.0<!-- SPDX-FileCopyrightText: 2026 Hari Srinivasan <harisrini21@gmail.com> --> <!-- SPDX-License-Identifier: Apache-2.0 --> # Observal v1.11.0 This release includes 13 change groups through `ad7a6cf`. ## Features - add teamspace membership and handle reservation ([#1619](https://github.com/Observal/Observal/pull/1619)) - add team publishing and team-private visibility ([#1640](https://github.com/Observal/Observal/pull/1640)) - add success criteria fields to agent versions ([#1623](https://gitHigh8/2/2026
v1.10.1## [1.10.1] - 2026-07-19 High7/19/2026
v1.9.9## [1.9.9] - 2026-07-07 ### Added - add JSON output for scan (**cli**) ([223973f](https://github.com/Observal/Observal/commit/223973f82d05fa10239032d6162e19d5f27662fe)) - GitHub OAuth sign-in + SSO settings robustness fixes (**auth**) ([9675ba6](https://github.com/Observal/Observal/commit/9675ba6b97964b73d34c2d4383f87c956ca3f7de)) ### Documentation - remove BlazeUp references ([0923059](https://github.com/Observal/Observal/commit/092305999abf2b8b5c1f248836ddd03d815463be)) - add license commiMedium7/7/2026
v1.9.8## [1.9.8] - 2026-07-01 ### Added - agent swapping and local profile isolation for pi ([e261ba7](https://github.com/Observal/Observal/commit/e261ba72edd2db0007f55f8b692004205dee143d)) - use ~/.pi/agent/agents isolated profiles with TUI to swap ([242be6b](https://github.com/Observal/Observal/commit/242be6bfafe5330626f93157716141239068c6a7)) - add /agent command to swap active agent in pi ([0fd4c64](https://github.com/Observal/Observal/commit/0fd4c646be0db9d726efc461217afe95cb20f1e6)) - instant High7/1/2026
v1.9.1## [1.9.1] - 2026-06-22 High6/22/2026
v1.6.0## [1.6.0] - 2026-06-13 ### Added - add version-aware report generation (**insights**) ([dc95544](https://github.com/BlazeUp-AI/Observal/commit/dc95544fa8593fca84c1e241a044f59fd78a82ac)) - use agent-scoped report routes (**insights**) ([84cec66](https://github.com/BlazeUp-AI/Observal/commit/84cec66d5c1960d7ab9e8b0a39235c4cbd5cd89b)) - add insights CLI pretty print commands (**ops**) ([cf13c35](https://github.com/BlazeUp-AI/Observal/commit/cf13c35c71037ac8e2c6b4762a2b9a466c608043)) - add contexHigh6/13/2026
v1.5.0## [1.5.0] - 2026-06-09 ### Added - add remote state backend (Azure Blob Storage) (**infra**) ([86c468b](https://github.com/BlazeUp-AI/Observal/commit/86c468b068de32d33d28f508f67f570a59b960c7)) - add Azure Terraform module for self-hosted deployment (**infra**) ([1c523fd](https://github.com/BlazeUp-AI/Observal/commit/1c523fd3232a6dd6f17015dbf913b195d1b28a35)) - add Antigravity CLI adapter and session parser (**ide**) ([7b4883e](https://github.com/BlazeUp-AI/Observal/commit/7b4883ef5861d509a655High6/9/2026
v1.4.4## [1.4.4] - 2026-06-01 ### Added - allow agent owners and co-authors to generate insights (**insights**) ([d285cd7](https://github.com/BlazeUp-AI/Observal/commit/d285cd7c3ba68cc42fb799461b0d0b4db9f8fede)) - replace custom LLM calls with LiteLLM (**insights**) ([0b59845](https://github.com/BlazeUp-AI/Observal/commit/0b59845a45cf3ddfaf4aae86a6e803079e876791)) ### Changed - remove global admin Insights page from sidebar (**web**) ([68ef1e2](https://github.com/BlazeUp-AI/Observal/commit/68ef1e2High6/1/2026
v1.4.0## [1.4.0] - 2026-05-31 ### Added - make sensitive settings write-once and retractable (**security**) ([b6b4fc1](https://github.com/BlazeUp-AI/Observal/commit/b6b4fc1f4f90d30c3c6bceef9d62d6faa5d214c7)) ### Fixed - correct tool count and strip ANSI from thinking blocks (**ui+parser**) ([cb97420](https://github.com/BlazeUp-AI/Observal/commit/cb974206eb1aead4429f2345b59a80296bcd9e3b)) - fix off-by-one in byte offset tracking (**pi-extension**) ([39e2135](https://github.com/BlazeUp-AI/Observal/cHigh5/31/2026
v1.0.0## [1.0.0] - 2026-05-23 ### Added - instrument uv.lock (**optic**) ([28dffa7](https://github.com/BlazeUp-AI/Observal/commit/28dffa70cc8b60d3f850a35da5638276f662e135)) - instrument tests.test_optic (**optic**) ([c30fd8e](https://github.com/BlazeUp-AI/Observal/commit/c30fd8e4fc4dbf3ade01840b3acfdd16c9fb7a4f)) - instrument ..pyproject.toml (**optic**) ([b230772](https://github.com/BlazeUp-AI/Observal/commit/b2307721751fcd3cf7223c6b024eefd62b1fd180)) - instrument observal-server.worker (**optic**)High5/23/2026
v0.6.0## [0.6.0] - 2026-05-16 ### Added - realign skill model with git-first architecture (**skills**) ([9600d3b](https://github.com/BlazeUp-AI/Observal/commit/9600d3ba363d1e37bcb81278275913ba1bfc91ff)) - add insight tables to migration system ([cd73e1e](https://github.com/BlazeUp-AI/Observal/commit/cd73e1e9ea20d7f5ea5c388db25bf2dda65853f8)) - add best-effort disclaimer for --git flag (**mcp**) ([360248e](https://github.com/BlazeUp-AI/Observal/commit/360248e0c00da9c260cfb50d64bd03130e88eac8)) - JSONHigh5/16/2026
v0.5.0## [0.5.0] - 2026-05-13 ### Added - slim curl-install to use pre-built images only (**deploy**) ([630a19f](https://github.com/BlazeUp-AI/Observal/commit/630a19f0752d0560e916e6376fb6751f085362a4)) - add browser-level Playwright e2e tests for 4 UI flows ([28f0274](https://github.com/BlazeUp-AI/Observal/commit/28f0274c8a6611cca9d12bbba02c0c7c2de96285)) - user profile picture is configurable (**UI**) ([442bc7c](https://github.com/BlazeUp-AI/Observal/commit/442bc7ce16c1869d936c2ed590bb008bd76ec7a9)High5/13/2026
v0.3.4## [0.3.4] - 2026-04-25 ### Added - add copilot-cli doctor checks and SLI repair ([fe8f91a](https://github.com/BlazeUp-AI/Observal/commit/fe8f91af37c6e3d354906c022aaba2e12eb4b816)) - add copilot-cli scan and hook injection ([8956644](https://github.com/BlazeUp-AI/Observal/commit/8956644008e824ba59675be52448880170a544e8)) - add copilot-cli server-side config generation ([7c71b94](https://github.com/BlazeUp-AI/Observal/commit/7c71b94b2bdeb3827ecfb48bda0180b065d4de8f)) - add copilot-cli hook scriHigh4/25/2026
v0.3.3## [0.3.3] - 2026-04-24 ### Fixed - filter release artifact download to skip Docker metadata (**ci**) ([dbd6a1b](https://github.com/BlazeUp-AI/Observal/commit/dbd6a1b66ec1dd3a6db067ecc9bc41a17174a329)) High4/24/2026
v0.2.0## What's Changed * docs + refactor: READMEs, eval subpackage, repo cleanup by @Haz3-jolt in https://github.com/BlazeUp-AI/Observal/pull/322 * feat: live session updates via GraphQL subscriptions by @Haz3-jolt in https://github.com/BlazeUp-AI/Observal/pull/323 * fix(web): protect registry routes with auth guard by @Kaushik-Kumar-CEG in https://github.com/BlazeUp-AI/Observal/pull/324 * feat: unify telemetry โ€” merge hooks, shims, and OTLP by @Haz3-jolt in https://github.com/BlazeUp-AI/ObservalHigh4/21/2026
v0.0.1Tag v0.0.1High4/15/2026

Dependencies & License Audit

Loading dependencies...

Similar Packages

mlflowThe open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controllinv3.15.2
agentic-configProject-agnostic, composable AI workflow automation via pi packages and Claude Code plugins.v0.3.2
llm-wikiLLM-powered knowledge base from your Claude Code, Codex CLI, Copilot, Cursor & Gemini sessions. Karpathy's LLM Wiki pattern โ€” implemented and shipped.v1.3.82
cc-sddTurn approved specs into long-running autonomous implementation. A minimal, adaptable SDD harness with Agent Skills for Claude Code, Codex, Cursor, Copilot, Windsurf, OpenCode, Gemini CLI, and Antigrav3.0.2
argus-mcp๐Ÿ” Enhance code quality with Argus MCP, an AI-driven code review server using a Zero-Trust model for safe and efficient development.main@2026-09-06

More in Testing

ContribAIAutonomous AI agent that contributes to open source โ€” discovers repos, analyzes code, generates fixes, and submits PRs
GitoAn AI-powered GitHub code review tool that uses LLMs to detect high-confidence, high-impact issuesโ€”such as security vulnerabilities, bugs, and maintainability concerns.
trulensEvaluation and Tracking for LLM Experiments and AI Agents
multi-agent-ralph-loopAutonomous orchestration framework for Claude Code with MemPalace-inspired memory (4-layer stack, 818-token wake-up), parallel-first Agent Teams (6 teammates), Aristotle First Principles methodology,