octobench
Benchmark and compare LLM tool, configuration, and prompt setups using a shared case framework with automated scoring and telemetry.
Why this rank:Recent releaseHealthy release cadenceStrong adoption
Description
Benchmark and compare LLM tool, configuration, and prompt setups using a shared case framework with automated scoring and telemetry.
README
Release History
| Version | Changes | Urgency | Date |
|---|---|---|---|
| main@2026-10-12 | Latest activity on main branch | High | 10/12/2026 |
| 0.0.0 | No release found â using repo HEAD | High | 4/9/2026 |
Dependencies & License Audit
Loading dependencies...
Similar Packages
simBuild, deploy, and orchestrate AI agents. Sim is the central intelligence layer for your AI workforce.v0.9.32
sdk-pythonA model-driven approach to building AI agents in just a few lines of code.harness-cli/v0.2.2
hatch3rInstall an agentic coding setup that adds multiple AI agents, skills, and rules to enhance automation across GitHub, Azure DevOps, or GitLab repositories.main@2026-10-12
agentic-flowProduction-ready AI agent orchestration platform with 66 specialized agents, 213 MCP tools, ReasoningBank learning memory, and autonomous multi-agent swarms. Built by @ruvnet with Claude Agent SDK, nev2.1.3
More in Testing
promptfooTest your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, Llama, and more. Simple declarative configs with command line and
giskard-ossđĸ Open-Source Evaluation & Testing library for LLM Agents
claw-evalClaw-Eval is an evaluation harness for evaluating LLM as agents. All tasks verified by humans.
phoenixAI Observability & Evaluation