freshcrate

Search results for "llmops"

16 results found
agenta📁v0.96.7🌳 Mature4,011

The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM observability all in one place.

gateway📁v1.11.19🌳 Mature589

The only fully local production-grade Super SDK that provides a simple, unified, and powerful interface for calling more than 200+ LLMs.

LLM-Agents-Ecosystem-Handbook📁0.0.0🌳 Mature508

One-stop handbook for building, deploying, and understanding LLM agents with 60+ skeletons, tutorials, ecosystem guides, and evaluation tools.

llama.cpp📁b8864🌳 Mature103,119

LLM inference in C/C++

openinference📁python-openinference-instrumentation-google-genai-v0.1.15🌿 Growing913

OpenTelemetry Instrumentation for AI Observability

career-ops📁v1.5.0🌿 Growing30,403

AI-powered job search system built on Claude Code. 14 skill modes, Go dashboard, PDF generation, batch processing.

hub📁0.9.0🌿 Growing184

High-scale LLM gateway, written in Rust. OpenTelemetry-based observability included

A comprehensive toolkit for deploying production-ready Generative AI infrastructure on Amazon EKS. Includes pre-configured components for: 🚀 AI Gateway (LiteLLM) 🤖 LLM Serving (vLLM, SGLang, Ollama

AI Agent Development Platform - Supports multiple models (OpenAI/DeepSeek/Wenxin/Tongyi), knowledge base management, workflow automation, and enterprise-grade security. Built with Flask + Vue3 + LangC

tensorzero📁2026.4.0🌱 Seedling11,204

TensorZero is an open-source LLMOps platform that unifies an LLM gateway, observability, evaluation, optimization, and experimentation.

mlflow📁v3.11.1🌱 Seedling25,285

The open source AI engineering platform for agents, LLMs, and ML models. MLflow enables teams of all sizes to debug, evaluate, monitor, and optimize production-quality AI applications while controllin

VectorChord📁1.1.1🌱 Seedling1,629

Scalable, fast, and disk-friendly vector search in Postgres, the successor of pgvecto.rs.

ragas📁v0.4.3🌱 Seedling13,329

Supercharge Your LLM Application Evaluations 🚀

axon📁main@2026-04-21🌱 Seedling2

Enable autonomous AI workflows with a local-first, zero-trust Rust framework for high-performance multi-agent orchestration and deterministic execution.

Awesome-RAG-Production📁main@2026-04-21🌱 Seedling2

🚀 Build and scale reliable Retrieval-Augmented Generation (RAG) systems with this curated collection of tools, frameworks, and best practices.

swiftide📁v0.32.1🌱 Seedling686

Fast, streaming indexing, query, and agentic LLM applications in Rust