Tag: #llmops
9 packages • ⭐ 17,891 total stars
Supercharge Your LLM Application Evaluations 🚀
Scalable, fast, and disk-friendly vector search in Postgres, the successor of pgvecto.rs.
OpenTelemetry Instrumentation for AI Observability
Fast, streaming indexing, query, and agentic LLM applications in Rust
The only fully local production-grade Super SDK that provides a simple, unified, and powerful interface for calling more than 200+ LLMs.
One-stop handbook for building, deploying, and understanding LLM agents with 60+ skeletons, tutorials, ecosystem guides, and evaluation tools.
High-scale LLM gateway, written in Rust. OpenTelemetry-based observability included
A comprehensive toolkit for deploying production-ready Generative AI infrastructure on Amazon EKS. Includes pre-configured components for: 🚀 AI Gateway (LiteLLM) 🤖 LLM Serving (vLLM, SGLang, Ollama
🚀 Build and scale reliable Retrieval-Augmented Generation (RAG) systems with this curated collection of tools, frameworks, and best practices.