Tag: #llmops
9 packages âĸ â 18,179 total stars
Supercharge Your LLM Application Evaluations đ
Scalable, fast, and disk-friendly vector search in Postgres, the successor of pgvecto.rs.
OpenTelemetry Instrumentation for AI Observability
Fast, streaming indexing, query, and agentic LLM applications in Rust
The only fully local production-grade Super SDK that provides a simple, unified, and powerful interface for calling more than 200+ LLMs.
One-stop handbook for building, deploying, and understanding LLM agents with 60+ skeletons, tutorials, ecosystem guides, and evaluation tools.
High-scale LLM gateway, written in Rust. OpenTelemetry-based observability included
A comprehensive toolkit for deploying production-ready Generative AI infrastructure on Amazon EKS. Includes pre-configured components for: đ AI Gateway (LiteLLM) đ¤ LLM Serving (vLLM, SGLang, Ollama
đ Build and scale reliable Retrieval-Augmented Generation (RAG) systems with this curated collection of tools, frameworks, and best practices.