Tag: #llm-gateway
7 packages âĸ â 19,698 total stars
đ Next Generation Multi-tenant AI One-Stop Solution. Builtin Admin & Billing System. Enterprise-Grade Unified LLM Gateway Support for 200+ Models And 35+ Providers, Load Balacing w/ Priority-base Rou
Plano is an AI-native proxy and data plane for agentic apps â with built-in orchestration, safety, observability, and smart LLM routing so you stay focused on your agents core logic.
Fastest enterprise AI gateway (50x faster than LiteLLM) with adaptive load balancer, cluster mode, guardrails, 1000+ models support & <100 Âĩs overhead at 5k RPS.
Open-source AI gateway written in Rust, with token compression for Claude Code, Codex... and any other LLM client.
Zero trust LLM gateway. OpenAI-compatible proxy with semantic routing and load balancing across OpenAI, Anthropic, Ollama, vLLM, and any compatible backend. Identity-based access, virtual A
Route, manage, and analyze your LLM requests across multiple providers with a unified API interface
đ Access the reverse-engineered GitHub Copilot API through this proxy, enabling streamlined integration for your development needs.