Tag: #llm-proxy
5 packages âĸ â 278 total stars
SmarterRouter: An intelligent LLM gateway and VRAM-aware router for Ollama, llama.cpp, and OpenAI. Features semantic caching, model profiling, and automatic failover for local AI labs.
gproxy is a Rust-based multi-channel LLM proxy that exposes OpenAI / Claude / Gemini-style APIs through a unified gateway, with a built-in admin console, user/key management, and request/usage auditin
Zero trust LLM gateway. OpenAI-compatible proxy with semantic routing and load balancing across OpenAI, Anthropic, Ollama, vLLM, and any compatible backend. Identity-based access, virtual A
Route, manage, and analyze your LLM requests across multiple providers with a unified API interface
đ Access the reverse-engineered GitHub Copilot API through this proxy, enabling streamlined integration for your development needs.