Search results for "llm-proxy"
2 results found (Python)
SmarterRouter: An intelligent LLM gateway and VRAM-aware router for Ollama, llama.cpp, and OpenAI. Features semantic caching, model profiling, and automatic failover for local AI labs.
Route, manage, and analyze your LLM requests across multiple providers with a unified API interface