freshcrate
Skin:/
Home > #inference-gateway

Tag: #inference-gateway

1 package â€ĸ ⭐ 179 total stars

Trending in #inference-gateway

smgv1.4.1đŸŒŋ Growing⭐179

Engine-agnostic LLM gateway in Rust. Full OpenAI & Anthropic API compatibility across SGLang, vLLM, TRT-LLM, OpenAI, Gemini & more. Industry-first gRPC pipeline, KV cache-aware routing, chat history,