freshcrate

Search results for "ai-infra"

Clear filters
2 results found (Go)
ai-gateway📁v1.0.4🌿 Growing68

One API for 25+ LLMs, OpenAI, Anthropic, Bedrock, Azure. Caching, guardrails & cost controls. Go-native LiteLLM & Kong AI Gateway alternative.

llm-gateway📁v0.1.4🌿 Growing55

Zero trust LLM gateway. OpenAI-compatible proxy with semantic routing and load balancing across OpenAI, Anthropic, Ollama, vLLM, and any compatible backend. Identity-based access, virtual A