freshcrate

Search results for "ai-gateway"

Clear filters
6 results found (Python)
litellm📁v1.83.7-stable🌳 Mature42,951

Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropi

arcade-mcp📁main@2026-04-21🌿 Growing855

The best way to create, deploy, and share MCP Servers

orbit📁v2.6.6🌿 Growing250

One API for 20+ LLM providers, your databases, and your files — self-hosted, open-source AI gateway with RAG, voice, and guardrails.

SmarterRouter📁2.2.5🌿 Growing105

SmarterRouter: An intelligent LLM gateway and VRAM-aware router for Ollama, llama.cpp, and OpenAI. Features semantic caching, model profiling, and automatic failover for local AI labs.

deltallm📁v0.1.20-rc2🌱 Seedling3

Route, manage, and analyze your LLM requests across multiple providers with a unified API interface

claude-api-cost-optimization📁main@2026-04-21🌱 Seedling2

💰 Optimize your Claude API usage to save 50-90% on costs with batching techniques and efficient request management.