freshcrate

Search results for "ai-gateway"

15 results found
llmio๐Ÿ“v0.8.3๐ŸŒฟ Growingโญ265

LLM API load-balancing gateway. LLM API ่ดŸ่ฝฝๅ‡่กก็ฝ‘ๅ…ณ.

bifrost๐Ÿ“ent-v1.4.0-prerelease4-base๐ŸŒณ Matureโญ3,615

Fastest enterprise AI gateway (50x faster than LiteLLM) with adaptive load balancer, cluster mode, guardrails, 1000+ models support & <100 ยตs overhead at 5k RPS.

litellm๐Ÿ“v1.83.7-stable๐ŸŒณ Matureโญ42,951

Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropi

new-api๐Ÿ“v0.12.14๐ŸŒณ Matureโญ26,168

A unified AI model hub for aggregation & distribution. It supports cross-converting various LLMs into OpenAI-compatible, Claude-compatible, or Gemini-compatible formats. A centralized gateway for pers

This Guidance demonstrates how to streamline access to numerous large language models (LLMs) through a unified, industry-standard API gateway based on OpenAI API standards

plano๐Ÿ“0.4.20๐ŸŒฟ Growingโญ6,241

Plano is an AI-native proxy and data plane for agentic apps โ€” with built-in orchestration, safety, observability, and smart LLM routing so you stay focused on your agents core logic.

arcade-mcp๐Ÿ“main@2026-04-21๐ŸŒฟ Growingโญ855

The best way to create, deploy, and share MCP Servers

orbit๐Ÿ“v2.6.6๐ŸŒฟ Growingโญ250

One API for 20+ LLM providers, your databases, and your files โ€” self-hosted, open-source AI gateway with RAG, voice, and guardrails.

SmarterRouter๐Ÿ“2.2.5๐ŸŒฟ Growingโญ105

SmarterRouter: An intelligent LLM gateway and VRAM-aware router for Ollama, llama.cpp, and OpenAI. Features semantic caching, model profiling, and automatic failover for local AI labs.

ai-gateway๐Ÿ“v1.0.4๐ŸŒฟ Growingโญ59

One API for 25+ LLMs, OpenAI, Anthropic, Bedrock, Azure. Caching, guardrails & cost controls. Go-native LiteLLM & Kong AI Gateway alternative.

oh-my-pi๐Ÿ“v14.1.2๐ŸŒฟ Growingโญ2,872

โŒฅ AI Coding agent for the terminal โ€” hash-anchored edits, optimized tool harness, LSP, Python, browser, subagents, and more

deltallm๐Ÿ“v0.1.20-rc2๐ŸŒฑ Seedlingโญ3

Route, manage, and analyze your LLM requests across multiple providers with a unified API interface

claude-api-cost-optimization๐Ÿ“main@2026-04-21๐ŸŒฑ Seedlingโญ2

๐Ÿ’ฐ Optimize your Claude API usage to save 50-90% on costs with batching techniques and efficient request management.

APIPark๐Ÿ“v1.9.6-beta๐ŸŒฑ Seedlingโญ1,644

Cloud native, ultra-high performance AI&API gateway, LLM API management, distribution system, open platform, supporting all AI APIs.๐Ÿฆ„ไบ‘ๅŽŸ็”Ÿใ€่ถ…้ซ˜ๆ€ง่ƒฝ AI&API็ฝ‘ๅ…ณ๏ผŒLLM API ็ฎก็†ใ€ๅˆ†ๅ‘็ณป็ปŸใ€ๅผ€ๆ”พๅนณๅฐ๏ผŒๆ”ฏๆŒๆ‰€ๆœ‰AI API๏ผŒไธ้™ไบŽOpenAIใ€Azureใ€

coai๐Ÿ“v4.0.0๐Ÿ’ค Dormantโญ9,059

๐Ÿš€ Next Generation Multi-tenant AI One-Stop Solution. Builtin Admin & Billing System. Enterprise-Grade Unified LLM Gateway Support for 200+ Models And 35+ Providers, Load Balacing w/ Priority-base Rou