freshcrate — Search

Search results for "litellm"

3 results found (Rust)

The world’s fastest AI model gateway (450x less overhead than LiteLLM). Unified access to LLMs across endpoints (openAI, self-hosted, etc.) behind a single authentication layer - with API key generati

gateway llm openai rustby doublewordaiRust

edgee 📁v0.2.2🌿 Growing⭐55

Open-source AI gateway written in Rust, with token compression for Claude Code, Codex... and any other LLM client.

agentic cli coding-assistant context-optimization cost-optimization edgee llm-gateway rust token-compressionby edgee-aiRust

DreamServer 📁v2.0.0🌿 Growing⭐443

Local AI anywhere, for everyone — LLM inference, chat UI, voice, agents, workflows, RAG, and image generation. No cloud, no subscriptions.

ai-agents amd comfyui docker llama-cpp llm local-ai n8n rustby Light-Heart-LabsRust