freshcrate

Search results for "cache-aware"

4 results found
opencode-magic-context📁dashboard-v0.2.8🌿 Growing124

OpenCode plugin for Magic Context — cache-aware infinite context, cross-session memory, and background history compression for AI coding agents

smg📁v1.4.1🌿 Growing156

Engine-agnostic LLM gateway in Rust. Full OpenAI & Anthropic API compatibility across SGLang, vLLM, TRT-LLM, OpenAI, Gemini & more. Industry-first gRPC pipeline, KV cache-aware routing, chat history,

agent2📁v0.1.0🌱 Seedling25

The production runtime for AI agents. Schema in, API out. Built on PydanticAI + FastAPI.