Search results for "cache"
Engine-agnostic LLM gateway in Rust. Full OpenAI & Anthropic API compatibility across SGLang, vLLM, TRT-LLM, OpenAI, Gemini & more. Industry-first gRPC pipeline, KV cache-aware routing, chat history,
Local knowledge graph for AI agents. Hybrid search + MCP server for Obsidian vaults.
Every meeting, every idea, every voice note — searchable by your AI. Open-source, privacy-first conversation memory layer.
EdgeCrab 🦀 A Super Powerful Personal Assistant inspired by NousHermes and OpenClaw — Rust-native, blazing-fast terminal UI, ReAct tool loop, multi-provider LLM support, ACP protocol, gateway adapters
gproxy is a Rust-based multi-channel LLM proxy that exposes OpenAI / Claude / Gemini-style APIs through a unified gateway, with a built-in admin console, user/key management, and request/usage auditin
A portable accelerated SQL query, search, and LLM-inference engine, written in Rust, for data-grounded AI apps and agents.
Data transformation framework for AI. Ultra performant, with incremental processing. 🌟 Star if you like it!
LeanKG: Stop Burning Tokens. Start Coding Lean.
Distributed AI/LLM for the people. Share compute privately or publicly to power your agents and chat.
EdegQuake 🌋 High-performance GraphRAG inspired from LightRag written in Rust; Transform documents into intelligent knowledge graphs for superior retrieval and generation
Memory that lasts and compounds. MentisDB gives agents durable memory so they do not just remember, they improve over time. It stores append-only thought chains plus a Git-like skills registry, lett
The world’s fastest AI model gateway (450x less overhead than LiteLLM). Unified access to LLMs across endpoints (openAI, self-hosted, etc.) behind a single authentication layer - with API key generati
A secure, durable runtime to sandbox AI agent tasks. Run untrusted code in isolated WebAssembly environments.
BioMCP: Biomedical Model Context Protocol
Pragmatic AI Labs MCP Agent Toolkit - An MCP Server designed to make code with agents more deterministic
Semantic code searcher and codebase utility
The code quality toolkit for the agentic AI era. Find dead code, clones, and scaffolding across 15 languages. MCP server + CLI.
An AI agent for teams, communities, and multi-user environments.
Generate fully-typed, lint-clean language bindings for Rust libraries across 11 languages
A high-performance, in-memory vector database written in Rust, designed for semantic search and top-k nearest neighbor queries in AI-driven applications, with binary file persistence for durability.
A functional programming language optimized for LLM code generation. Compiles to Rust and WebAssembly.
Next-Gen AI-Aware Git
Local AI anywhere, for everyone — LLM inference, chat UI, voice, agents, workflows, RAG, and image generation. No cloud, no subscriptions.
Serialize your functions with tools-rs!
Your personal Multi-Agent portfolio manager and financial analyst team
LSP server leveraging LLMs for code completion (and more?)
Complete open-source AI collaboration suite and multi-agent platform featuring LLM orchestration, automation, and virtual assistants. Scales seamlessly from small deployments to large enterprise envir