freshcrate

Search results for "llm"

Clear filters
50 results found (Rust)
pdf_oxideπŸ“v0.3.37🌳 Mature⭐547

The fastest PDF library for Python and Rust. Text extraction, image extraction, markdown conversion, PDF creation & editing. 0.8ms mean, 5Γ— faster than industry leaders, 100% pass rate on 3,830 PDFs.

gproxyπŸ“v1.0.18🌿 Growing⭐92

gproxy is a Rust-based multi-channel LLM proxy that exposes OpenAI / Claude / Gemini-style APIs through a unified gateway, with a built-in admin console, user/key management, and request/usage auditin

moltisπŸ“20260420.02🌳 Mature⭐2,536

A secure persistent personal agent server in Rust. One binary, sandboxed execution, multi-provider LLMs, voice, memory, Telegram, WhatsApp, Discord, Teams, and MCP tools. Secure by design, runs on you

edgecrabπŸ“v0.7.0🌱 Seedling⭐21

EdgeCrab πŸ¦€ A Super Powerful Personal Assistant inspired by NousHermes and OpenClaw β€” Rust-native, blazing-fast terminal UI, ReAct tool loop, multi-provider LLM support, ACP protocol, gateway adapters

control-layerπŸ“v8.41.0🌿 Growing⭐62

The world’s fastest AI model gateway (450x less overhead than LiteLLM). Unified access to LLMs across endpoints (openAI, self-hosted, etc.) behind a single authentication layer - with API key generati

planoπŸ“0.4.20🌿 Growing⭐6,241

Plano is an AI-native proxy and data plane for agentic apps β€” with built-in orchestration, safety, observability, and smart LLM routing so you stay focused on your agents core logic.

capsuleπŸ“v0.8.8🌿 Growing⭐276

A secure, durable runtime to sandbox AI agent tasks. Run untrusted code in isolated WebAssembly environments.

almideπŸ“v0.15.0🌱 Seedling⭐15

A functional programming language optimized for LLM code generation. Compiles to Rust and WebAssembly.

mentisdbπŸ“0.9.3.39🌿 Growing⭐56

Memory that lasts and compounds. MentisDB gives agents durable memory so they do not just remember, they improve over time. It stores append-only thought chains plus a Git-like skills registry, lett

ContribAIπŸ“v6.4.1🌿 Growing⭐232

Autonomous AI agent that contributes to open source β€” discovers repos, analyzes code, generates fixes, and submits PRs

gooseπŸ“v1.31.1🌿 Growing⭐41,151

an open source, extensible AI agent that goes beyond code suggestions - install, execute, edit, and test with any LLM

edgeeπŸ“v0.2.2🌱 Seedling⭐33

Open-source AI gateway written in Rust, with token compression for Claude Code, Codex... and any other LLM client.

crab-codeπŸ“main@2026-04-21🌱 Seedling⭐25

πŸ¦€ Open-source alternative to Claude Code, built from scratch in Rust. Agentic coding CLI β€” thinks, plans, and executes with any LLM. Compatible with Claude Code workflows.

biomcpπŸ“v0.8.21🌿 Growing⭐488

BioMCP: Biomedical Model Context Protocol

bamlπŸ“0.221.0🌿 Growing⭐7,955

The AI framework that adds the engineering to prompt engineering (Python/TS/Ruby/Java/C#/Rust/Go compatible)

hubπŸ“0.9.0🌿 Growing⭐184

High-scale LLM gateway, written in Rust. OpenTelemetry-based observability included

carapaceπŸ“v0.7.0🌱 Seedling⭐42

A secure, stable Rust alternative to openclaw/moltbot/clawdbot

cortex-scoutπŸ“v3.3.7🌿 Growing⭐60

A unified web extraction and stateful automation engine for AI. Replaces heavy testing frameworks with token-optimized browser control, deep research, and HITL.

smgπŸ“v1.4.1🌿 Growing⭐156

Engine-agnostic LLM gateway in Rust. Full OpenAI & Anthropic API compatibility across SGLang, vLLM, TRT-LLM, OpenAI, Gemini & more. Industry-first gRPC pipeline, KV cache-aware routing, chat history,

rust-sdkπŸ“rmcp-v1.5.0🌿 Growing⭐3,283

The official Rust SDK for the Model Context Protocol

zeroclawπŸ“v0.7.3🌿 Growing⭐29,983

Fast, small, and fully autonomous AI personal assistant infrastructure, ANY OS, ANY PLATFORM β€” deploy anywhere, swap anything πŸ¦€

OdysseyπŸ“main@2026-04-16🌱 Seedling⭐37

Rust SDK for packaging, securing, and operating portable AI agents.

graphbitπŸ“Graphbit_Python_v0.6.7🌱 Seedling⭐529

GraphBit is the world’s first enterprise-grade Agentic AI framework, built on a Rust core with a Python wrapper for unmatched speed, security, and scalability. It enables reliable multi-agent workflow

paiml-mcp-agent-toolkitπŸ“v3.14.0🌿 Growing⭐148

Pragmatic AI Labs MCP Agent Toolkit - An MCP Server designed to make code with agents more deterministic

oramacoreπŸ“v1.2.38🌱 Seedling⭐249

OramaCore is the complete runtime you need for your projects, answer engines, copilots, and search. It includes a fully-fledged full-text search engine, vector database, LLM interface, and many more u

octocodeπŸ“0.14.0🌿 Growing⭐319

Semantic code searcher and codebase utility

tensorzeroπŸ“2026.4.0🌱 Seedling⭐11,204

TensorZero is an open-source LLMOps platform that unifies an LLM gateway, observability, evaluation, optimization, and experimentation.

spiceaiπŸ“v1.11.5🌱 Seedling⭐2,868

A portable accelerated SQL query, search, and LLM-inference engine, written in Rust, for data-grounded AI apps and agents.

tools-rsπŸ“0.3.3🌱 Seedling⭐6

Serialize your functions with tools-rs!

AutoAgentsπŸ“v0.3.7🌱 Seedling⭐542

A multi-agent framework written in Rust that enables you to build, deploy, and coordinate multiple intelligent agents

spacebotπŸ“v0.4.1🌱 Seedling⭐2,066

An AI agent for teams, communities, and multi-user environments.

meerkatπŸ“v0.5.2🌱 Seedling⭐5

Meerkat - A modular, high-performance agent harness built in Rust.

DreamServerπŸ“v2.0.0🌱 Seedling⭐478

Local AI anywhere, for everyone β€” LLM inference, chat UI, voice, agents, workflows, RAG, and image generation. No cloud, no subscriptions.

VectorChordπŸ“1.1.1🌱 Seedling⭐1,629

Scalable, fast, and disk-friendly vector search in Postgres, the successor of pgvecto.rs.

sandboxed.shπŸ“v0.10.0🌱 Seedling⭐371

Self-hosted orchestrator for AI autonomous agents. Run Claude Code & Open Code in isolated linux workspaces. Manage your skills, configs and encrypted secrets with a git repo.

diraigentπŸ“v20260326-0929🌱 Seedling⭐6

A self-hosted software factory β€” define goals, agents decompose and execute them through enforced pipelines, with humans in the loop where it matters.

axonixπŸ“main@2026-04-13🌱 Seedling⭐3

A self-evolving AI agent that gets more useful every day

scorpio-analystπŸ“v0.2.4🌱 Seedling⭐1

Your personal Multi-Agent portfolio manager and financial analyst team

git-mcp-rsπŸ“main@2026-04-21🌱 Seedling⭐1

πŸ” Enable real-time exploration of GitHub repositories with this high-performance Model Context Protocol (MCP) server built in Rust.

aictlπŸ“v0.28.0🌱 Seedling⭐1

πŸ€– AI agent in your terminal

hrafnπŸ“master@2026-04-18🌱 Seedling⭐2

Lightweight, modular AI agent runtime β€” thinks (Hrafn) and remembers (MuninnDB) πŸ¦β€β¬›

ryvosπŸ“v0.9.0🌱 Seedling⭐2

Open-source autonomous AI assistant with 5-tier security, 62 tools, 14 LLM providers. Written in Rust. Single binary.

RustClawπŸ“v0.5.0🌱 Seedling⭐2

Lean Rust AI agent: 6MB binary, 7.9MB RAM. OpenClaw replacement. Telegram + Discord + GitHub auto-PR. Ollama/Anthropic support.

swiftideπŸ“v0.32.1🌱 Seedling⭐686

Fast, streaming indexing, query, and agentic LLM applications in Rust

swarm_factoryπŸ“main@2026-04-21🌱 Seedling⭐1

πŸš€ Build and launch a dynamic multi-agent ecosystem quickly with Swarm Factory, your go-to solution for adaptive AI development.

CrystalCanvasπŸ“main@2026-04-14🌱 Seedling⭐1

High-performance crystal structure modeling and DFT/MD file preparation. Native desktop app fusing a Rust/C++ physics kernel, a GPU-accelerated Metal/Vulkan renderer, and an AI-driven command bus for

phronesiserπŸ“main@2026-04-18🌱 Seedling⭐1

Add provably safe ethical constraints to AI agents via Phronesis

llm-lsπŸ“0.5.3⚰️ Archived⭐865

LSP server leveraging LLMs for code completion (and more?)

botserverπŸ“2.4.42⚰️ Archived⭐76

Complete open-source AI collaboration suite and multi-agent platform featuring LLM orchestration, automation, and virtual assistants. Scales seamlessly from small deployments to large enterprise envir