freshcrate

Search results for "llm"

Clear filters
8 results found (C++)
xgrammarπŸ“0.1.33🌳 Mature⭐1,637

Efficient, Flexible and Portable Structured Generation

llama.cppπŸ“b8871πŸ›οΈ Flagship⭐105,537

LLM inference in C/C++

rocketride-serverπŸ“server-v3.1.2-prerelease🌳 Mature⭐1,873

High-performance AI pipeline engine with a C++ core and 50+ Python-extensible nodes. Build, debug, and scale LLM workflows with 13+ model providers, 8+ vector databases, and agent orchestration, all f

infinityπŸ“v0.7.0-dev5🌳 Mature⭐4,485

The AI-native database built for LLM applications, providing incredibly fast hybrid search of dense vector, sparse vector, tensor (multi-vector), and full-text.

seekdbπŸ“v1.2.0🌿 Growing⭐2,530

The AI-Native Search Database. Unifies vector, text, structured and semi-structured data in a single engine, enabling hybrid search and in-database AI workflows.

ThemisDBπŸ“v1.8.1-rc1🌱 Seedling⭐5

Themis Database System - High-performance C++ hybrid-database (graph-vector-relational-file) with AQL support and MVCC

llm-streamπŸ“main@2026-04-21🌱 Seedling⭐2

Stream responses from OpenAI and Anthropic models with lightweight C++ tools for efficient large language model integration.

mcp-brunella-coreπŸ“main@2026-04-20🌱 Seedling⭐1

BRUNELLA AGENT SYSTEM (BAS) – A JΓ–VŐ DIGITÁLIS SZERVEZETE