freshcrate

Search results for "tensorrt"

10 results found
flashinfer-python📁0.6.8.post1🏛️ Flagship5,467

FlashInfer: Kernel Library for LLM Serving

xgrammar📁0.1.33🌳 Mature1,637

Efficient, Flexible and Portable Structured Generation

smg📁v1.4.1🌿 Growing179

Engine-agnostic LLM gateway in Rust. Full OpenAI & Anthropic API compatibility across SGLang, vLLM, TRT-LLM, OpenAI, Gemini & more. Industry-first gRPC pipeline, KV cache-aware routing, chat history,

DeepCamera📁v2026.3🌳 Mature2,689

Open-Source AI Camera Skills Platform, AI NVR & CCTV Surveillance. Local VLM video analysis with Qwen, DeepSeek, SmolVLM, LLaVA, YOLO26. LLM-powered agentic security camera agent — watches, understand

orbit📁v2.6.6🌿 Growing250

One API for 20+ LLM providers, your databases, and your files — self-hosted, open-source AI gateway with RAG, voice, and guardrails.

awesome-opensource-ai📁main@2026-04-20🌿 Growing2,849

Curated list of the best truly open-source AI projects, models, tools, and infrastructure.

AIGC-Interview-Book📁main@2026-04-19🌿 Growing3,560

【三年面试五年模拟】AIGC算法工程师面试秘籍。涵盖AIGC、LLM大模型、AI Agent、传统深度学习、自动驾驶、机器学习、计算机视觉、自然语言处理、强化学习、大数据挖掘、具身智能、元宇宙、AGI等AI行业面试笔试干货经验与核心知识。

robots📁v0.3.8🌱 Seedling44

Control robots and physical hardware with natural language through Strands Agents.

Comfy-Cozy📁v4.0.0🌱 Seedling6

AI co-pilot for ComfyUI — 113 tools for workflow authoring, model provisioning, and iterative rendering. Multi-provider (Claude, GPT-4o, Gemini, Ollama). Ships as MCP server or standalone CLI.

tritonclient2.67.0🌱 Seedling

Python client library and utilities for communicating with Triton Inference Server