Tag: #ai-infrastructure
10 packages âĸ â 265 total stars
One API for 25+ LLMs, OpenAI, Anthropic, Bedrock, Azure. Caching, guardrails & cost controls. Go-native LiteLLM & Kong AI Gateway alternative.
Self-hosted orchestration layer for autonomous AI agent teams. Shared memory, heartbeat scheduling, vault-first secrets, and cross-model peer review â one command to deploy.
Zero trust LLM gateway. OpenAI-compatible proxy with semantic routing and load balancing across OpenAI, Anthropic, Ollama, vLLM, and any compatible backend. Identity-based access, virtual A
Zero-code LLM security & observability proxy. Real-time prompt injection detection, PII scanning, and cost control for OpenAI-compatible APIs. Built in Rust.
Your machine's AI brain. One 20MB binary gives every tool, script, and cron job shared AI memory + 114 API routes. Desktop app, CLI, Telegram â all connected. Rust-powered.
Production-grade TypeScript AI runtime focused on reliability, governance, and reproducible LLM systems. Multi-provider gateway, agents, RAG, workflows, policy engine, audit trails, and deterministic
The open, vendor-neutral protocol for governing the lifecycle of AI agent systems. Standardizes planning, coordination, execution, confirmation, and traceability across multi-agent runtimes and tools
Route, manage, and analyze your LLM requests across multiple providers with a unified API interface
đ Enable AI agents to shop for users seamlessly, protecting your brand and data while streamlining commerce across any platform.
Commit mode for production AI agent actions. Free verification. Free trust discovery.