# ai-gateway

> One API for 25+ LLMs, OpenAI, Anthropic, Bedrock, Azure. Caching, guardrails & cost controls. Go-native LiteLLM & Kong AI Gateway alternative.

- **URL**: https://www.freshcrate.ai/projects/ai-gateway
- **Author**: ferro-labs
- **Category**: MCP Servers
- **Latest version**: `v1.1.2` (2026-06-06)
- **License**: Apache-2.0
- **Source**: https://github.com/ferro-labs/ai-gateway
- **Homepage**: https://docs.ferrolabs.ai
- **Language**: Go
- **GitHub**: 68 stars, 10 forks
- **Registry**: github
- **Tags**: `ai-gateway`, `ai-infrastructure`, `anthropic`, `bedrock`, `deepinfra`, `gateway`, `go`, `guardrails`, `kong`

## Description

One API for 25+ LLMs, OpenAI, Anthropic, Bedrock, Azure. Caching, guardrails & cost controls. Go-native LiteLLM & Kong AI Gateway alternative.

## Recent releases

| Version | Date | Urgency | Changes |
| --- | --- | --- | --- |
| `v1.1.2` | 2026-06-06 | High | ## [1.1.2] — 2026-06-06  Release hardening patch for the external model catalog cutover, catalog pricing correctness, and response-body lifecycle fixes. No public API breaks. Fixes every issue labelled [`release-1.1.2`](https://github.com/ferro-labs/ai-gateway/issues?q=label%3Arelease-1.1.2): [#132](https://github.com/ferro-labs/ai-gateway/issues/132), [#133](https://github.com/ferro-labs/ai-gateway/issues/133), [#134](https://github.com/ferro-labs/ai-gateway/issues/134), and [#185](https://gi |
| `v1.1.1` | 2026-05-31 | High | ## [1.1.1] — 2026-05-31  Stability hotfix. No new features, no API breaks. Fixes every issue labelled [`release-1.1.1`](https://github.com/ferro-labs/ai-gateway/issues?q=label%3Arelease-1.1.1) plus three additional CRITICAL bugs found in the post-v1.1.0 engine audit (shutdown panic, runtime-discovery data race, streaming goroutine/body leak). Adds a `goleak` + `-race` concurrency stress harness so these regressions can't recur silently.  ### Fixed  - **Send on closed channel panic during s |
| `v1.1.0` | 2026-05-24 | High | ## [1.1.0] — 2026-05-24  Adds opt-in OpenTelemetry tracing. Off by default — a zero-allocation no-op until an OTLP endpoint or exporter is configured.  ### Added  - **OpenTelemetry tracing** (issue [#49](https://github.com/ferro-labs/ai-gateway/issues/49)): new public `observability` package (stable `Provider`/`Span`/`Exporter`/`Event` seam + `gen_ai.*`/`ferro.*` attribute constants) backed by an `internal/otel` OTLP pipeline (gRPC + HTTP/protobuf, W3C propagation). Each `Route()`/`RouteStream() |
| `v1.0.10` | 2026-05-16 | High | ## [1.0.10] — 2026-05-16  Security maintenance release addressing GitHub Dependabot alerts and adding CI coverage for reachable Go vulnerabilities.  ### Security  - **gRPC-Go authorization bypass**: Overrode transitive `google.golang.org/grpc` resolution to `v1.79.3` to address `GHSA-p77j-4mvh-x3m3` / `CVE-2026-33186`. - **golang.org/x/crypto SSH vulnerabilities**: Upgraded `golang.org/x/crypto` from `v0.35.0` to `v0.51.0`, addressing `GHSA-f6x5-jh6r-wrfv` / `CVE-2025-47914` and `GHSA-j5w8-q4qc- |
| `v1.0.7` | 2026-05-11 | High | ## [1.0.7] — 2026-05-11  Internal architecture release completing the `cmd/ferrogw` refactor. No public API or behaviour changes.  ### Changed  - **`cmd/ferrogw` refactor — Phases 2–6**: Moved all remaining business logic out of `cmd/ferrogw/` into dedicated `internal/` packages. `main.go` is now 59 lines of Cobra wiring + plugin imports.   - `internal/httpserver/` — HTTP server constructor (`server.go`) and Prometheus connection tracker (`conntracker.go`)   - `internal/proxy/` — Pass-through re |
| `v1.0.6` | 2026-05-06 | High | ## [1.0.6] — 2026-05-06  Feature release adding official Python and TypeScript SDKs, Helm chart distribution via ArtifactHub, and Replicate streaming support.  ### Added  - **Official TypeScript SDK** ([ferro-labs/ferrolabs-typescript-sdk](https://github.com/ferro-labs/ferrolabs-typescript-sdk)): First-party TypeScript/JavaScript client library for the Ferro Labs AI Gateway — supports chat, streaming, embeddings, and image generation across 30+ providers. - **Official Python SDK** ([ferro-labs/f |
| `v1.0.5` | 2026-04-28 | High | ## [1.0.5] — 2026-04-28  Feature release adding first-class Ollama Cloud support and broader embedding coverage while keeping the gateway's public API OpenAI-compatible for end users.  ### Added  - **Ollama Cloud provider** ([#94](https://github.com/ferro-labs/ai-gateway/issues/94)): Added `ollama-cloud` as a separate provider from local `ollama`, using Ollama Cloud's documented `https://ollama.com/api` endpoints with Bearer token authentication via `OLLAMA_API_KEY`. - **OpenAI-compatible gatewa |
| `v1.0.4` | 2026-04-09 | High | ## [1.0.4] — 2026-04-09  Patch release focused on security maintenance, cache correctness, and refreshed project messaging. This release keeps the `v1.0.x` line stable while improving the published release notes for GitHub releases.  ### Security  - **Dependabot: AWS SDK EventStream decoder DoS**: Upgraded `github.com/aws/aws-sdk-go-v2/service/bedrockruntime` from `v1.50.1` to `v1.50.4` and `github.com/aws/aws-sdk-go-v2/aws/protocol/eventstream` from `v1.7.6` to `v1.7.8` to address GitHub adviso |
| `v1.0.3` | 2026-04-01 | Medium | ## Ferro Labs AI Gateway 1.0.3  **Full Changelog**: https://github.com/ferro-labs/ai-gateway/blob/main/CHANGELOG.md  ## Changelog ### Other Changes * e0bfe4c4d92c7ce245f70746414954d359f35bec: Release v1.0.3 — dashboard redesign, Docker hardening, CLI polish (#77) (@MitulShah1) |
| `v1.0.2` | 2026-03-30 | Medium | ## Ferro Labs AI Gateway 1.0.2  **Full Changelog**: https://github.com/ferro-labs/ai-gateway/blob/main/CHANGELOG.md  ## Changelog ### Other Changes * 097d48a001c7aad262d62ae50c4f2dc4e6b94f86: Release/v1.0.2 (#75) (@MitulShah1) |

## Dependency audit

- **Score**: 52/100
- **Total deps**: 14
- **Resolved**: 0
- **Unresolved**: 14
- **License conflicts**: 0
- **Warnings**: 14
- **Scanned**: 2026-05-18

## Citation

- HTML: https://www.freshcrate.ai/projects/ai-gateway
- Markdown: https://www.freshcrate.ai/projects/ai-gateway.md
- Dependencies JSON: https://www.freshcrate.ai/api/projects/ai-gateway/deps

_Generated by freshcrate.ai. Indexes github releases for AI-agent ecosystem packages._