# inference-gateway

> An open-source, cloud-native, high-performance gateway unifying multiple LLM providers, from local solutions like Ollama to major cloud providers such as OpenAI, Groq, Cohere, Anthropic, Cloudflare an

- **URL**: https://www.freshcrate.ai/projects/inference-gateway
- **Author**: inference-gateway
- **Category**: Infrastructure
- **Latest version**: `v0.24.6` (2026-05-21)
- **License**: MIT
- **Source**: https://github.com/inference-gateway/inference-gateway
- **Homepage**: https://docs.inference-gateway.com
- **Language**: Go
- **GitHub**: 111 stars, 20 forks
- **Registry**: github
- **Tags**: `agnostic`, `anthropic`, `api`, `cohere`, `deepseek-v3-2`, `gateway`, `gateway-api`, `go`, `golang`

## Description

An open-source, cloud-native, high-performance gateway unifying multiple LLM providers, from local solutions like Ollama to major cloud providers such as OpenAI, Groq, Cohere, Anthropic, Cloudflare and DeepSeek.

## Recent releases

| Version | Date | Urgency | Changes |
| --- | --- | --- | --- |
| `v0.24.6` | 2026-05-21 | High | ## [0.24.6](https://github.com/inference-gateway/inference-gateway/compare/v0.24.5...v0.24.6) (2026-05-21)  ### 🐛 Bug Fixes  * **mcp:** Keep gateway running when all MCP servers are unreachable at startup ([#306](https://github.com/inference-gateway/inference-gateway/issues/306)) ([a10910b](https://github.com/inference-gateway/inference-gateway/commit/a10910bc92218e5cb54c7f305bbd794be1e1fe98)), closes [#304](https://github.com/inference-gateway/inference-gateway/issues/304)  ### 🔧 Miscellaneou |
| `v0.24.4` | 2026-05-13 | High | ## [0.24.4](https://github.com/inference-gateway/inference-gateway/compare/v0.24.3...v0.24.4) (2026-05-13)  ### 🔧 Miscellaneous  * **deps:** Bump SDK to v1.16.3 and refresh generated types ([#299](https://github.com/inference-gateway/inference-gateway/issues/299)) ([baa564b](https://github.com/inference-gateway/inference-gateway/commit/baa564bc5675d5d0b0cf37d1e71e76c4c6779a7b)), closes [#298](https://github.com/inference-gateway/inference-gateway/issues/298)   ---  ## 📦 Quick Installation  ### |
| `v0.24.3` | 2026-05-13 | High | ## [0.24.3](https://github.com/inference-gateway/inference-gateway/compare/v0.24.2...v0.24.3) (2026-05-13)  ### 🐛 Bug Fixes  * **dependabot:** Replace assignees with CODEOWNERS ([f360f03](https://github.com/inference-gateway/inference-gateway/commit/f360f03c427cce3def5f39fee63e758158bc3bf0))  ### 🔧 Miscellaneous  * **dependabot:** Simplify config to root gomod, docker, and github-actions ([644e958](https://github.com/inference-gateway/inference-gateway/commit/644e9582cff674a3c68fbb613e23e5abed |
| `v0.24.1` | 2026-05-07 | High | ## [0.24.1](https://github.com/inference-gateway/inference-gateway/compare/v0.24.0...v0.24.1) (2026-05-07)  ### 👷 CI  * **deps:** Bump golangci-lint to latest ([6924c38](https://github.com/inference-gateway/inference-gateway/commit/6924c3865e90178446142eb0ac622a93421e1950)) * Update Claude Code action version and refine system prompt instructions ([3e2fae3](https://github.com/inference-gateway/inference-gateway/commit/3e2fae3dfbc50ac8b789d76ba812f339cbc8ee49)) * Update golangci-lint installatio |
| `v0.24.0` | 2026-04-28 | High | ## [0.24.0](https://github.com/inference-gateway/inference-gateway/compare/v0.23.6...v0.24.0) (2026-04-28)  ### ✨ Features  * Add Google's extra content for thought_signature passing ([#275](https://github.com/inference-gateway/inference-gateway/issues/275)) ([b31659b](https://github.com/inference-gateway/inference-gateway/commit/b31659b3d83b587077baa26f11d17d6040d4c080))  ### 🐛 Bug Fixes  * **ci:** Infer workflow should be skipped when the actor was a bot ([327a86c](https://github.com/inferenc |
| `v0.23.6` | 2026-04-08 | High | ## [0.23.6](https://github.com/inference-gateway/inference-gateway/compare/v0.23.5...v0.23.6) (2026-04-08)  ### 🔧 Miscellaneous  * Bump dev dependencies and tool versions ([#266](https://github.com/inference-gateway/inference-gateway/issues/266)) ([d851119](https://github.com/inference-gateway/inference-gateway/commit/d85111908b4063b1d1ac5651f6a8d1c00ae9f426)) * **deps(examples):** Bump @hono/node-server ([#267](https://github.com/inference-gateway/inference-gateway/issues/267)) ([ec87055] |
| `v0.23.5` | 2026-04-01 | Medium | ## [0.23.5](https://github.com/inference-gateway/inference-gateway/compare/v0.23.4...v0.23.5) (2026-04-01)  ### 🔧 Miscellaneous  * Add stale issues workflow to auto-close inactive issues ([0989d22](https://github.com/inference-gateway/inference-gateway/commit/0989d225d61f7ba414f1619f5c13058ed5033503)) * Bump CI and dev containers dependencies ([#255](https://github.com/inference-gateway/inference-gateway/issues/255)) ([aca7a05](https://github.com/inference-gateway/inference-gateway/commit/aca7a |
| `v0.23.4` | 2026-03-05 | Low | ## [0.23.4](https://github.com/inference-gateway/inference-gateway/compare/v0.23.3...v0.23.4) (2026-03-05)  ### 🐛 Bug Fixes  * Do not run infer agent if the comment was made by dependabot ([2ea9aa9](https://github.com/inference-gateway/inference-gateway/commit/2ea9aa9f92bb75cf1e8fad8f2721389c8021e092))   ---  ## 📦 Quick Installation  ### Binary Installation  **Install latest version:** ```bash curl -fsSL https://raw.githubusercontent.com/inference-gateway/inference-gateway/main/install.sh \| ba |
| `v0.23.3` | 2026-03-05 | Low | ## [0.23.3](https://github.com/inference-gateway/inference-gateway/compare/v0.23.2...v0.23.3) (2026-03-05)  ### ♻️ Improvements  * Remove deprecated web UI ([#233](https://github.com/inference-gateway/inference-gateway/issues/233)) ([1738332](https://github.com/inference-gateway/inference-gateway/commit/1738332230bc5092206f352f087442ae245e34db))  ### 🔧 Miscellaneous  * **deps)(deps:** Bump go.opentelemetry.io/otel/sdk ([#242](https://github.com/inference-gateway/inference-gateway/issues/242)) ( |
| `v0.23.2` | 2026-01-23 | Low | ## [0.23.2](https://github.com/inference-gateway/inference-gateway/compare/v0.23.1...v0.23.2) (2026-01-23)  ### 🐛 Bug Fixes  * **examples:** Add missing ghcr.io prefix to oci images ([02a84b8](https://github.com/inference-gateway/inference-gateway/commit/02a84b89680744534aa37c705f941bbd84b56869))   ---  ## 📦 Quick Installation  ### Binary Installation  **Install latest version:** ```bash curl -fsSL https://raw.githubusercontent.com/inference-gateway/inference-gateway/main/install.sh \| bash ``` |

## Citation

- HTML: https://www.freshcrate.ai/projects/inference-gateway
- Markdown: https://www.freshcrate.ai/projects/inference-gateway.md
- Dependencies JSON: https://www.freshcrate.ai/api/projects/inference-gateway/deps

_Generated by freshcrate.ai. Indexes github releases for AI-agent ecosystem packages._