# LocalAI

> LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.

- **URL**: https://www.freshcrate.ai/projects/LocalAI
- **Author**: mudler
- **Category**: MCP Servers
- **Latest version**: `v4.3.6` (2026-05-30)
- **License**: MIT
- **Source**: https://github.com/mudler/LocalAI
- **Homepage**: https://localai.io
- **Language**: Go
- **GitHub**: 45,672 stars, 3,988 forks
- **Registry**: github
- **Tags**: `agents`, `ai`, `api`, `audio-generation`, `decentralized`, `distributed`, `go`, `image-generation`, `libp2p`

## Description

LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.

## Recent releases

| Version | Date | Urgency | Changes |
| --- | --- | --- | --- |
| `v4.3.6` | 2026-05-30 | High | <!-- Release notes generated using configuration in .github/release.yml at master -->  ## What's Changed ### Other Changes * chore: :arrow_up: Update ggml-org/llama.cpp to `22d66b567eef11cf2e9832f04db64ee0323a0fd0` by @localai-bot in https://github.com/mudler/LocalAI/pull/10080 * security(http): refuse redirects on outbound clients via hardened pkg/httpclient by @richiejp in https://github.com/mudler/LocalAI/pull/10087 * feat(parakeet-cpp): add NVIDIA NeMo Parakeet ASR backend (parakeet.cp |
| `v4.3.1` | 2026-05-25 | High | <!-- Release notes generated using configuration in .github/release.yml at master -->  ## What's Changed ### Other Changes * Fix kokoros backend build break from Backend trait drift by @Copilot in https://github.com/mudler/LocalAI/pull/9972 * chore: :arrow_up: Update antirez/ds4 to `f91c12b50a1448527c435c028bfc70d1b00f6c33` by @localai-bot in https://github.com/mudler/LocalAI/pull/9975 * chore: :arrow_up: Update ikawrakow/ik_llama.cpp to `9f7ba245ab41e118f03aa8dd5134d18a81159d02` by @local |
| `v4.2.6` | 2026-05-16 | High | <!-- Release notes generated using configuration in .github/release.yml at master -->  ## What's Changed ### Other Changes * feat(llama-cpp): bump to MTP-merge SHA and automatically set MTP defaults by @localai-bot in https://github.com/mudler/LocalAI/pull/9852 * docs: :arrow_up: update docs version mudler/LocalAI by @localai-bot in https://github.com/mudler/LocalAI/pull/9853 * chore: :arrow_up: Update antirez/ds4 to `ef0a4905d05263df8e63689f2dd1efac618a752c` by @localai-bot in https://git |
| `v4.2.1` | 2026-05-11 | High | <!-- Release notes generated using configuration in .github/release.yml at master -->  ## What's Changed ### Exciting New Features 🎉 * feat: add ds4 backend (DeepSeek V4 Flash) with tool calls, thinking, KV cache by @localai-bot in https://github.com/mudler/LocalAI/pull/9758 ### 👒 Dependencies * chore(deps): bump the go_modules group across 1 directory with 2 updates by @dependabot[bot] in https://github.com/mudler/LocalAI/pull/9759 ### Other Changes * docs: :arrow_up: update docs vers |
| `v4.1.3` | 2026-04-06 | High | <!-- Release notes generated using configuration in .github/release.yml at master -->  ## What's Changed ### Bug fixes :bug: * fix(token): login via legacy api keys by @mudler in https://github.com/mudler/LocalAI/pull/9249 * fix(anthropic): do not emit empty tokens and fix SSE tool calls by @mudler in https://github.com/mudler/LocalAI/pull/9258 * fix(gpu): better detection for MacOS and Thor by @mudler in https://github.com/mudler/LocalAI/pull/9263 ### 👒 Dependencies * chore(deps): bump |
| `v4.1.2` | 2026-04-06 | Medium | <!-- Release notes generated using configuration in .github/release.yml at master -->  ## What's Changed ### Bug fixes :bug: * fix(autoparser): correctly pass by logprobs by @mudler in https://github.com/mudler/LocalAI/pull/9239 * fix(chat): do not retry if we had chatdeltas or tooldeltas from backend by @mudler in https://github.com/mudler/LocalAI/pull/9244 ### Exciting New Features 🎉 * feat(llama.cpp): wire speculative decoding settings by @mudler in https://github.com/mudler/LocalAI/p |
| `v4.1.1` | 2026-04-05 | Medium | This is a patch release to address few regressions from the last release and the upcoming Gemma4, most importantly:  - Fixes Gemma 4 tokenization with llama.cpp - Show login in api key only mode - Small fixes to improve Anthropic API compatibility  ## What's Changed ### Other Changes * docs: Update Home Assistant integrations list by @loryanstrant in https://github.com/mudler/LocalAI/pull/9206 * chore: :arrow_up: Update ggml-org/llama.cpp to `a1cfb645307edc61a89e41557f290f441043d3c2` by |
| `v4.1.0` | 2026-04-02 | Medium | # 🎉 LocalAI 4.1.0 Release! 🚀  <h1 align="center">   <br>   <img height="300" src="https://raw.githubusercontent.com/mudler/LocalAI/refs/heads/master/core/http/static/logo.png">   <br>   <br> </h1>  LocalAI 4.1.0 is out! 🔥  Just weeks after the landmark 4.0, we're back with another massive drop. This release turns LocalAI into a **production-grade AI platform**: spin up a distributed cluster with smart routing and autoscaling, lock it down with built-in auth and per-user quotas, fin |
| `v4.0.0` | 2026-03-14 | Low | <!-- Release notes generated using configuration in .github/release.yml at master -->  --- # 🎉 LocalAI 4.0.0 Release! 🚀  <h1 align="center">   <br>   <img height="300" src="https://raw.githubusercontent.com/mudler/LocalAI/refs/heads/master/core/http/static/logo.png">   <br>   <br> </h1>  LocalAI 4.0.0 is out!  This major release transforms LocalAI into a complete AI orchestration platform. We’ve embedded agentic and hybrid search capabilities directly into the core, completely ov |
| `v3.12.1` | 2026-02-21 | Low | <!-- Release notes generated using configuration in .github/release.yml at master -->  This is a patch release to tag the new llama.cpp version which fixes incompatibilities with Qwen 3 coder.  ## What's Changed ### Other Changes * docs: :arrow_up: update docs version mudler/LocalAI by @localai-bot in https://github.com/mudler/LocalAI/pull/8611 * feat(traces): Add backend traces by @richiejp in https://github.com/mudler/LocalAI/pull/8609 * chore: :arrow_up: Update ggml-org/llama.cpp to ` |

## Dependency audit

- **Score**: 0/100
- **Total deps**: 69
- **Resolved**: 0
- **Unresolved**: 69
- **License conflicts**: 0
- **Warnings**: 69
- **Scanned**: 2026-05-04

## Citation

- HTML: https://www.freshcrate.ai/projects/LocalAI
- Markdown: https://www.freshcrate.ai/projects/LocalAI.md
- Dependencies JSON: https://www.freshcrate.ai/api/projects/LocalAI/deps

_Generated by freshcrate.ai. Indexes github releases for AI-agent ecosystem packages._