# LocalAI

> Drop-in OpenAI API replacement that runs locally

A self-hosted server that exposes OpenAI-compatible endpoints for text, images, audio and embeddings, backed by local models. It runs on CPUs and GPUs.

- Source: https://github.com/mudler/LocalAI
- Homepage: https://localai.io
- License: MIT
- Language: Go
- Stars: 49371
- Forks: 4483
- Contributors: 260
- Last commit: 2026-10-02
- Latest release: v4.11.0 (2026-10-02)
- Purpose: AI & LLM tooling, Local inference
- Runs on: Docker / self-host
- For: Personal, Enterprise

## Worth score: 86/100

How much DigGitHub recommends it, from activity, adoption, docs, license and security signals.

- Popularity: 23/25
- Momentum: 10/20
- Maintenance: 25/25
- Community: 13/15
- Readiness: 15/15

## Alternatives

- [Ollama](https://diggithub.com/ollama/ollama.md): Run open-weight LLMs locally with one command
- [vLLM](https://diggithub.com/vllm-project/vllm.md): High-throughput LLM serving engine
- [PrivateGPT](https://diggithub.com/zylon-ai/private-gpt.md): Private AI API over local models
- [SGLang](https://diggithub.com/sgl-project/sglang.md): Fast serving framework for LLMs
- [llama.cpp](https://diggithub.com/ggml-org/llama.cpp.md): LLM inference in C/C++ on CPUs and GPUs
- [Unsloth](https://diggithub.com/unslothai/unsloth.md): Fast local fine-tuning and running of LLMs
- [oMLX](https://diggithub.com/jundot/omlx.md): LLM server for Apple Silicon
- [OpenVINO](https://diggithub.com/openvinotoolkit/openvino.md): Optimize and deploy AI inference

---

Source page: https://diggithub.com/mudler/LocalAI
Updated: 2026-10-03