LocalAI
mudler/LocalAIDrop-in OpenAI API replacement that runs locally
PersonalEnterpriseLocal inferenceDocker / self-hostPermissive
About
A self-hosted server that exposes OpenAI-compatible endpoints for text, images, audio and embeddings, backed by local models. It runs on CPUs and GPUs.
From the repository: “LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.”
Alternatives
All alternatives →OllamaRun open-weight LLMs locally with one commandDocker / self-hostDesktop90
vLLMHigh-throughput LLM serving engineDocker / self-hostLibrary / SDK86
PrivateGPTPrivate AI API over local modelsDocker / self-host83
SGLangFast serving framework for LLMsDocker / self-hostLibrary / SDK81