Unslothunslothai/unsloth
Fast local fine-tuning and running of LLMsPersonalEnterpriseLocal inferenceWebLibrary / SDK★ 77kApache-2.0commit 7 hours ago81worth
Open-source alternatives to SwarmUI
24 projects in the catalog share a category with SwarmUI (Local inference). They are ranked by how closely their categories, platforms and GitHub topics match, then by worth score. Of these, 6 run with Docker, 18 have a permissive license and 24 had a commit in the last 90 days.
Compare at a glance
| Project | Runs on | Self-host with Docker | License | Stars | Last commit |
|---|---|---|---|---|---|
| SwarmUI (this project) | Web | Not listed | MIT | 4.6k | |
| whisper.cpp | CLI, Library / SDK | Not listed | MIT | 54k | |
| Stability Matrix | Desktop | Not listed | AGPL-3.0 | 8.9k | |
| Mochi Diffusion | Desktop | Not listed | GPL-3.0 | 8k | |
| Unsloth | Web, Library / SDK | Not listed | Apache-2.0 | 77k | |
| Text Generation WebUI | Web, Desktop | Not listed | AGPL-3.0 | 48k | |
| Ollama | Docker / self-host, Desktop, CLI | Yes | MIT | 182k | |
| llama.cpp | CLI, Library / SDK | Not listed | MIT | 130k | |
| LocalAI | Docker / self-host | Yes | MIT | 49k | |
| vLLM | Docker / self-host, Library / SDK | Yes | Apache-2.0 | 93k | |
| MoneyPrinterTurbo | Web, Docker / self-host | Yes | MIT | 128k | |
| PrivateGPT | Docker / self-host | Yes | Apache-2.0 | 58k | |
| SGLang | Docker / self-host, Library / SDK | Yes | Apache-2.0 | 37k | |
| oMLX | Desktop | Not listed | Apache-2.0 | 22k | |
| OpenVINO | Library / SDK | Not listed | Apache-2.0 | 11k | |
| Colibri | CLI | Not listed | Apache-2.0 | 39k | |
| llmfit | CLI | Not listed | MIT | 37k | |
| Applio | Web | Not listed | MIT | 3.8k | |
| Jan | Desktop | Not listed | Custom (read before use) | 45k | |
| AirLLM | Library / SDK | Not listed | Apache-2.0 | 35k | |
| RVC WebUI | Web | Not listed | MIT | 39k | |
| llamafile | CLI | Not listed | Custom (read before use) | 26k | |
| RunAnywhere SDKs | Mobile, Library / SDK | Not listed | Custom (read before use) | 10k | |
| GPT-SoVITS | Web | Not listed | MIT | 62k | |
| exo | CLI | Not listed | Apache-2.0 | 48k |
Web apps (6)
Text Generation WebUIoobabooga/textgen
Desktop app for running local LLMsPersonalChat UIsLocal inferenceWebDesktop★ 48kAGPL-3.0commit 2 months ago69worth
MoneyPrinterTurboharry0703/MoneyPrinterTurbo
Generate short videos from a topic with AIPersonalAI & LLM toolingMedia & photosWebDocker / self-host★ 128kMITcommit 5 hours ago85worth
ApplioIAHispano/Applio
Simple voice conversion toolPersonalAI & LLM toolingMedia & photosWeb★ 3.8kMITcommit 4 days ago76worth
RVC WebUIRVC-Project/Retrieval-based-Voice-Conversion-WebUI
Train voice conversion models with little dataPersonalAI & LLM toolingMedia & photosWeb★ 39kMITcommit 2 months ago72worth
GPT-SoVITSRVC-Boss/GPT-SoVITS
Few-shot voice cloning and text-to-speechPersonalAI & LLM toolingMedia & photosWeb★ 62kMITcommit 2 months ago69worth
Self-hosted Docker apps (5)
Ollamaollama/ollama
Run open-weight LLMs locally with one commandPersonalEnterpriseLocal inferenceDocker / self-hostDesktopCLI★ 182kMITcommit 14 hours ago90worth
LocalAImudler/LocalAI
Drop-in OpenAI API replacement that runs locallyPersonalEnterpriseLocal inferenceDocker / self-host★ 49kMITcommit 10 hours ago86worth
vLLMvllm-project/vllm
High-throughput LLM serving engineEnterpriseLocal inferenceDocker / self-hostLibrary / SDK★ 93kApache-2.0commit 7 hours ago86worth
PrivateGPTzylon-ai/private-gpt
Private AI API over local modelsEnterpriseLocal inferenceRAG & vector DBsDocker / self-host★ 58kApache-2.0commit 2 weeks ago83worth
SGLangsgl-project/sglang
Fast serving framework for LLMsEnterpriseLocal inferenceDocker / self-hostLibrary / SDK★ 37kApache-2.0commit 6 hours ago81worth
Desktop apps (4)
Stability MatrixLykosAI/StabilityMatrix
Package manager for Stable Diffusion UIsPersonalLocal inferenceMedia & photosDesktop★ 8.9kAGPL-3.0commit 2 days ago72worth
Mochi DiffusionMochiDiffusion/MochiDiffusion
Stable Diffusion on MacPersonalLocal inferenceMedia & photosDesktop★ 8kGPL-3.0commit 3 days ago68worth
oMLXjundot/omlx
LLM server for Apple SiliconPersonalLocal inferenceDesktop★ 22kApache-2.0commit 23 hours ago80worth
Janjanhq/jan
Offline ChatGPT alternative that runs on your computerPersonalChat UIsLocal inferenceDesktop★ 45kcommit yesterday73worth
Mobile apps (1)
RunAnywhere SDKsRunanywhereAI/runanywhere-sdks
Run AI locally on devicesPersonalEnterpriseLocal inferenceMobileLibrary / SDK★ 10kcommit last week70worth
Command-line tools (6)
whisper.cppggml-org/whisper.cpp
Whisper speech recognition in C/C++PersonalEnterpriseLocal inferenceMedia & photosCLILibrary / SDK★ 54kMITcommit 19 hours ago79worth
llama.cppggml-org/llama.cpp
LLM inference in C/C++ on CPUs and GPUsPersonalLocal inferenceCLILibrary / SDK★ 130kMITcommit 8 hours ago86worth
ColibriJustVugg/colibri
Run large MoE models on everyday hardwarePersonalLocal inferenceCLI★ 39kApache-2.0commit last week79worth
llmfitAlexsJones/llmfit
Find which LLMs run on your hardwarePersonalLocal inferenceCLI★ 37kMITcommit 11 hours ago79worth
llamafilemozilla-ai/llamafile
Run an LLM from a single filePersonalLocal inferenceCLI★ 26kcommit 3 days ago71worth
exoexo-explore/exo
Run frontier AI models across your own devicesPersonalLocal inferenceCLI★ 48kApache-2.0commit last month67worth
Libraries & SDKs (2)
OpenVINOopenvinotoolkit/openvino
Optimize and deploy AI inferenceEnterpriseLocal inferenceLibrary / SDK★ 11kApache-2.0commit 16 hours ago80worth
AirLLMlyogavin/airllm
Run 70B models on a 4GB GPUPersonalLocal inferenceLibrary / SDK★ 35kApache-2.0commit 2 days ago73worth