Best open-source local LLM runners for desktop

Open-source runtimes for running LLMs on your own hardware.

Filters · 2 Local inference, Desktop

For

Personal6Enterprise1

Purpose

AI & LLM tooling41Chat UIs9Agents & frameworks9Local inference6RAG & vector DBs2Coding assistants15Agent skills1MCP servers1Developer tools53Web frameworks1Databases & backends3Editors & IDEs6API tools3Self-hosted apps22Notes & docs15Automation3Data & analytics2Infra & DevOps3Security & identity13Communication9Media & photos40Design & creative16

Runs on

Web3Docker / self-host5Desktop6Mobile1CLI8Library / SDK10Extension / plugin0

License

Permissive2Copyleft3Source-available0Other / custom1

More

Has live demo0Commit in last 90 days6

6 projects

SortWorth scoreTrendingMost starsRecently updatedNewest in catalog

O

Ollamaollama/ollama

Run open-weight LLMs locally with one commandPersonalEnterpriseLocal inferenceDocker / self-hostDesktopCLI★ 182kMITcommit 13 hours ago

90worth

☆ Save

o

oMLXjundot/omlx

LLM server for Apple SiliconPersonalLocal inferenceDesktop★ 22kApache-2.0commit 22 hours ago

80worth

☆ Save

J

Janjanhq/jan

Offline ChatGPT alternative that runs on your computerPersonalChat UIsLocal inferenceDesktop★ 45kcommit yesterday

73worth

☆ Save

S

Stability MatrixLykosAI/StabilityMatrix

Package manager for Stable Diffusion UIsPersonalLocal inferenceMedia & photosDesktop★ 8.9kAGPL-3.0commit 2 days ago

72worth

☆ Save

T

Text Generation WebUIoobabooga/textgen

Desktop app for running local LLMsPersonalChat UIsLocal inferenceWebDesktop★ 48kAGPL-3.0commit 2 months ago

69worth

☆ Save

M

Mochi DiffusionMochiDiffusion/MochiDiffusion

Stable Diffusion on MacPersonalLocal inferenceMedia & photosDesktop★ 8kGPL-3.0commit 3 days ago

68worth

☆ Save

Narrow down

For

Personal · 6Enterprise · 1