Best open-source local LLM runners

Open-source runtimes for running LLMs on your own hardware.

Filters · 1 Local inference

For

Personal 20Enterprise 11

Purpose

AI & LLM tooling 340Chat UIs 22Agents & frameworks 105Local inference 24RAG & vector DBs 49Coding assistants 72Evals & observability 14Agent skills 44MCP servers 36Developer tools 399Web frameworks 123Databases & backends 52Editors & IDEs 21API tools 22Git hosting 5Self-hosted apps 134Notes & docs 45Automation 65Data & analytics 59Infra & DevOps 90Security & identity 71Communication 39Media & photos 97Design & creative 87

Runs on

Web 3Docker / self-host 5Desktop 6Mobile 1CLI 8Library / SDK 10Extension / plugin 0

License

Permissive 17Copyleft 3Source-available 0Other / custom 4

More

Has live demo 0Commit in last 90 days 24

24 projects · showing 21–24

SortWorth scoreTrendingMost starsRecently updatedNewest in catalog

n

ncnnTencent/ncnn

Neural network inference for mobilePersonalEnterpriseLocal inferenceLibrary / SDK★ 24kcommit 3 days ago

66worth

☆ Save

S

SwarmUImcmonkeyprojects/SwarmUI

Modular Stable Diffusion web UIPersonalLocal inferenceMedia & photosWeb★ 4.6kMITcommit 3 days ago

64worth

☆ Save

B

BitNetmicrosoft/BitNet

Inference framework for 1-bit LLMsPersonalEnterpriseLocal inferenceLibrary / SDK★ 40kMITcommit 2 months ago

63worth

☆ Save

d

ds4antirez/ds4

Local DeepSeek 4 inference enginePersonalLocal inferenceCLI★ 23kMITcommit 2 weeks ago

63worth

☆ Save

Narrow down

Runs on

Web · 3Docker / self-host · 5Desktop · 6Mobile · 1CLI · 8Library / SDK · 10

For

Personal · 20Enterprise · 11