Best open-source local LLM runners for the web

Open-source runtimes for running LLMs on your own hardware.

Filters · 2 Local inference, Web

For

Personal3Enterprise1

Purpose

AI & LLM tooling46Chat UIs10Agents & frameworks19Local inference3RAG & vector DBs5Coding assistants6Evals & observability1Agent skills1MCP servers1Developer tools26Web frameworks9Databases & backends5Editors & IDEs1API tools1Self-hosted apps25Notes & docs9Automation7Data & analytics12Infra & DevOps6Security & identity7Communication8Media & photos15Design & creative16

Runs on

Web3Docker / self-host5Desktop6Mobile1CLI8Library / SDK10Extension / plugin0

License

Permissive2Copyleft1Source-available0Other / custom0

More

Has live demo0Commit in last 90 days3

3 projects

SortWorth scoreTrendingMost starsRecently updatedNewest in catalog

U

Unslothunslothai/unsloth

Fast local fine-tuning and running of LLMsPersonalEnterpriseLocal inferenceWebLibrary / SDK★ 77kApache-2.0commit 20 hours ago

81worth

☆ Save

T

Text Generation WebUIoobabooga/textgen

Desktop app for running local LLMsPersonalChat UIsLocal inferenceWebDesktop★ 48kAGPL-3.0commit 2 months ago

69worth

☆ Save

S

SwarmUImcmonkeyprojects/SwarmUI

Modular Stable Diffusion web UIPersonalLocal inferenceMedia & photosWeb★ 4.6kMITcommit 2 days ago

64worth

☆ Save

Narrow down

For

Personal · 3Enterprise · 1