Best open-source local LLM runners for the web, personal use

Open-source runtimes for running LLMs on your own hardware.

Filters · 3 Personal, Local inference, Web

For

Personal3Enterprise1

Purpose

AI & LLM tooling42Chat UIs10Agents & frameworks17Local inference3RAG & vector DBs5Coding assistants6Agent skills1MCP servers1Developer tools21Web frameworks4Databases & backends5Editors & IDEs1API tools1Self-hosted apps21Notes & docs8Automation3Data & analytics7Infra & DevOps5Security & identity7Communication6Media & photos15Design & creative16

Runs on

Web3Docker / self-host2Desktop6Mobile1CLI8Library / SDK7Extension / plugin0

License

Permissive2Copyleft1Source-available0Other / custom0

More

Has live demo0Commit in last 90 days3

3 projects

SortWorth scoreTrendingMost starsRecently updatedNewest in catalog

U

Unslothunslothai/unsloth

Fast local fine-tuning and running of LLMsPersonalEnterpriseLocal inferenceWebLibrary / SDK★ 77kApache-2.0commit 7 hours ago

81worth

☆ Save

T

Text Generation WebUIoobabooga/textgen

Desktop app for running local LLMsPersonalChat UIsLocal inferenceWebDesktop★ 48kAGPL-3.0commit 2 months ago

69worth

☆ Save

S

SwarmUImcmonkeyprojects/SwarmUI

Modular Stable Diffusion web UIPersonalLocal inferenceMedia & photosWeb★ 4.6kMITcommit 2 days ago

64worth

☆ Save