Best open-source local LLM runners for the web, enterprise

Open-source runtimes for running LLMs on your own hardware.

Filters · 3 Enterprise, Local inference, Web

For

Personal3Enterprise1

Purpose

AI & LLM tooling20Chat UIs3Agents & frameworks12Local inference1RAG & vector DBs2Coding assistants2Evals & observability1Agent skills0MCP servers0Developer tools20Web frameworks9Databases & backends5Editors & IDEs1API tools1Git hosting2Self-hosted apps17Notes & docs4Automation7Data & analytics9Infra & DevOps5Security & identity3Communication6Media & photos0Design & creative5

Runs on

Web1Docker / self-host5Desktop1Mobile1CLI2Library / SDK8Extension / plugin0

License

Permissive1Copyleft0Source-available0Other / custom0

More

Has live demo0Commit in last 90 days1

1 project

SortWorth scoreTrendingMost starsRecently updatedNewest in catalog

U

Unslothunslothai/unsloth

Fast local fine-tuning and running of LLMsPersonalEnterpriseLocal inferenceWebLibrary / SDK★ 77kApache-2.0commit yesterday

81worth

☆ Save