Best open-source local LLM command-line tools for enterprise

Open-source runtimes for running LLMs on your own hardware.

Filters · 3 Enterprise, Local inference, CLI

For

Personal8Enterprise2

Purpose

AI & LLM tooling37Agents & frameworks12Local inference2RAG & vector DBs5Coding assistants15Evals & observability3Agent skills3MCP servers9Developer tools50Web frameworks3Databases & backends3API tools2Self-hosted apps5Notes & docs4Automation9Data & analytics4Infra & DevOps30Security & identity21Communication0Media & photos3Design & creative0

Runs on

Web1Docker / self-host5Desktop1Mobile1CLI2Library / SDK8Extension / plugin0

License

Permissive2Copyleft0Source-available0Other / custom0

More

Has live demo0Commit in last 90 days2

2 projects

SortWorth scoreTrendingMost starsRecently updatedNewest in catalog

O

Ollamaollama/ollama

Run open-weight LLMs locally with one commandPersonalEnterpriseLocal inferenceDocker / self-hostDesktopCLI★ 182kMITcommit 20 hours ago

90worth

☆ Save

w

whisper.cppggml-org/whisper.cpp

Whisper speech recognition in C/C++PersonalEnterpriseLocal inferenceMedia & photosCLILibrary / SDK★ 54kMITcommit yesterday

79worth

☆ Save