Best open-source AI & LLM tooling for desktop, personal use

Open-source AI and LLM tools: chat interfaces, agent frameworks, local model runners, RAG pipelines, coding assistants and evaluation suites.

Filters · 3 Personal, AI & LLM tooling, Desktop

For

Personal 42Enterprise 5

Purpose

AI & LLM tooling 42Chat UIs 9Agents & frameworks 9Local inference 6RAG & vector DBs 2Coding assistants 15Agent skills 1MCP servers 2Developer tools 53Web frameworks 1Databases & backends 3Editors & IDEs 6API tools 3Self-hosted apps 25Notes & docs 15Automation 4Data & analytics 2Infra & DevOps 3Security & identity 13Communication 7Media & photos 42Design & creative 17

Runs on

Web 50Docker / self-host 65Desktop 42Mobile 5CLI 94Library / SDK 121Extension / plugin 22

License

Permissive 23Copyleft 11Source-available 0Other / custom 8

More

Has live demo 1Commit in last 90 days 42

42 projects · showing 41–42

SortWorth scoreTrendingMost starsRecently updatedNewest in catalog

L

LLM Wikinashsu/llm_wiki

Turn documents into an interlinked knowledge basePersonalNotes & docsRAG & vector DBsDesktop★ 20kcommit 7 days ago

68worth

☆ Save

M

Mochi DiffusionMochiDiffusion/MochiDiffusion

Stable Diffusion on MacPersonalLocal inferenceMedia & photosDesktop★ 8kGPL-3.0commit 4 days ago

68worth

☆ Save