Best open-source AI & LLM tooling for Docker

Open-source AI and LLM tools: chat interfaces, agent frameworks, local model runners, RAG pipelines, coding assistants and evaluation suites.

Filters · 2 AI & LLM tooling, Docker / self-host

For

Personal 65Enterprise 70

Purpose

AI & LLM tooling 91Chat UIs 12Agents & frameworks 44Local inference 5RAG & vector DBs 23Coding assistants 4Evals & observability 7Agent skills 1MCP servers 12Developer tools 66Web frameworks 17Databases & backends 31Editors & IDEs 1API tools 7Git hosting 5Self-hosted apps 91Notes & docs 13Automation 33Data & analytics 29Infra & DevOps 58Security & identity 29Communication 18Media & photos 21Design & creative 3

Runs on

Web 54Docker / self-host 91Desktop 42Mobile 5CLI 99Library / SDK 140Extension / plugin 22

License

Permissive 63Copyleft 12Source-available 0Other / custom 16

More

Has live demo 4Commit in last 90 days 90

91 projects · showing 81–91

SortWorth scoreTrendingMost starsRecently updatedNewest in catalog

W

WhisperLiveKitQuentinFuxa/WhisperLiveKit

Real-time local speech-to-textPersonalEnterpriseAI & LLM toolingMedia & photosDocker / self-hostLibrary / SDK★ 11kApache-2.0commit last month

73worth

☆ Save

a

arcadedbArcadeData/arcadedb

Multi-model DBMS supporting graph, document, vector, and SQLPersonalEnterpriseDatabases & backendsMCP serversRAG & vector DBsWeb★ 1.2kApache-2.0commit 17 hours ago

73worth

☆ Save

V

VaneItzCrazyKns/Vane

AI-powered answering enginePersonalChat UIsRAG & vector DBsDocker / self-host★ 37kMITcommit last month

71worth

☆ Save

S

Screenshot to Codeabi/screenshot-to-code

Turn screenshots into HTML, Tailwind, React or VuePersonalCoding assistantsDesign & creativeWebDocker / self-host★ 80kMITcommit 2 months ago

70worth

☆ Save

f

firecrawl-mcp-serverfirecrawl/firecrawl-mcp-server

MCP server for web scraping, crawling, and search with FirecrawlPersonalEnterpriseAI & LLM toolingMCP serversDocker / self-hostCLI★ 7.5kMITcommit 2 days agolive demo

68worth

☆ Save

H

HeliconeHelicone/helicone

Open-source LLM observabilityPersonalEnterpriseEvals & observabilityDocker / self-host★ 6.2kApache-2.0commit 3 weeks ago

68worth

☆ Save

T

TrendRadarsansan0/TrendRadar

AI-driven public opinion monitor and multi-platform trend aggregatorPersonalAI & LLM toolingMCP serversData & analyticsWebDocker / self-host★ 63kGPL-3.0commit 3 weeks agolive demo

67worth

☆ Save

F

Fish Speechfishaudio/fish-speech

State-of-the-art open TTSPersonalEnterpriseAI & LLM toolingMedia & photosDocker / self-hostLibrary / SDK★ 33kcommit 3 weeks ago

65worth

☆ Save

D

DeepWiki OpenAsyncFuncAI/deepwiki-open

AI wiki generator for repositoriesPersonalEnterpriseNotes & docsCoding assistantsWebDocker / self-host★ 18kMITcommit last month

65worth

☆ Save

L

Leonleon-ai/leon

Open-source personal assistantPersonalAgents & frameworksDocker / self-host★ 18kMITcommit yesterday

64worth

☆ Save

P

Pathway LLM Apppathwaycom/llm-app

Ready-to-run templates for live RAG and enterprise searchEnterpriseRAG & vector DBsDocker / self-host★ 59kMITcommit 3 months ago

57worth

☆ Save

Narrow down

For

Personal · 65Enterprise · 70