MLflowmlflow/mlflow
Open-source AI engineering platformEnterpriseEvals & observabilityDocker / self-hostLibrary / SDK★ 28kApache-2.0commit 11 hours ago83worth
Open-source alternatives to Helicone
24 projects in the catalog share a category with Helicone (Evals & observability). They are ranked by how closely their categories, platforms and GitHub topics match, then by worth score. Of these, 18 run with Docker, 18 have a permissive license and 24 had a commit in the last 90 days.
Compare at a glance
| Project | Runs on | Self-host with Docker | License | Stars | Last commit |
|---|---|---|---|---|---|
| Helicone (this project) | Docker / self-host | Yes | Apache-2.0 | 6.2k | |
| MLflow | Docker / self-host, Library / SDK | Yes | Apache-2.0 | 28k | |
| Langfuse | Web, Docker / self-host | Yes | Custom (read before use) | 35k | |
| Opik | Docker / self-host, Library / SDK | Yes | Apache-2.0 | 22k | |
| Phoenix | Docker / self-host, Library / SDK | Yes | Custom (read before use) | 12k | |
| SigNoz | Docker / self-host | Yes | Custom (read before use) | 32k | |
| Sentry | Docker / self-host | Yes | Custom (read before use) | 45k | |
| promptfoo | CLI, Library / SDK | Not listed | MIT | 26k | |
| garak | CLI | Not listed | Apache-2.0 | 9.4k | |
| DeepEval | Library / SDK | Not listed | Apache-2.0 | 19k | |
| iFixAi | CLI | Not listed | Apache-2.0 | 19k | |
| Giskard | Library / SDK | Not listed | Apache-2.0 | 5.9k | |
| SkillOpt | Library / SDK | Not listed | MIT | 18k | |
| Ollama | Docker / self-host, Desktop, CLI | Yes | MIT | 182k | |
| OpenClaw | Docker / self-host, Desktop, CLI | Yes | MIT | 391k | |
| Paperclip | Web, Docker / self-host | Yes | MIT | 96k | |
| Crawl4AI | Docker / self-host, Library / SDK | Yes | Apache-2.0 | 85k | |
| RAGFlow | Docker / self-host | Yes | Apache-2.0 | 92k | |
| nanobot | Web, Docker / self-host, CLI | Yes | MIT | 49k | |
| New API | Docker / self-host | Yes | AGPL-3.0 | 49k | |
| LocalAI | Docker / self-host | Yes | MIT | 49k | |
| vLLM | Docker / self-host, Library / SDK | Yes | Apache-2.0 | 93k | |
| Hermes Agent | Docker / self-host, CLI | Yes | MIT | 251k | |
| QwenPaw | Docker / self-host, Desktop | Yes | Apache-2.0 | 35k | |
| LightRAG | Docker / self-host, Library / SDK | Yes | MIT | 40k |
Self-hosted Docker apps (18)
Langfuselangfuse/langfuse
LLM engineering platform: tracing, evals and prompt managementEnterpriseEvals & observabilityWebDocker / self-host★ 35kcommit 17 hours ago81worth
Opikcomet-ml/opik
Debug, evaluate and monitor LLM appsPersonalEnterpriseEvals & observabilityDocker / self-hostLibrary / SDK★ 22kApache-2.0commit 22 hours ago80worth
PhoenixArize-ai/phoenix
AI observability and evaluationPersonalEnterpriseEvals & observabilityDocker / self-hostLibrary / SDK★ 12kcommit 14 hours ago77worth
SigNozSigNoz/signoz
OpenTelemetry-native observabilityEnterpriseEvals & observabilityInfra & DevOpsDocker / self-host★ 32kcommit yesterday76worth
Sentrygetsentry/sentry
Error tracking and performance monitoringEnterpriseDeveloper toolsEvals & observabilityDocker / self-host★ 45kcommit 13 hours ago75worth
Ollamaollama/ollama
Run open-weight LLMs locally with one commandPersonalEnterpriseLocal inferenceDocker / self-hostDesktopCLI★ 182kMITcommit 19 hours ago90worth
OpenClawopenclaw/openclaw
Personal AI assistant that acts on your behalf across appsPersonalEnterpriseAgents & frameworksDocker / self-hostDesktopCLI★ 391kMITcommit 11 hours ago90worth
Paperclippaperclipai/paperclip
Manage teams of AI agents at workEnterpriseAgents & frameworksWebDocker / self-host★ 96kMITcommit 11 hours ago89worth
Crawl4AIunclecode/crawl4ai
Web crawler that turns sites into LLM-ready MarkdownPersonalEnterpriseRAG & vector DBsDocker / self-hostLibrary / SDK★ 85kApache-2.0commit last week88worth
RAGFlowinfiniflow/ragflow
RAG engine built on deep document understandingEnterpriseRAG & vector DBsDocker / self-host★ 92kApache-2.0commit 23 hours ago87worth
nanobotHKUDS/nanobot
Ultra-light self-hosted personal AI agentPersonalAgents & frameworksWebDocker / self-hostCLI★ 49kMITcommit 21 hours ago87worth
New APIQuantumNous/new-api
Unified AI model gatewayEnterpriseAI & LLM toolingDocker / self-host★ 49kAGPL-3.0commit 2 days ago87worth
LocalAImudler/LocalAI
Drop-in OpenAI API replacement that runs locallyPersonalEnterpriseLocal inferenceDocker / self-host★ 49kMITcommit 16 hours ago86worth
vLLMvllm-project/vllm
High-throughput LLM serving engineEnterpriseLocal inferenceDocker / self-hostLibrary / SDK★ 93kApache-2.0commit 12 hours ago86worth
Hermes AgentNousResearch/hermes-agent
Self-improving personal agent from Nous ResearchPersonalEnterpriseAgents & frameworksDocker / self-hostCLI★ 251kMITcommit 11 hours ago86worth
QwenPawagentscope-ai/QwenPaw
Personal AI assistant you can self-hostPersonalAgents & frameworksDocker / self-hostDesktop★ 35kApache-2.0commit 3 days ago86worth
LightRAGHKUDS/LightRAG
Simple and fast graph-based RAGPersonalEnterpriseRAG & vector DBsDocker / self-hostLibrary / SDK★ 40kMITcommit last week86worth
Command-line tools (3)
promptfoopromptfoo/promptfoo
Test and red-team LLM appsEnterpriseEvals & observabilityCLILibrary / SDK★ 26kMITcommit 14 hours ago85worth
garakNVIDIA/garak
LLM vulnerability scannerPersonalEnterpriseEvals & observabilitySecurity & identityCLI★ 9.4kApache-2.0commit 20 hours ago77worth
iFixAiifixai-ai/iFixAi
Independent auditing of AI agentsPersonalEnterpriseEvals & observabilityCLI★ 19kApache-2.0commit 19 hours ago76worth
Libraries & SDKs (3)
DeepEvalconfident-ai/deepeval
The LLM evaluation frameworkPersonalEnterpriseEvals & observabilityLibrary / SDK★ 19kApache-2.0commit 22 hours ago76worth
GiskardGiskard-AI/giskard-oss
Evaluation and testing for LLM agentsPersonalEnterpriseEvals & observabilitySecurity & identityLibrary / SDK★ 5.9kApache-2.0commit yesterday75worth
SkillOptmicrosoft/SkillOpt
Optimizer that trains reusable agent skillsPersonalEnterpriseAgent skillsEvals & observabilityLibrary / SDK★ 18kMITcommit 3 days ago74worth