Best open-source LLM eval & observability tools for Docker

Open-source tools for testing, evaluating and tracing LLM applications.

Filters · 2 Evals & observability, Docker / self-host

For

Personal 3Enterprise 7

Purpose

AI & LLM tooling 91Chat UIs 12Agents & frameworks 44Local inference 5RAG & vector DBs 23Coding assistants 4Evals & observability 7Agent skills 1MCP servers 12Developer tools 66Web frameworks 17Databases & backends 31Editors & IDEs 1API tools 7Git hosting 5Self-hosted apps 91Notes & docs 13Automation 33Data & analytics 29Infra & DevOps 58Security & identity 29Communication 18Media & photos 21Design & creative 3

Runs on

Web 1Docker / self-host 7Desktop 0Mobile 0CLI 4Library / SDK 7Extension / plugin 1

License

Permissive 3Copyleft 0Source-available 0Other / custom 4

More

Has live demo 0Commit in last 90 days 7

7 projects

SortWorth scoreTrendingMost starsRecently updatedNewest in catalog

M

MLflowmlflow/mlflow

Open-source AI engineering platformEnterpriseEvals & observabilityDocker / self-hostLibrary / SDK★ 28kApache-2.0commit 19 hours ago

83worth

☆ Save

L

Langfuselangfuse/langfuse

LLM engineering platform: tracing, evals and prompt managementEnterpriseEvals & observabilityWebDocker / self-host★ 35kcommit 2 days ago

81worth

☆ Save

O

Opikcomet-ml/opik

Debug, evaluate and monitor LLM appsPersonalEnterpriseEvals & observabilityDocker / self-hostLibrary / SDK★ 22kApache-2.0commit 2 days ago

80worth

☆ Save

P

PhoenixArize-ai/phoenix

AI observability and evaluationPersonalEnterpriseEvals & observabilityDocker / self-hostLibrary / SDK★ 12kcommit 2 days ago

77worth

☆ Save

S

SigNozSigNoz/signoz

OpenTelemetry-native observabilityEnterpriseEvals & observabilityInfra & DevOpsDocker / self-host★ 32kcommit 2 days ago

76worth

☆ Save

S

Sentrygetsentry/sentry

Error tracking and performance monitoringEnterpriseDeveloper toolsEvals & observabilityDocker / self-host★ 45kcommit 23 hours ago

75worth

☆ Save

H

HeliconeHelicone/helicone

Open-source LLM observabilityPersonalEnterpriseEvals & observabilityDocker / self-host★ 6.2kApache-2.0commit 3 weeks ago

68worth

☆ Save

Narrow down

For

Personal · 3Enterprise · 7