Best open-source LLM eval & observability tools for Docker, enterprise

Open-source tools for testing, evaluating and tracing LLM applications.

Filters · 3 Enterprise, Evals & observability, Docker / self-host

For

Personal3Enterprise7

Purpose

AI & LLM tooling65Chat UIs5Agents & frameworks29Local inference5RAG & vector DBs17Coding assistants3Evals & observability7Agent skills0MCP servers4Developer tools59Web frameworks16Databases & backends30Editors & IDEs1API tools6Git hosting4Self-hosted apps33Notes & docs6Automation23Data & analytics23Infra & DevOps42Security & identity19Communication15Media & photos6Design & creative1

Runs on

Web1Docker / self-host7Desktop0Mobile0CLI3Library / SDK7Extension / plugin0

License

Permissive3Copyleft0Source-available0Other / custom4

More

Has live demo0Commit in last 90 days7

7 projects

SortWorth scoreTrendingMost starsRecently updatedNewest in catalog

M

MLflowmlflow/mlflow

Open-source AI engineering platformEnterpriseEvals & observabilityDocker / self-hostLibrary / SDK★ 28kApache-2.0commit 22 hours ago

83worth

☆ Save

L

Langfuselangfuse/langfuse

LLM engineering platform: tracing, evals and prompt managementEnterpriseEvals & observabilityWebDocker / self-host★ 35kcommit yesterday

81worth

☆ Save

O

Opikcomet-ml/opik

Debug, evaluate and monitor LLM appsPersonalEnterpriseEvals & observabilityDocker / self-hostLibrary / SDK★ 22kApache-2.0commit yesterday

80worth

☆ Save

P

PhoenixArize-ai/phoenix

AI observability and evaluationPersonalEnterpriseEvals & observabilityDocker / self-hostLibrary / SDK★ 12kcommit yesterday

77worth

☆ Save

S

SigNozSigNoz/signoz

OpenTelemetry-native observabilityEnterpriseEvals & observabilityInfra & DevOpsDocker / self-host★ 32kcommit 2 days ago

76worth

☆ Save

S

Sentrygetsentry/sentry

Error tracking and performance monitoringEnterpriseDeveloper toolsEvals & observabilityDocker / self-host★ 45kcommit 23 hours ago

75worth

☆ Save

H

HeliconeHelicone/helicone

Open-source LLM observabilityPersonalEnterpriseEvals & observabilityDocker / self-host★ 6.2kApache-2.0commit 2 weeks ago

68worth

☆ Save