Best open-source LLM eval & observability tools for Docker, personal use

Open-source tools for testing, evaluating and tracing LLM applications.

Filters · 3 Personal, Evals & observability, Docker / self-host

For

Personal3Enterprise7

Purpose

AI & LLM tooling59Chat UIs11Agents & frameworks33Local inference2RAG & vector DBs11Coding assistants4Evals & observability3Agent skills1MCP servers5Developer tools30Web frameworks9Databases & backends15Editors & IDEs1API tools1Self-hosted apps74Notes & docs11Automation15Data & analytics10Infra & DevOps22Security & identity15Communication11Media & photos20Design & creative3

Runs on

Web0Docker / self-host3Desktop0Mobile0CLI2Library / SDK5Extension / plugin0

License

Permissive2Copyleft0Source-available0Other / custom1

More

Has live demo0Commit in last 90 days3

3 projects

SortWorth scoreTrendingMost starsRecently updatedNewest in catalog

O

Opikcomet-ml/opik

Debug, evaluate and monitor LLM appsPersonalEnterpriseEvals & observabilityDocker / self-hostLibrary / SDK★ 22kApache-2.0commit yesterday

80worth

☆ Save

P

PhoenixArize-ai/phoenix

AI observability and evaluationPersonalEnterpriseEvals & observabilityDocker / self-hostLibrary / SDK★ 12kcommit 24 hours ago

77worth

☆ Save

H

HeliconeHelicone/helicone

Open-source LLM observabilityPersonalEnterpriseEvals & observabilityDocker / self-host★ 6.2kApache-2.0commit 2 weeks ago

68worth

☆ Save