Opik

comet-ml/opik

Debug, evaluate and monitor LLM apps

PersonalEnterpriseEvals & observabilityDocker / self-hostLibrary / SDKPermissive
comet.com
Preview of Opik
Preview of Opik at comet.com

About

Tracing, automated evaluations and production dashboards.

From the repository: “Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards.”

MLflowOpen-source AI engineering platformDocker / self-hostLibrary / SDK83
PhoenixAI observability and evaluationDocker / self-hostLibrary / SDK77
promptfooTest and red-team LLM appsCLILibrary / SDK85
LangfuseLLM engineering platform: tracing, evals and prompt managementWebDocker / self-host81

Topics