DeepEval

confident-ai/deepeval

The LLM evaluation framework

PersonalEnterpriseEvals & observabilityLibrary / SDKPermissive
deepeval.com
Preview of DeepEval
Preview of DeepEval at deepeval.com

About

Unit-test LLM outputs with many ready-made metrics.

From the repository: “The LLM Evaluation Framework”

promptfooTest and red-team LLM appsCLILibrary / SDK85
MLflowOpen-source AI engineering platformDocker / self-hostLibrary / SDK83
OpikDebug, evaluate and monitor LLM appsDocker / self-hostLibrary / SDK80
PhoenixAI observability and evaluationDocker / self-hostLibrary / SDK77

Topics