promptfoopromptfoo/promptfoo
Test and red-team LLM appsEnterpriseEvals & observabilityCLILibrary / SDK★ 26kMITcommit 18 hours ago85worth
Best open-source LLM eval libraries & SDKs
Open-source tools for testing, evaluating and tracing LLM applications.
7 projects
MLflowmlflow/mlflow
Open-source AI engineering platformEnterpriseEvals & observabilityDocker / self-hostLibrary / SDK★ 28kApache-2.0commit 13 hours ago83worth
Opikcomet-ml/opik
Debug, evaluate and monitor LLM appsPersonalEnterpriseEvals & observabilityDocker / self-hostLibrary / SDK★ 22kApache-2.0commit 2 days ago80worth
PhoenixArize-ai/phoenix
AI observability and evaluationPersonalEnterpriseEvals & observabilityDocker / self-hostLibrary / SDK★ 12kcommit 2 days ago77worth
DeepEvalconfident-ai/deepeval
The LLM evaluation frameworkPersonalEnterpriseEvals & observabilityLibrary / SDK★ 19kApache-2.0commit 2 days ago76worth
GiskardGiskard-AI/giskard-oss
Evaluation and testing for LLM agentsPersonalEnterpriseEvals & observabilitySecurity & identityLibrary / SDK★ 5.9kApache-2.0commit 2 days ago75worth
SkillOptmicrosoft/SkillOpt
Optimizer that trains reusable agent skillsPersonalEnterpriseAgent skillsEvals & observabilityLibrary / SDK★ 18kMITcommit 4 days ago74worth