Opikcomet-ml/opik
Debug, evaluate and monitor LLM appsPersonalEnterpriseEvals & observabilityDocker / self-hostLibrary / SDK★ 22kApache-2.0commit 2 days ago80worth
Best open-source LLM eval & observability tools for personal use
Open-source tools for testing, evaluating and tracing LLM applications.
9 projects
iFixAiifixai-ai/iFixAi
Independent auditing of AI agentsPersonalEnterpriseEvals & observabilityCLI★ 20kApache-2.0commit 2 days ago77worth
PhoenixArize-ai/phoenix
AI observability and evaluationPersonalEnterpriseEvals & observabilityDocker / self-hostLibrary / SDK★ 12kcommit 2 days ago77worth
garakNVIDIA/garak
LLM vulnerability scannerPersonalEnterpriseEvals & observabilitySecurity & identityCLI★ 9.4kApache-2.0commit 2 days ago77worth
DeepEvalconfident-ai/deepeval
The LLM evaluation frameworkPersonalEnterpriseEvals & observabilityLibrary / SDK★ 19kApache-2.0commit 2 days ago76worth
ouroborosQ00/ouroboros
Agent OS and specification runtime for AI coding workflowsPersonalMCP serversCoding assistantsEvals & observabilityCLIExtension / plugin★ 6.2kMITcommit yesterday75worth
GiskardGiskard-AI/giskard-oss
Evaluation and testing for LLM agentsPersonalEnterpriseEvals & observabilitySecurity & identityLibrary / SDK★ 5.9kApache-2.0commit 3 days ago75worth
SkillOptmicrosoft/SkillOpt
Optimizer that trains reusable agent skillsPersonalEnterpriseAgent skillsEvals & observabilityLibrary / SDK★ 18kMITcommit 4 days ago74worth
HeliconeHelicone/helicone
Open-source LLM observabilityPersonalEnterpriseEvals & observabilityDocker / self-host★ 6.2kApache-2.0commit 3 weeks ago68worth