Best open-source LLM eval libraries & SDKs for personal use

Open-source tools for testing, evaluating and tracing LLM applications.

Filters · 3 Personal, Evals & observability, Library / SDK

For

Personal5Enterprise7

Purpose

AI & LLM tooling119Agents & frameworks30Local inference7RAG & vector DBs25Coding assistants4Evals & observability5Agent skills4MCP servers6Developer tools160Web frameworks89Databases & backends14Editors & IDEs3API tools9Self-hosted apps6Notes & docs6Automation17Data & analytics23Infra & DevOps2Security & identity4Communication8Media & photos24Design & creative50

Runs on

Web0Docker / self-host3Desktop0Mobile0CLI2Library / SDK5Extension / plugin0

License

Permissive4Copyleft0Source-available0Other / custom1

More

Has live demo0Commit in last 90 days5

5 projects

SortWorth scoreTrendingMost starsRecently updatedNewest in catalog

O

Opikcomet-ml/opik

Debug, evaluate and monitor LLM appsPersonalEnterpriseEvals & observabilityDocker / self-hostLibrary / SDK★ 22kApache-2.0commit yesterday

80worth

☆ Save

P

PhoenixArize-ai/phoenix

AI observability and evaluationPersonalEnterpriseEvals & observabilityDocker / self-hostLibrary / SDK★ 12kcommit yesterday

77worth

☆ Save

D

DeepEvalconfident-ai/deepeval

The LLM evaluation frameworkPersonalEnterpriseEvals & observabilityLibrary / SDK★ 19kApache-2.0commit yesterday

76worth

☆ Save

G

GiskardGiskard-AI/giskard-oss

Evaluation and testing for LLM agentsPersonalEnterpriseEvals & observabilitySecurity & identityLibrary / SDK★ 5.9kApache-2.0commit 2 days ago

75worth

☆ Save

S

SkillOptmicrosoft/SkillOpt

Optimizer that trains reusable agent skillsPersonalEnterpriseAgent skillsEvals & observabilityLibrary / SDK★ 18kMITcommit 3 days ago

74worth

☆ Save