Best open-source LLM eval command-line tools for enterprise

Open-source tools for testing, evaluating and tracing LLM applications.

Filters · 3 Enterprise, Evals & observability, CLI

For

Personal 3Enterprise 3

Purpose

AI & LLM tooling 42Agents & frameworks 14Local inference 2RAG & vector DBs 6Coding assistants 15Evals & observability 3Agent skills 3MCP servers 14Developer tools 56Web frameworks 4Databases & backends 5API tools 3Self-hosted apps 7Notes & docs 5Automation 11Data & analytics 4Infra & DevOps 33Security & identity 23Communication 1Media & photos 3Design & creative 0

Runs on

Web 1Docker / self-host 7Desktop 0Mobile 0CLI 3Library / SDK 7Extension / plugin 0

License

Permissive 3Copyleft 0Source-available 0Other / custom 0

More

Has live demo 0Commit in last 90 days 3

3 projects

SortWorth scoreTrendingMost starsRecently updatedNewest in catalog

p

promptfoopromptfoo/promptfoo

Test and red-team LLM appsEnterpriseEvals & observabilityCLILibrary / SDK★ 26kMITcommit 18 hours ago

85worth

☆ Save

i

iFixAiifixai-ai/iFixAi

Independent auditing of AI agentsPersonalEnterpriseEvals & observabilityCLI★ 20kApache-2.0commit 2 days ago

77worth

☆ Save

g

garakNVIDIA/garak

LLM vulnerability scannerPersonalEnterpriseEvals & observabilitySecurity & identityCLI★ 9.4kApache-2.0commit 2 days ago

77worth

☆ Save