Best open-source LLM eval command-line tools for personal use

Open-source tools for testing, evaluating and tracing LLM applications.

Filters · 3 Personal, Evals & observability, CLI

For

Personal 3Enterprise 3

Purpose

AI & LLM tooling 94Agents & frameworks 31Local inference 8RAG & vector DBs 7Coding assistants 42Evals & observability 3Agent skills 10MCP servers 22Developer tools 106Web frameworks 6Databases & backends 6Editors & IDEs 6API tools 3Self-hosted apps 19Notes & docs 9Automation 13Data & analytics 8Infra & DevOps 24Security & identity 25Communication 2Media & photos 9Design & creative 3

Runs on

Web 0Docker / self-host 3Desktop 0Mobile 0CLI 3Library / SDK 5Extension / plugin 1

License

Permissive 3Copyleft 0Source-available 0Other / custom 0

More

Has live demo 0Commit in last 90 days 3

3 projects

SortWorth scoreTrendingMost starsRecently updatedNewest in catalog

i

iFixAiifixai-ai/iFixAi

Independent auditing of AI agentsPersonalEnterpriseEvals & observabilityCLI★ 20kApache-2.0commit 2 days ago

77worth

☆ Save

g

garakNVIDIA/garak

LLM vulnerability scannerPersonalEnterpriseEvals & observabilitySecurity & identityCLI★ 9.4kApache-2.0commit 2 days ago

77worth

☆ Save

o

ouroborosQ00/ouroboros

Agent OS and specification runtime for AI coding workflowsPersonalMCP serversCoding assistantsEvals & observabilityCLIExtension / plugin★ 6.2kMITcommit 24 hours ago

75worth

☆ Save