promptfoopromptfoo/promptfoo
Test and red-team LLM appsEnterpriseEvals & observabilityCLILibrary / SDK★ 26kMITcommit 17 hours ago85worth
Open-source alternatives to Giskard
24 projects in the catalog share a category with Giskard (Evals & observability). They are ranked by how closely their categories, platforms and GitHub topics match, then by worth score. Of these, 12 run with Docker, 19 have a permissive license and 24 had a commit in the last 90 days.
Compare at a glance
| Project | Runs on | Self-host with Docker | License | Stars | Last commit |
|---|---|---|---|---|---|
| Giskard (this project) | Library / SDK | Not listed | Apache-2.0 | 5.9k | |
| garak | CLI | Not listed | Apache-2.0 | 9.4k | |
| promptfoo | CLI, Library / SDK | Not listed | MIT | 26k | |
| MLflow | Docker / self-host, Library / SDK | Yes | Apache-2.0 | 28k | |
| Opik | Docker / self-host, Library / SDK | Yes | Apache-2.0 | 22k | |
| Phoenix | Docker / self-host, Library / SDK | Yes | Custom (read before use) | 12k | |
| DeepEval | Library / SDK | Not listed | Apache-2.0 | 19k | |
| SkillOpt | Library / SDK | Not listed | MIT | 18k | |
| Langfuse | Web, Docker / self-host | Yes | Custom (read before use) | 35k | |
| SigNoz | Docker / self-host | Yes | Custom (read before use) | 32k | |
| iFixAi | CLI | Not listed | Apache-2.0 | 19k | |
| Sentry | Docker / self-host | Yes | Custom (read before use) | 45k | |
| Helicone | Docker / self-host | Yes | Apache-2.0 | 6.2k | |
| Shannon | Docker / self-host, CLI | Yes | AGPL-3.0 | 49k | |
| Strix | Docker / self-host, CLI | Yes | Apache-2.0 | 66k | |
| NemoClaw | Docker / self-host | Yes | Apache-2.0 | 23k | |
| Browser Use | Library / SDK | Not listed | MIT | 117k | |
| Crawl4AI | Docker / self-host, Library / SDK | Yes | Apache-2.0 | 85k | |
| MarkItDown | CLI, Library / SDK | Not listed | MIT | 188k | |
| Headroom | Library / SDK | Not listed | Apache-2.0 | 74k | |
| Docling | CLI, Library / SDK | Not listed | MIT | 68k | |
| MemPalace | Library / SDK | Not listed | MIT | 59k | |
| llama.cpp | CLI, Library / SDK | Not listed | MIT | 130k | |
| vLLM | Docker / self-host, Library / SDK | Yes | Apache-2.0 | 93k | |
| Transformers | Library / SDK | Not listed | Apache-2.0 | 167k |
Libraries & SDKs (15)
MLflowmlflow/mlflow
Open-source AI engineering platformEnterpriseEvals & observabilityDocker / self-hostLibrary / SDK★ 28kApache-2.0commit 13 hours ago83worth
Opikcomet-ml/opik
Debug, evaluate and monitor LLM appsPersonalEnterpriseEvals & observabilityDocker / self-hostLibrary / SDK★ 22kApache-2.0commit yesterday80worth
PhoenixArize-ai/phoenix
AI observability and evaluationPersonalEnterpriseEvals & observabilityDocker / self-hostLibrary / SDK★ 12kcommit 16 hours ago77worth
DeepEvalconfident-ai/deepeval
The LLM evaluation frameworkPersonalEnterpriseEvals & observabilityLibrary / SDK★ 19kApache-2.0commit yesterday76worth
SkillOptmicrosoft/SkillOpt
Optimizer that trains reusable agent skillsPersonalEnterpriseAgent skillsEvals & observabilityLibrary / SDK★ 18kMITcommit 3 days ago74worth
Browser Usebrowser-use/browser-use
Let AI agents use a web browserPersonalEnterpriseAgents & frameworksAutomationLibrary / SDK★ 117kMITcommit 16 hours ago89worth
Crawl4AIunclecode/crawl4ai
Web crawler that turns sites into LLM-ready MarkdownPersonalEnterpriseRAG & vector DBsDocker / self-hostLibrary / SDK★ 85kApache-2.0commit last week88worth
MarkItDownmicrosoft/markitdown
Convert Office files and PDFs to Markdown for LLMsPersonalEnterpriseRAG & vector DBsCLILibrary / SDK★ 188kMITcommit 14 hours ago87worth
Headroomheadroomlabs-ai/headroom
Compress tool output before it reaches the LLMPersonalEnterpriseCoding assistantsLibrary / SDK★ 74kApache-2.0commit 14 hours ago87worth
Doclingdocling-project/docling
Get your documents ready for generative AIPersonalEnterpriseRAG & vector DBsCLILibrary / SDK★ 68kMITcommit yesterday87worth
MemPalaceMemPalace/mempalace
Open-source AI memory systemPersonalAI & LLM toolingMCP serversLibrary / SDK★ 59kMITcommit 15 hours ago87worth
llama.cppggml-org/llama.cpp
LLM inference in C/C++ on CPUs and GPUsPersonalLocal inferenceCLILibrary / SDK★ 130kMITcommit 16 hours ago86worth
vLLMvllm-project/vllm
High-throughput LLM serving engineEnterpriseLocal inferenceDocker / self-hostLibrary / SDK★ 93kApache-2.0commit 15 hours ago86worth
Transformershuggingface/transformers
Model definitions for state-of-the-art ML modelsPersonalEnterpriseAI & LLM toolingLibrary / SDK★ 167kApache-2.0commit 19 hours ago86worth
Web apps (1)
Langfuselangfuse/langfuse
LLM engineering platform: tracing, evals and prompt managementEnterpriseEvals & observabilityWebDocker / self-host★ 35kcommit 19 hours ago81worth
Self-hosted Docker apps (6)
SigNozSigNoz/signoz
OpenTelemetry-native observabilityEnterpriseEvals & observabilityInfra & DevOpsDocker / self-host★ 32kcommit yesterday76worth
Sentrygetsentry/sentry
Error tracking and performance monitoringEnterpriseDeveloper toolsEvals & observabilityDocker / self-host★ 45kcommit 15 hours ago75worth
HeliconeHelicone/helicone
Open-source LLM observabilityPersonalEnterpriseEvals & observabilityDocker / self-host★ 6.2kApache-2.0commit 2 weeks ago68worth
ShannonKeygraphHQ/shannon
AI pentester for your web apps and APIsEnterpriseAgents & frameworksSecurity & identityDocker / self-hostCLI★ 49kAGPL-3.0commit 3 days ago80worth
Strixusestrix/strix
AI agents that pentest your own appsPersonalEnterpriseAgents & frameworksSecurity & identityDocker / self-hostCLI★ 66kApache-2.0commit yesterday79worth
NemoClawNVIDIA/NemoClaw
Run agents more securely in NVIDIA OpenShellEnterpriseAgents & frameworksSecurity & identityDocker / self-host★ 23kApache-2.0commit 22 hours ago75worth
Command-line tools (2)
garakNVIDIA/garak
LLM vulnerability scannerPersonalEnterpriseEvals & observabilitySecurity & identityCLI★ 9.4kApache-2.0commit 22 hours ago77worth
iFixAiifixai-ai/iFixAi
Independent auditing of AI agentsPersonalEnterpriseEvals & observabilityCLI★ 19kApache-2.0commit 21 hours ago76worth