PrivateGPT
zylon-ai/private-gptPrivate AI API over local models
EnterpriseLocal inferenceRAG & vector DBsDocker / self-hostPermissive
About
An API layer for private AI apps with RAG, tools, MCP and text-to-SQL, running on local or OpenAI-compatible models.
From the repository: “Complete API layer for private AI applications on local models: RAG, skills, tools, MCP, text-to-sql, and more. Works with any OpenAI-compatible inference server.”
Alternatives
All alternatives →OllamaRun open-weight LLMs locally with one commandDocker / self-hostDesktop90
Crawl4AIWeb crawler that turns sites into LLM-ready MarkdownDocker / self-hostLibrary / SDK88
RAGFlowRAG engine built on deep document understandingDocker / self-host87
LocalAIDrop-in OpenAI API replacement that runs locallyDocker / self-host86