# PrivateGPT

> Private AI API over local models

An API layer for private AI apps with RAG, tools, MCP and text-to-SQL, running on local or OpenAI-compatible models.

- Source: https://github.com/zylon-ai/private-gpt
- Homepage: https://www.zylon.ai/private-gpt
- License: Apache-2.0
- Language: Python
- Stars: 57558
- Forks: 7623
- Contributors: 109
- Last commit: 2026-09-21
- Latest release: v1.0.1 (2026-06-18)
- Purpose: AI & LLM tooling, Local inference, RAG & vector DBs
- Runs on: Docker / self-host
- For: Enterprise

## Worth score: 83/100

How much DigGitHub recommends it, from activity, adoption, docs, license and security signals.

- Popularity: 24/25
- Momentum: 10/20
- Maintenance: 21/25
- Community: 13/15
- Readiness: 15/15

## Alternatives

- [Ollama](https://diggithub.com/ollama/ollama.md): Run open-weight LLMs locally with one command
- [Crawl4AI](https://diggithub.com/unclecode/crawl4ai.md): Web crawler that turns sites into LLM-ready Markdown
- [RAGFlow](https://diggithub.com/infiniflow/ragflow.md): RAG engine built on deep document understanding
- [LocalAI](https://diggithub.com/mudler/LocalAI.md): Drop-in OpenAI API replacement that runs locally
- [vLLM](https://diggithub.com/vllm-project/vllm.md): High-throughput LLM serving engine
- [LightRAG](https://diggithub.com/HKUDS/LightRAG.md): Simple and fast graph-based RAG
- [SGLang](https://diggithub.com/sgl-project/sglang.md): Fast serving framework for LLMs
- [WeKnora](https://diggithub.com/Tencent/WeKnora.md): LLM knowledge platform

---

Source page: https://diggithub.com/zylon-ai/private-gpt
Updated: 2026-10-04