LightRAGHKUDS/LightRAG
Simple and fast graph-based RAGPersonalEnterpriseRAG & vector DBsDocker / self-hostLibrary / SDK★ 40kMITcommit last week86worth
Open-source alternatives to Crawl4AI
24 projects in the catalog are in the same category as Crawl4AI: RAG & vector DBs. They are ranked by how closely their categories, platforms and GitHub topics match, then by worth score. Of these, 14 run with Docker, 19 have a permissive license and 24 had a commit in the last 90 days.
Compare at a glance
| Project | Runs on | Self-host with Docker | License | Stars | Last commit |
|---|---|---|---|---|---|
| Crawl4AI (this project) | Docker / self-host, Library / SDK | Yes | Apache-2.0 | 85k | |
| LightRAG | Docker / self-host, Library / SDK | Yes | MIT | 40k | |
| gpt-researcher | Web, Docker / self-host, Library / SDK | Yes | Apache-2.0 | 30k | |
| Chroma | Docker / self-host, Library / SDK | Yes | Apache-2.0 | 29k | |
| Firecrawl | Web, Docker / self-host, Library / SDK | Yes | AGPL-3.0 | 188k | |
| RAGFlow | Docker / self-host | Yes | Apache-2.0 | 92k | |
| MarkItDown | CLI, Library / SDK | Not listed | MIT | 188k | |
| Docling | CLI, Library / SDK | Not listed | MIT | 68k | |
| OpenViking | Library / SDK | Not listed | AGPL-3.0 | 39k | |
| Dify | Web, Docker / self-host | Yes | Custom (read before use) | 158k | |
| LlamaIndex | Library / SDK | Not listed | MIT | 52k | |
| Open Notebook | Web, Docker / self-host | Yes | MIT | 40k | |
| Cognee | Library / SDK | Not listed | Apache-2.0 | 31k | |
| AnythingLLM | Docker / self-host, Desktop | Yes | MIT | 67k | |
| PrivateGPT | Docker / self-host | Yes | Apache-2.0 | 58k | |
| Milvus | Docker / self-host | Yes | Apache-2.0 | 46k | |
| GraphRAG | Library / SDK | Not listed | MIT | 36k | |
| Qdrant | Docker / self-host | Yes | Apache-2.0 | 35k | |
| WeKnora | Docker / self-host | Yes | Custom (read before use) | 32k | |
| Haystack | Library / SDK | Not listed | Apache-2.0 | 27k | |
| MaxKB | Docker / self-host | Yes | GPL-3.0 | 23k | |
| LangChain4j | Library / SDK | Not listed | Apache-2.0 | 13k | |
| Faiss | Library / SDK | Not listed | MIT | 41k | |
| OpenDataLoader PDF | Library / SDK | Not listed | Apache-2.0 | 29k | |
| DocsGPT | Docker / self-host | Yes | MIT | 18k |
Self-hosted Docker apps (14)
gpt-researcherassafelovic/gpt-researcher
Autonomous deep research agent for web and local documentsPersonalAgent skillsAgents & frameworksMCP serversRAG & vector DBsWeb★ 30kApache-2.0commit last week85worth
Chromachroma-core/chroma
Open-source embedding database for AI appsPersonalEnterpriseDatabases & backendsRAG & vector DBsDocker / self-hostLibrary / SDK★ 29kApache-2.0commit yesterday77worth
Firecrawlfirecrawl/firecrawl
Web data API that turns sites into LLM-ready dataPersonalEnterpriseRAG & vector DBsWebDocker / self-hostLibrary / SDK★ 188kAGPL-3.0commit 24 hours ago77worth
RAGFlowinfiniflow/ragflow
RAG engine built on deep document understandingEnterpriseRAG & vector DBsDocker / self-host★ 92kApache-2.0commit yesterday87worth
Difylanggenius/dify
Build, run and monitor LLM apps and agent workflowsPersonalEnterpriseAgents & frameworksRAG & vector DBsWebDocker / self-host★ 158kcommit 22 hours agolive demo85worth
Open Notebooklfnovo/open-notebook
Open-source NotebookLM alternativePersonalNotes & docsRAG & vector DBsWebDocker / self-host★ 40kMITcommit 22 hours ago85worth
AnythingLLMMintplex-Labs/anything-llm
Chat with your documents using any LLMPersonalEnterpriseChat UIsRAG & vector DBsDocker / self-hostDesktop★ 67kMITcommit yesterday84worth
PrivateGPTzylon-ai/private-gpt
Private AI API over local modelsEnterpriseLocal inferenceRAG & vector DBsDocker / self-host★ 58kApache-2.0commit 2 weeks ago83worth
Milvusmilvus-io/milvus
Cloud-native vector databaseEnterpriseDatabases & backendsRAG & vector DBsDocker / self-host★ 46kApache-2.0commit 2 days ago83worth
Qdrantqdrant/qdrant
High-performance vector database and search engineEnterpriseDatabases & backendsRAG & vector DBsDocker / self-host★ 35kApache-2.0commit last month82worth
WeKnoraTencent/WeKnora
LLM knowledge platformEnterpriseRAG & vector DBsDocker / self-host★ 32kcommit 4 days ago81worth
MaxKB1Panel-dev/MaxKB
Platform for enterprise agentsEnterpriseAgents & frameworksRAG & vector DBsDocker / self-host★ 23kGPL-3.0commit 6 days ago80worth
DocsGPTarc53/DocsGPT
Private AI platform for agents and searchEnterpriseAgents & frameworksRAG & vector DBsDocker / self-host★ 18kMITcommit yesterday79worth
Libraries & SDKs (10)
MarkItDownmicrosoft/markitdown
Convert Office files and PDFs to Markdown for LLMsPersonalEnterpriseRAG & vector DBsCLILibrary / SDK★ 188kMITcommit 21 hours ago87worth
Doclingdocling-project/docling
Get your documents ready for generative AIPersonalEnterpriseRAG & vector DBsCLILibrary / SDK★ 68kMITcommit yesterday87worth
OpenVikingvolcengine/OpenViking
Context database for AI agentsPersonalEnterpriseRAG & vector DBsLibrary / SDK★ 39kAGPL-3.0commit yesterday86worth
LlamaIndexrun-llama/llama_index
Data framework for LLM applications and agentsEnterpriseAgents & frameworksRAG & vector DBsLibrary / SDK★ 52kMITcommit 2 days ago85worth
Cogneetopoteretes/cognee
Open-source memory platform for agentsPersonalEnterpriseRAG & vector DBsLibrary / SDK★ 31kApache-2.0commit 2 days ago85worth
GraphRAGmicrosoft/graphrag
Graph-based RAG from MicrosoftEnterpriseRAG & vector DBsLibrary / SDK★ 36kMITcommit last week83worth
Haystackdeepset-ai/haystack
AI orchestration for production LLM appsEnterpriseAgents & frameworksRAG & vector DBsLibrary / SDK★ 27kApache-2.0commit yesterday81worth
LangChain4jlangchain4j/langchain4j
LLM apps on the JVMEnterpriseAgents & frameworksRAG & vector DBsLibrary / SDK★ 13kApache-2.0commit yesterday80worth
Faissfacebookresearch/faiss
Efficient similarity search for vectorsPersonalEnterpriseRAG & vector DBsLibrary / SDK★ 41kMITcommit 23 hours ago79worth
OpenDataLoader PDFopendataloader-project/opendataloader-pdf
PDF parser for AI-ready dataPersonalEnterpriseRAG & vector DBsLibrary / SDK★ 29kApache-2.0commit 3 days ago79worth