Crawl4AIunclecode/crawl4ai
Web crawler that turns sites into LLM-ready MarkdownPersonalEnterpriseRAG & vector DBsDocker / self-hostLibrary / SDK★ 85kApache-2.0commit last week88worth
Best open-source RAG tools & vector databases for personal use
Open-source retrieval-augmented generation engines and vector databases.
33 projects · showing 1–20
MarkItDownmicrosoft/markitdown
Convert Office files and PDFs to Markdown for LLMsPersonalEnterpriseRAG & vector DBsCLILibrary / SDK★ 188kMITcommit 5 hours ago87worth
Doclingdocling-project/docling
Get your documents ready for generative AIPersonalEnterpriseRAG & vector DBsCLILibrary / SDK★ 68kMITcommit 16 hours ago87worth
LightRAGHKUDS/LightRAG
Simple and fast graph-based RAGPersonalEnterpriseRAG & vector DBsDocker / self-hostLibrary / SDK★ 40kMITcommit 7 days ago86worth
OpenVikingvolcengine/OpenViking
Context database for AI agentsPersonalEnterpriseRAG & vector DBsLibrary / SDK★ 39kAGPL-3.0commit 13 hours ago86worth
Difylanggenius/dify
Build, run and monitor LLM apps and agent workflowsPersonalEnterpriseAgents & frameworksRAG & vector DBsWebDocker / self-host★ 158kcommit 5 hours agolive demo85worth
Open Notebooklfnovo/open-notebook
Open-source NotebookLM alternativePersonalNotes & docsRAG & vector DBsWebDocker / self-host★ 40kMITcommit 5 hours ago85worth
Cogneetopoteretes/cognee
Open-source memory platform for agentsPersonalEnterpriseRAG & vector DBsLibrary / SDK★ 31kApache-2.0commit 2 days ago85worth
gpt-researcherassafelovic/gpt-researcher
Autonomous deep research agent for web and local documentsPersonalAgent skillsAgents & frameworksMCP serversRAG & vector DBsWeb★ 30kApache-2.0commit 7 days ago85worth
AnythingLLMMintplex-Labs/anything-llm
Chat with your documents using any LLMPersonalEnterpriseChat UIsRAG & vector DBsDocker / self-hostDesktop★ 67kMITcommit 11 hours ago84worth
Faissfacebookresearch/faiss
Efficient similarity search for vectorsPersonalEnterpriseRAG & vector DBsLibrary / SDK★ 41kMITcommit 6 hours ago79worth
OpenDataLoader PDFopendataloader-project/opendataloader-pdf
PDF parser for AI-ready dataPersonalEnterpriseRAG & vector DBsLibrary / SDK★ 29kApache-2.0commit 2 days ago79worth
UnstructuredUnstructured-IO/unstructured
Convert documents to structured dataPersonalEnterpriseRAG & vector DBsLibrary / SDK★ 16kApache-2.0commit 10 hours ago79worth
PaddleOCRPaddlePaddle/PaddleOCR
OCR toolkit that turns documents into structured dataPersonalEnterpriseRAG & vector DBsLibrary / SDK★ 91kApache-2.0commit 2 weeks ago78worth
MinerUopendatalab/MinerU
Convert PDFs and Office docs to LLM-ready MarkdownPersonalEnterpriseRAG & vector DBsCLILibrary / SDK★ 81kcommit 4 days ago78worth
Local Deep ResearchLearningCircuit/local-deep-research
Deep research with local or cloud LLMsPersonalAgents & frameworksRAG & vector DBsDocker / self-host★ 9.1kMITcommit 10 hours ago78worth
Firecrawlfirecrawl/firecrawl
Web data API that turns sites into LLM-ready dataPersonalEnterpriseRAG & vector DBsWebDocker / self-hostLibrary / SDK★ 188kAGPL-3.0commit 7 hours ago77worth
Markerdatalab-to/marker
Convert PDFs to Markdown and JSON with high accuracyPersonalEnterpriseRAG & vector DBsCLILibrary / SDK★ 40kApache-2.0commit 21 hours ago77worth
Chromachroma-core/chroma
Open-source embedding database for AI appsPersonalEnterpriseDatabases & backendsRAG & vector DBsDocker / self-hostLibrary / SDK★ 29kApache-2.0commit 15 hours ago77worth
CocoIndexcocoindex-io/cocoindex
Incremental data engine for agentsPersonalEnterpriseRAG & vector DBsData & analyticsLibrary / SDK★ 12kApache-2.0commit 23 hours ago77worth