Crawl4AIunclecode/crawl4ai
Web crawler that turns sites into LLM-ready MarkdownPersonalEnterpriseRAG & vector DBsDocker / self-hostLibrary / SDK★ 85kApache-2.0commit last week88worth
Best open-source RAG libraries & SDKs
Open-source retrieval-augmented generation engines and vector databases.
29 projects · showing 1–20
MarkItDownmicrosoft/markitdown
Convert Office files and PDFs to Markdown for LLMsPersonalEnterpriseRAG & vector DBsCLILibrary / SDK★ 188kMITcommit 9 hours ago87worth
Doclingdocling-project/docling
Get your documents ready for generative AIPersonalEnterpriseRAG & vector DBsCLILibrary / SDK★ 68kMITcommit 20 hours ago87worth
LightRAGHKUDS/LightRAG
Simple and fast graph-based RAGPersonalEnterpriseRAG & vector DBsDocker / self-hostLibrary / SDK★ 40kMITcommit last week86worth
OpenVikingvolcengine/OpenViking
Context database for AI agentsPersonalEnterpriseRAG & vector DBsLibrary / SDK★ 39kAGPL-3.0commit 17 hours ago86worth
LlamaIndexrun-llama/llama_index
Data framework for LLM applications and agentsEnterpriseAgents & frameworksRAG & vector DBsLibrary / SDK★ 52kMITcommit 2 days ago85worth
Cogneetopoteretes/cognee
Open-source memory platform for agentsPersonalEnterpriseRAG & vector DBsLibrary / SDK★ 31kApache-2.0commit 2 days ago85worth
gpt-researcherassafelovic/gpt-researcher
Autonomous deep research agent for web and local documentsPersonalAgent skillsAgents & frameworksMCP serversRAG & vector DBsWeb★ 30kApache-2.0commit 7 days ago85worth
GraphRAGmicrosoft/graphrag
Graph-based RAG from MicrosoftEnterpriseRAG & vector DBsLibrary / SDK★ 36kMITcommit last week83worth
Haystackdeepset-ai/haystack
AI orchestration for production LLM appsEnterpriseAgents & frameworksRAG & vector DBsLibrary / SDK★ 27kApache-2.0commit 20 hours ago81worth
LangChain4jlangchain4j/langchain4j
LLM apps on the JVMEnterpriseAgents & frameworksRAG & vector DBsLibrary / SDK★ 13kApache-2.0commit 23 hours ago80worth
Faissfacebookresearch/faiss
Efficient similarity search for vectorsPersonalEnterpriseRAG & vector DBsLibrary / SDK★ 41kMITcommit 10 hours ago79worth
OpenDataLoader PDFopendataloader-project/opendataloader-pdf
PDF parser for AI-ready dataPersonalEnterpriseRAG & vector DBsLibrary / SDK★ 29kApache-2.0commit 2 days ago79worth
UnstructuredUnstructured-IO/unstructured
Convert documents to structured dataPersonalEnterpriseRAG & vector DBsLibrary / SDK★ 16kApache-2.0commit 14 hours ago79worth
PaddleOCRPaddlePaddle/PaddleOCR
OCR toolkit that turns documents into structured dataPersonalEnterpriseRAG & vector DBsLibrary / SDK★ 91kApache-2.0commit 2 weeks ago78worth
MinerUopendatalab/MinerU
Convert PDFs and Office docs to LLM-ready MarkdownPersonalEnterpriseRAG & vector DBsCLILibrary / SDK★ 81kcommit 4 days ago78worth
Firecrawlfirecrawl/firecrawl
Web data API that turns sites into LLM-ready dataPersonalEnterpriseRAG & vector DBsWebDocker / self-hostLibrary / SDK★ 188kAGPL-3.0commit 11 hours ago77worth
Markerdatalab-to/marker
Convert PDFs to Markdown and JSON with high accuracyPersonalEnterpriseRAG & vector DBsCLILibrary / SDK★ 40kApache-2.0commit yesterday77worth
Chromachroma-core/chroma
Open-source embedding database for AI appsPersonalEnterpriseDatabases & backendsRAG & vector DBsDocker / self-hostLibrary / SDK★ 29kApache-2.0commit 19 hours ago77worth
CocoIndexcocoindex-io/cocoindex
Incremental data engine for agentsPersonalEnterpriseRAG & vector DBsData & analyticsLibrary / SDK★ 12kApache-2.0commit yesterday77worth