Pathway
pathwaycom/pathwayPython ETL for streaming, analytics and live RAG
PersonalEnterpriseRAG & vector DBsData & analyticsLibrary / SDKOther / custom
About
A Python framework with a Rust engine for real-time data pipelines, stream processing and LLM apps.
From the repository: “Python ETL framework for stream processing, real-time analytics, LLM pipelines, and RAG.”
Alternatives
All alternatives →CocoIndexIncremental data engine for agentsLibrary / SDK77
Crawl4AIWeb crawler that turns sites into LLM-ready MarkdownDocker / self-hostLibrary / SDK88
MarkItDownConvert Office files and PDFs to Markdown for LLMsCLILibrary / SDK87
DoclingGet your documents ready for generative AICLILibrary / SDK87