Apache Spark
apache/sparkUnified engine for large-scale data
EnterpriseData & analyticsLibrary / SDKPermissive
About
Distributed processing for SQL, streaming, machine learning and graphs.
From the repository: “Apache Spark - A unified analytics engine for large-scale data processing”
Alternatives
All alternatives →scikit-learnMachine learning in PythonLibrary / SDK85
ScrapyFast, high-level web crawling framework for PythonLibrary / SDK85
CCXTUnified API for 100+ crypto exchangesLibrary / SDK85
PrefectWorkflow orchestration for PythonDocker / self-hostLibrary / SDK85