exo

exo-explore/exo

Run frontier AI models across your own devices

PersonalLocal inferenceCLIPermissive
github.com
Preview of exo
Preview of exo

About

Pools the memory and compute of several home devices into one cluster to run large models locally.

From the repository: “Run frontier AI locally.”

OllamaRun open-weight LLMs locally with one commandDocker / self-hostDesktop90
llama.cppLLM inference in C/C++ on CPUs and GPUsCLILibrary / SDK86
whisper.cppWhisper speech recognition in C/C++CLILibrary / SDK79
ColibriRun large MoE models on everyday hardwareCLI79