ds4

antirez/ds4

Local DeepSeek 4 inference engine

PersonalLocal inferenceCLIPermissive
github.com
Preview of ds4
Preview of ds4

About

antirez's engine to run DeepSeek 4 models on Metal, CUDA and ROCm.

From the repository: “DeepSeek 4 Flash and PRO local inference engine for Metal, CUDA and ROCm”

OllamaRun open-weight LLMs locally with one commandDocker / self-hostDesktop90
llama.cppLLM inference in C/C++ on CPUs and GPUsCLILibrary / SDK86
ColibriRun large MoE models on everyday hardwareCLI79
llmfitFind which LLMs run on your hardwareCLI79