OpenVINO
openvinotoolkit/openvinoOptimize and deploy AI inference
EnterpriseLocal inferenceLibrary / SDKPermissive
About
Intel's toolkit for fast inference on CPUs, GPUs and NPUs.
From the repository: “OpenVINO™ is an open source toolkit for optimizing and deploying AI inference”
Alternatives
All alternatives →RunAnywhere SDKsRun AI locally on devicesMobileLibrary / SDK70
ncnnNeural network inference for mobileLibrary / SDK66
UnslothFast local fine-tuning and running of LLMsWebLibrary / SDK81
vLLMHigh-throughput LLM serving engineDocker / self-hostLibrary / SDK86