Unsloth

unslothai/unsloth

Fast local fine-tuning and running of LLMs

PersonalEnterpriseLocal inferenceWebLibrary / SDKPermissive
unsloth.ai
Preview of Unsloth
Preview of Unsloth at unsloth.ai

About

Fine-tune and run open models faster with less memory, now with a local UI. Supports GGUF, MLX and many model families.

From the repository: “Local UI to run and train LLMs and diffusion models. Supports GGUF, MLX, Qwen3.8, DeepSeek-V4, MiniMax-H3, Gemma 4, FLUX and more.”

llama.cppLLM inference in C/C++ on CPUs and GPUsCLILibrary / SDK86
vLLMHigh-throughput LLM serving engineDocker / self-hostLibrary / SDK86
SGLangFast serving framework for LLMsDocker / self-hostLibrary / SDK81
OpenVINOOptimize and deploy AI inferenceLibrary / SDK80

Topics