# oMLX

> LLM server for Apple Silicon

Continuous batching and SSD caching, managed from the menu bar.

- Source: https://github.com/jundot/omlx
- Homepage: https://omlx.ai
- License: Apache-2.0
- Language: Python
- Stars: 22472
- Forks: 1962
- Contributors: 282
- Last commit: 2026-10-02
- Latest release: v0.7.0 (2026-09-30)
- Purpose: AI & LLM tooling, Local inference
- Runs on: Desktop
- For: Personal

## Worth score: 80/100

How much DigGitHub recommends it, from activity, adoption, docs, license and security signals.

- Popularity: 22/25
- Momentum: 10/20
- Maintenance: 25/25
- Community: 12/15
- Readiness: 11/15

## Alternatives

- [Ollama](https://diggithub.com/ollama/ollama.md): Run open-weight LLMs locally with one command
- [Jan](https://diggithub.com/janhq/jan.md): Offline ChatGPT alternative that runs on your computer
- [Stability Matrix](https://diggithub.com/LykosAI/StabilityMatrix.md): Package manager for Stable Diffusion UIs
- [Text Generation WebUI](https://diggithub.com/oobabooga/textgen.md): Desktop app for running local LLMs
- [Mochi Diffusion](https://diggithub.com/MochiDiffusion/MochiDiffusion.md): Stable Diffusion on Mac
- [llama.cpp](https://diggithub.com/ggml-org/llama.cpp.md): LLM inference in C/C++ on CPUs and GPUs
- [LocalAI](https://diggithub.com/mudler/LocalAI.md): Drop-in OpenAI API replacement that runs locally
- [vLLM](https://diggithub.com/vllm-project/vllm.md): High-throughput LLM serving engine

---

Source page: https://diggithub.com/jundot/omlx
Updated: 2026-10-03