vLLM

vllm-project/vllm

High-throughput LLM serving engine

Enterprise Local inference Docker / self-host Library / SDKPermissive

Website ↗GitHub ↗Docs ↗Alternatives →

About

A fast inference and serving engine for LLMs built around PagedAttention and continuous batching. It is the standard choice for serving open models at scale on GPUs.

From the repository: “A high-throughput and memory-efficient inference and serving engine for LLMs”

Alternatives

All alternatives →

SGLangFast serving framework for LLMsDocker / self-hostLibrary / SDK81

OllamaRun open-weight LLMs locally with one commandDocker / self-hostDesktop90

llama.cppLLM inference in C/C++ on CPUs and GPUsCLILibrary / SDK86

LocalAIDrop-in OpenAI API replacement that runs locallyDocker / self-host86

Topics

gpt llm pytorch model-serving transformer llm-serving inference llama amd cuda tpu deepseek qwen blackwell deepseek-v3 gpt-oss kimi moe openai qwen3

Worth score

86top 5% of catalog

Popularity25/25

Momentum10/20

Maintenance25/25

Community15/15

Readiness11/15

Momentum is estimated (striped) until 90 days of star history exist.

Add a badge to your README

Put this in your README. It links back to this page, and the score updates every day.

Worth score badge (Markdown)

[![DigGitHub worth](https://diggithub.com/-/badge/vllm-project/vllm.svg)](https://diggithub.com/vllm-project/vllm)

Featured badge, no score (Markdown)

[![Featured on DigGitHub](https://diggithub.com/-/badge/vllm-project/vllm/featured.svg)](https://diggithub.com/vllm-project/vllm)

Need a small one for a row of badges? Add ?style=flat after .svg.

Enterprise readiness

–SSO (SAML / OIDC)
–Role-based access control
–Audit log
–Helm chart / Kubernetes docs
✓Security policy (SECURITY.md)
–Commercial support available

✓ means an editor confirmed it in the docs or repo. – means not yet verified.Evaluate for your company Beta

Listed

In catalog since: last week
Data refreshed: 15 hours ago

Suggest a correction