LiteLLM
BerriAI/litellmAI gateway for 100+ LLM APIs
EnterpriseAI & LLM toolingDocker / self-hostLibrary / SDKOther / custom
About
Call many LLM providers through one OpenAI-style API with cost tracking, rate limits, fallbacks and guardrails.
From the repository: “The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]”
Alternatives
All alternatives →Crawl4AIWeb crawler that turns sites into LLM-ready MarkdownDocker / self-hostLibrary / SDK88
vLLMHigh-throughput LLM serving engineDocker / self-hostLibrary / SDK86
LightRAGSimple and fast graph-based RAGDocker / self-hostLibrary / SDK86
gpt-researcherAutonomous deep research agent for web and local documentsWebDocker / self-host85