How to Install LiteLLM on Ubuntu 24.04
Install LiteLLM on Ubuntu 24.04 with Docker Compose.
LiteLLM is an open source AI Gateway that gives you a single, unified interface to call 100+ LLM providers — OpenAI, Anthropic, Gemini, Bedrock, Azure, and more — using the OpenAI format. Use it as a Python SDK for direct library integration, or deploy the AI Gateway (Proxy Server) as a centralized service with cost tracking, guardrails, load balancing, and logging.
Requirements · LiteLLM
See the full tool page: LiteLLM →