How to Install Envoy AI Gateway on Ubuntu 24.04
Install Envoy AI Gateway on Ubuntu 24.04 with Docker Compose.
Envoy AI Gateway is an open-source, CNCF-hosted gateway that gives you unified access to generative AI services. Built on Envoy Gateway, it lets you route requests to any LLM provider — OpenAI, Anthropic, AWS Bedrock, or self-hosted models — through a single consistent interface. It provides enterprise features like token-based rate limiting, cost control, observability, and centralized policy management, while keeping your vendor lock-in to zero. Deploy it on Kubernetes or run it standalone in Docker to manage, secure, and monitor all your AI traffic from one place.
Requirements · Envoy AI Gateway
See the full tool page: Envoy AI Gateway →