How to Install vLLM Omni on Ubuntu 24.04
Install vLLM Omni on Ubuntu 24.04 with Docker Compose.
vLLM Omni extends the vLLM inference engine to omni-modality models, enabling efficient serving of text, image, and audio generation and diffusion models with unified interfaces, high throughput, and low latency.
Requirements · vLLM Omni
See the full tool page: vLLM Omni →