vLLM Omni System Requirements (CPU, RAM, Disk)
System requirements for vLLM Omni: CPU, RAM, and disk space.
vLLM Omni extends the vLLM inference engine to omni-modality models, enabling efficient serving of text, image, and audio generation and diffusion models with unified interfaces, high throughput, and low latency.
Requirements · vLLM Omni
Min vCPU
2
Min RAM
4,096 MB
Min Disk
10 GB
Rec vCPU
4
Rec RAM
8,192 MB
Rec Disk
20 GB
See the full tool page: vLLM Omni →