vLLM

Requirements

Recommended VPS

Affiliate disclosure

Docker Compose

# Generated by Run This Ai — docker-compose.yml
services:
  vllm:
    image: vllm/vllm-openai:latest
    restart: unless-stopped
    ports:
      - 8080:8080
    volumes:
      - ./data/vllm:/data

Best VPS for vLLM →

vLLM — Overview