vLLM

Anforderungen

Empfohlener VPS

Affiliate-Hinweis

Docker Compose

# Generated by Run This Ai — docker-compose.yml
services:
  vllm:
    image: vllm/vllm-openai:latest
    restart: unless-stopped
    ports:
      - 8080:8080
    volumes:
      - ./data/vllm:/data

Bester VPS für vLLM →

vLLM — Overview