GPUStack
GPU-Cluster verwalten, KI-Modelle mit vLLM und SGLang bereitstellen und auf Abruf SSH-zugängliche GPU-Instanzen erhalten.
Überblick
Anforderungen
Empfohlener VPS
Hostinger · KVM 4
4 vCPU · 16384 MB · 200 GB
Hostinger · KVM 4
4 vCPU · 16384 MB · 200 GB
Hostinger · KVM 8
8 vCPU · 32256 MB · 400 GB
Affiliate-Hinweis
Docker Compose
# Generated by Run This Ai — docker-compose.yml
services:
gpustack:
image: gpustack/gpustack:latest
restart: unless-stopped
ports:
- 8080:8080
volumes:
- ./data/gpustack:/data
Verwandte Tools
NextChat
Cross-platform ChatGPT web UI with multi-model support for Ollama, Claude, Gemini, and more
Lobe Chat
Extensible, open-source ChatGPT alternative with plugins, knowledge base, and multi-LLM support
Open WebUI
User-friendly WebUI for LLMs (Ollama, OpenAI API)
text-generation-webui
Run local LLMs with a powerful web interface — text, vision, tool-calling, and OpenAI-compatible API
Streamlit
Build and share data apps in pure Python — fast
Gradio
Build and share delightful machine learning apps in Python
Anleitungen & Artikel
How to Deploy GPUStack with Docker: Step-by-Step Setup Tutorial
From docker-compose to your first served model — run GPUStack on one machine or a cluster of GPU nodes in under 15 minutes.
GPUStack: Open-Source GPU Cluster Management for High-Performance AI Serving
GPUStack pools every GPU across your machines into one cluster for serving vLLM and SGLang models — plus on-demand SSH-accessible GPU instances for training.