SGLang
High-performance serving framework for LLMs with RadixAttention
Überblick
Anforderungen
Empfohlener VPS
Hostinger · KVM 2
2 vCPU · 8192 MB · 100 GB
Hostinger · KVM 2
2 vCPU · 8192 MB · 100 GB
Hostinger · KVM 4
4 vCPU · 16384 MB · 200 GB
Affiliate-Hinweis
Docker Compose
# Generated by Run This Ai — docker-compose.yml
services:
sglang:
image: lmsysorg/sglang:latest
restart: unless-stopped
ports:
- 8080:8080
volumes:
- ./data/sglang:/data
SGLang: install
SGLang
High-performance serving framework for LLMs with RadixAttention
Prerequisites
- Docker installed (version 24.0+)
- Docker Compose (version 2.20+)
- At least 1GB RAM (2GB recommended)
Quick start with Docker
# Pull the image
docker pull lmsysorg/sglang:latest
# Run the container
docker run -d --name sglang -p 8080:8080 lmsysorg/sglang:latestKey features
- Self-hosted and open source
- Docker-based deployment
- License: Apache-2.0
- Repository: https://github.com/sgl-project/sglang
- Docker image:
lmsysorg/sglang:latest
SGLang: overview
SGLang
High-performance serving framework for LLMs with RadixAttention
Key features
- Self-hosted and open source
- Docker-based deployment
- License: Apache-2.0
- Repository: https://github.com/sgl-project/sglang
- Docker image:
lmsysorg/sglang:latest
What it's good for
SGLang runs entirely on your own infrastructure — your data never leaves your server.
Verwandte Tools
NextChat
Cross-platform ChatGPT web UI with multi-model support for Ollama, Claude, Gemini, and more
Lobe Chat
Extensible, open-source ChatGPT alternative with plugins, knowledge base, and multi-LLM support
Open WebUI
User-friendly WebUI for LLMs (Ollama, OpenAI API)
text-generation-webui
Run local LLMs with a powerful web interface — text, vision, tool-calling, and OpenAI-compatible API
Streamlit
Build and share data apps in pure Python — fast
Gradio
Build and share delightful machine learning apps in Python