LMDeploy
Efficient LLM deployment with TurboMind/PyTorch engines
Überblick
Anforderungen
Empfohlener VPS
Hostinger · KVM 2
2 vCPU · 8192 MB · 100 GB
Hostinger · KVM 2
2 vCPU · 8192 MB · 100 GB
Hostinger · KVM 4
4 vCPU · 16384 MB · 200 GB
Affiliate-Hinweis
Docker Compose
# Generated by Run This Ai — docker-compose.yml
services:
lmdeploy:
image: openmmlm/lmdeploy:latest
restart: unless-stopped
ports:
- 8080:8080
volumes:
- ./data/lmdeploy:/data
LMDeploy: install
LMDeploy
Efficient LLM deployment with TurboMind/PyTorch engines
Prerequisites
- Docker installed (version 24.0+)
- Docker Compose (version 2.20+)
- At least 1GB RAM (2GB recommended)
Quick start with Docker
# Pull the image
docker pull openmmlm/lmdeploy:latest
# Run the container
docker run -d --name lmdeploy -p 8080:8080 openmmlm/lmdeploy:latestKey features
- Self-hosted and open source
- Docker-based deployment
- License: Apache-2.0
- Repository: https://github.com/InternLM/lmdeploy
- Docker image:
openmmlm/lmdeploy:latest
LMDeploy: overview
LMDeploy
Efficient LLM deployment with TurboMind/PyTorch engines
Key features
- Self-hosted and open source
- Docker-based deployment
- License: Apache-2.0
- Repository: https://github.com/InternLM/lmdeploy
- Docker image:
openmmlm/lmdeploy:latest
What it's good for
LMDeploy runs entirely on your own infrastructure — your data never leaves your server.
Verwandte Tools
NextChat
Cross-platform ChatGPT web UI with multi-model support for Ollama, Claude, Gemini, and more
Lobe Chat
Extensible, open-source ChatGPT alternative with plugins, knowledge base, and multi-LLM support
Open WebUI
User-friendly WebUI for LLMs (Ollama, OpenAI API)
text-generation-webui
Run local LLMs with a powerful web interface — text, vision, tool-calling, and OpenAI-compatible API
Streamlit
Build and share data apps in pure Python — fast
Gradio
Build and share delightful machine learning apps in Python