DS4
Local inference engine for DeepSeek 4 Flash and PRO — run on Metal, CUDA and ROCm
Overview
Requirements
Recommended VPS
Hostinger · KVM 4
4 vCPU · 16384 MB · 200 GB
Hostinger · KVM 4
4 vCPU · 16384 MB · 200 GB
Hostinger · KVM 8
8 vCPU · 32256 MB · 400 GB
Affiliate disclosure
Docker Compose
# Generated by Run This Ai — docker-compose.yml
services:
ds4:
image: arraying/ds4:latest
restart: unless-stopped
ports:
- 8080:8080
volumes:
- ./data/ds4:/data
Related tools
NextChat
Cross-platform ChatGPT web UI with multi-model support for Ollama, Claude, Gemini, and more
Lobe Chat
Extensible, open-source ChatGPT alternative with plugins, knowledge base, and multi-LLM support
Open WebUI
User-friendly WebUI for LLMs (Ollama, OpenAI API)
text-generation-webui
Run local LLMs with a powerful web interface — text, vision, tool-calling, and OpenAI-compatible API
Streamlit
Build and share data apps in pure Python — fast
Gradio
Build and share delightful machine learning apps in Python
Guides & articles
DS4 with Docker: Step-by-Step Installation Tutorial for DeepSeek 4
Learn how to deploy DS4 in Docker in ten minutes: start the arraying/ds4 container, download DeepSeek 4 Flash weights automatically, and query an OpenAI-compatible local API with curl.
DS4: Complete Guide to Running DeepSeek 4 Flash and PRO Locally
DS4 is a local inference engine for DeepSeek 4 Flash and PRO by antirez — the Redis creator. It runs on Metal, CUDA and ROCm for fully private, offline LLM inference on your own hardware.