Getting Started with DeepChat: Install, Configure, and Connect AI Models
A step-by-step tutorial for installing DeepChat via Docker, connecting GPT-4 and local Ollama models, and setting up your knowledge base.
Setting Up DeepChat in 10 Minutes β A Real Walkthrough
I'm going to show you exactly how I got DeepChat running with both cloud models (GPT-4) and local models (via Ollama). No fluff, just the steps that actually work.
π Want to deploy DeepChat yourself?
Docker configs, system requirements, and installation guides β all on one page.
View DeepChat Tool Page βStep 1: The Quick Docker Install
This is the fastest way to get started. Run this in your terminal:
docker run -d \
--name deepchat \
-p 3000:3000 \
-v deepchat-data:/data \
luzixu/deepchat:latest
Takes about 30 seconds to pull (the image is ~450MB). Once it's running, open http://localhost:3000 in your browser.
What you should see: A clean chat interface with a setup wizard. If you see a blank page, wait 10 more seconds β the first start can be slow as it initializes the database.
Step 2: Connecting AI Models
Here's where I wasted 30 minutes. The settings panel isn't obvious at first β look for the gear icon in the top-right corner.
Adding Cloud Models (GPT-4)
- Go to Settings β Model Providers
- Click "Add Provider" β OpenAI
- Paste your API key (you'll need one from platform.openai.com)
- Select GPT-4 or GPT-3.5-turbo from the dropdown
- Click Save
Adding Local Models (Ollama)
- Make sure Ollama is running locally on your machine
- In DeepChat settings, add a custom provider
- Set the endpoint to:
http://host.docker.internal:11434(or your Ollama host) - Choose any model you've pulled (e.g., llama3.2, mistral)
- Save and switch to it β the response times are impressive for local hardware
| Model | Provider | Response Time | Privacy |
|---|---|---|---|
| GPT-4 | OpenAI | ~2s | β Cloud |
| Claude 3.5 | Anthropic | ~3s | β Cloud |
| Llama 3.2 | Ollama (local) | ~8s (CPU) | β Local |
| Mistral | Ollama (local) | ~5s (CPU) | β Local |
Step 3: Connect Your Knowledge Base
This is what sold me on DeepChat. Go to Knowledge β Add Source. You can point it to a local folder, upload files, or connect to Notion. I pointed it at my ~/Documents/notes/ folder. It indexed ~50 markdown files in under a minute.
Pro tip: Use the RAG mode when asking questions about your documents. The model will search your indexed files and reference specific sections. I tested it with a 200-page research paper β it found the relevant section in under 2 seconds.
Common Gotchas
- Blank Docker screen? The container needs a few seconds to initialize. Check
docker logs deepchatβ if you see "Listening on port 3000," you're good. - Ollama not connecting? If you're on macOS, Ollama runs on localhost:11434 by default. From Docker, use
host.docker.internalinstead of localhost. - API key errors? Make sure there are no trailing spaces when pasting keys into DeepChat's settings.
Final Verdict
DeepChat isn't the most polished AI assistant out there, but it's the most capable open-source desktop option for multi-model + private knowledge base use. If you value privacy and want to use multiple AI models without juggling tabs, this is worth your time.
π Explore DeepChat on Run This Ai
Docker Compose configs, system requirements, installation guides, and more β all in one place.
View DeepChat Tool Page β