Jan
Open-source ChatGPT replacement — run LLMs locally with full control and privacy
Overview
Requirements
Recommended VPS
Hetzner · CX22
2 vCPU · 4096 MB · 40 GB
Hetzner · CX22
2 vCPU · 4096 MB · 40 GB
Hetzner · CX22
2 vCPU · 4096 MB · 40 GB
Affiliate disclosure
Jan — Faq
Jan
Jan is bringing the best of open-source AI in an easy-to-use product. Download and run LLMs with full control and privacy. It supports local AI models (Llama, Gemma, Qwen) from HuggingFace, cloud integrations (OpenAI, Anthropic, Mistral), custom assistants, an OpenAI-compatible local API server, and Model Context Protocol (MCP) integration for agentic capabilities.
Is Jan free to self-host?
Yes — it is open source and runs on your own hardware.
Does Jan need a lot of resources?
A server with 1–2GB RAM is enough for most workloads.
How do I deploy Jan?
Easiest via Docker — see the installation guide for commands.
Where does my data go?
Nowhere — everything is processed locally on your server.
Jan — Alt
Jan
Jan is bringing the best of open-source AI in an easy-to-use product. Download and run LLMs with full control and privacy. It supports local AI models (Llama, Gemma, Qwen) from HuggingFace, cloud integrations (OpenAI, Anthropic, Mistral), custom assistants, an OpenAI-compatible local API server, and Model Context Protocol (MCP) integration for agentic capabilities.
Alternatives to Jan
If Jan isn't quite right, these are common self-hosted alternatives in the same category:
| Tool | Strengths |
|---|---|
| — | Browse the directory for more options |
Jan — Review
Jan
Jan is bringing the best of open-source AI in an easy-to-use product. Download and run LLMs with full control and privacy. It supports local AI models (Llama, Gemma, Qwen) from HuggingFace, cloud integrations (OpenAI, Anthropic, Mistral), custom assistants, an OpenAI-compatible local API server, and Model Context Protocol (MCP) integration for agentic capabilities.
Strengths
- Full self-hosted control over your data
- Straightforward Docker-based deployment
- Open-source license
Weaknesses
- Initial setup requires Docker familiarity
- You are responsible for maintenance and updates
- Resource needs can grow under heavy load
Verdict
Jan is a solid self-hosted choice — its strengths outweigh the usual maintenance overhead.
Jan — Install
Jan
Jan is bringing the best of open-source AI in an easy-to-use product. Download and run LLMs with full control and privacy. It supports local AI models (Llama, Gemma, Qwen) from HuggingFace, cloud integrations (OpenAI, Anthropic, Mistral), custom assistants, an OpenAI-compatible local API server, and Model Context Protocol (MCP) integration for agentic capabilities.
Prerequisites
- Docker installed (version 24.0+)
- Docker Compose (version 2.20+)
- At least 1GB RAM (2GB recommended)
Quick start with Docker
# Pull the image
docker pull owner/image:latest
# Run the container
docker run -d --name jan -p 8080:8080 owner/image:latest
Key features
- Self-hosted and open source
- Docker-based deployment
- License: Apache-2.0
- Repository: https://github.com/janhq/jan
Jan — Overview
Jan
Jan is bringing the best of open-source AI in an easy-to-use product. Download and run LLMs with full control and privacy. It supports local AI models (Llama, Gemma, Qwen) from HuggingFace, cloud integrations (OpenAI, Anthropic, Mistral), custom assistants, an OpenAI-compatible local API server, and Model Context Protocol (MCP) integration for agentic capabilities.
Key features
- Self-hosted and open source
- Docker-based deployment
- License: Apache-2.0
- Repository: https://github.com/janhq/jan
What it's good for
Jan runs entirely on your own infrastructure — your data never leaves your server.
Related tools
Ollama
Run large language models locally
Open WebUI
User-friendly WebUI for LLMs (Ollama, OpenAI API)
llama.cpp
LLM inference in C/C++
SGLang
High-performance serving framework for LLMs with RadixAttention
Llamafile
Distribute and run LLMs as single-file executables — no installation needed
LocalAI
Open-source AI engine — run any model (LLM, vision, voice, image, video) on any hardware, no GPU required