Ollama
Run large language models locally
Overview
Ollama lets you run LLMs like Llama 3, Mistral, and Phi locally with a simple API and CLI.
Requirements
Min vCPU
2
Min RAM
4096 MB
Min Disk
20 GB
Rec vCPU
4
Rec RAM
8192 MB
Rec Disk
40 GB
Recommended VPS
Contabo · VPS S
4 vCPU · 8192 MB · 100 GB
Contabo · VPS S
4 vCPU · 8192 MB · 100 GB
Contabo · VPS S
4 vCPU · 8192 MB · 100 GB
Affiliate disclosure
Docker Compose
# Generated by Run This Ai — docker-compose.yml
services:
ollama:
image: ollama/ollama:latest
restart: unless-stopped
ports:
- 8080:8080
volumes:
- ./data/ollama:/data