Llamafile
Distribute and run LLMs as single-file executables — no installation needed
Overview
Llamafile is a groundbreaking Mozilla project that collapses all the complexity of LLMs into a single-file executable. Built on llama.cpp and Cosmopolitan Libc, it lets you run powerful language models on virtually any operating system (macOS, Linux, Windows, FreeBSD) and CPU architecture without any installation or dependencies. Just download, make executable, and run. With 25k+ GitHub stars, it also includes whisperfile for single-file speech-to-text. Llamafile supports a wide range of open models including Llama, Mistral, Qwen, and more, making local LLM inference truly accessible to everyone.
Requirements
Min vCPU
1
Min RAM
4096 MB
Min Disk
10 GB
Rec vCPU
4
Rec RAM
4096 MB
Rec Disk
20 GB
Recommended VPS
Hostinger · KVM 4
4 vCPU · 16384 MB · 200 GB
Hostinger · KVM 4
4 vCPU · 16384 MB · 200 GB
Hostinger · KVM 8
8 vCPU · 32256 MB · 400 GB
Affiliate disclosure
Docker Compose
# Generated by Run This Ai — docker-compose.yml
services:
llamafile:
image: ghcr.io/mozilla-ai/llamafile:latest
restart: unless-stopped
ports:
- 8080:8080
volumes:
- ./data/llamafile:/data
Related tools
NextChat
Cross-platform ChatGPT web UI with multi-model support for Ollama, Claude, Gemini, and more
Lobe Chat
Extensible, open-source ChatGPT alternative with plugins, knowledge base, and multi-LLM support
Open WebUI
User-friendly WebUI for LLMs (Ollama, OpenAI API)
text-generation-webui
Run local LLMs with a powerful web interface — text, vision, tool-calling, and OpenAI-compatible API
Streamlit
Build and share data apps in pure Python — fast
Gradio
Build and share delightful machine learning apps in Python