Run This Ai
EN DE

Mesh LLM

Distributed AI/LLM for the people. Share compute privately or publicly to power your agents and chat.

★ 3,206 GitHub Apache-2.0 llmdistributedagentschatself-hostedrust LLM & Chat

Overview

Mesh LLM is a distributed AI platform that lets you share compute privately or publicly to power your agents and chat. Built in Rust, it offers a full web console for managing a mesh of nodes, running open-weight LLMs, routing requests across the network, and collaborating with other instances over the public mesh. You can run it fully headless as an API, self-host your own private mesh, or join the public network with fine-grained control over what you share.

Requirements

Min vCPU
2
Min RAM
4096 MB
Min Disk
10 GB
Rec vCPU
4
Rec RAM
8192 MB
Rec Disk
20 GB

Recommended VPS

Hostinger · KVM 4

4 vCPU · 16384 MB · 200 GB

$11.99
View plan

Hostinger · KVM 4

4 vCPU · 16384 MB · 200 GB

$11.99
View plan

Hostinger · KVM 8

8 vCPU · 32256 MB · 400 GB

$20.00
View plan

Affiliate disclosure

Docker Compose

# Generated by Run This Ai — docker-compose.yml
services:
  mesh-llm:
    image: ghcr.io/mesh-llm/mesh-llm:latest
    restart: unless-stopped
    ports:
      - 8080:8080
    volumes:
      - ./data/mesh-llm:/data

Best VPS for Mesh LLM →

Related tools

NextChat

Cross-platform ChatGPT web UI with multi-model support for Ollama, Claude, Gemini, and more

Lobe Chat

Extensible, open-source ChatGPT alternative with plugins, knowledge base, and multi-LLM support

Open WebUI

User-friendly WebUI for LLMs (Ollama, OpenAI API)

text-generation-webui

Run local LLMs with a powerful web interface — text, vision, tool-calling, and OpenAI-compatible API

Streamlit

Build and share data apps in pure Python — fast

Gradio

Build and share delightful machine learning apps in Python

Guides & articles

How to Deploy Mesh LLM with Docker: A Step-by-Step Tutorial

Deploy your own Mesh LLM node with Docker Compose, connect it to the public mesh or keep it private, and start sharing compute with your agents. Step-by-step with commands.

Aug 12, 2026

Mesh LLM: A Complete Guide to Distributed Self-Hosted AI

Mesh LLM turns your hardware into a private or public AI mesh. Here is how distributed inference works, what the Rust-based platform offers, and why it matters for self-hosters.

Aug 12, 2026