Run This Ai
EN DE

GPT-Load

Self-hosted AI gateway for multi-channel, multi-credential setups — API keys and subscription accounts, scheduling, failover, request logs and usage tracking.

★ 6,283 GitHub MIT ai-gatewayllm-routingproxyopenaiload-balancingfailoverself-hosted LLM & Chat

Overview

GPT-Load is a high-performance, enterprise-grade transparent AI API proxy built with Go. It unifies access to multiple AI providers (OpenAI, Google Gemini, Anthropic Claude and more) through a single gateway, with intelligent key-pool management, weighted load balancing, automatic failover, hot-reload configuration, and a modern Vue 3 management dashboard. Ideal for teams that need centralized AI access, cost tracking, and high availability.

Requirements

Min vCPU
2
Min RAM
4096 MB
Min Disk
10 GB
Rec vCPU
4
Rec RAM
8192 MB
Rec Disk
20 GB

Recommended VPS

Hostinger · KVM 4

4 vCPU · 16384 MB · 200 GB

$11.99
View plan

Hostinger · KVM 4

4 vCPU · 16384 MB · 200 GB

$11.99
View plan

Hostinger · KVM 8

8 vCPU · 32256 MB · 400 GB

$20.00
View plan

Affiliate disclosure

Docker Compose

# Generated by Run This Ai — docker-compose.yml
services:
  gpt-load:
    image: tbphp/gpt-load:latest
    restart: unless-stopped
    ports:
      - 8080:8080
    volumes:
      - ./data/gpt-load:/data

Best VPS for GPT-Load →

Related tools

NextChat

Cross-platform ChatGPT web UI with multi-model support for Ollama, Claude, Gemini, and more

Lobe Chat

Extensible, open-source ChatGPT alternative with plugins, knowledge base, and multi-LLM support

Open WebUI

User-friendly WebUI for LLMs (Ollama, OpenAI API)

text-generation-webui

Run local LLMs with a powerful web interface — text, vision, tool-calling, and OpenAI-compatible API

Streamlit

Build and share data apps in pure Python — fast

Gradio

Build and share delightful machine learning apps in Python

Guides & articles

How to Deploy GPT-Load with Docker: Step-by-Step Tutorial

Deploy GPT-Load in minutes with Docker: create key groups, issue access keys, verify failover, and track usage costs — a complete hands-on walkthrough.

Aug 31, 2026

GPT-Load: The Complete Guide to a Self-Hosted AI Gateway

Learn how GPT-Load unifies OpenAI, Gemini, and Claude behind one transparent proxy with intelligent key pools, load balancing, failover, and usage tracking — all self-hosted.

Aug 31, 2026