Run This Ai
EN DE

Portkey AI Gateway

A blazing fast AI Gateway with integrated guardrails -- route to 1,600+ LLMs with one API

★ 12,219 GitHub MIT ai-gatewayllm-routingguardrailsobservabilityopenaiapi-gatewayproxy AI Agents

Overview

Portkey AI Gateway is an open-source, blazing-fast API gateway designed specifically for AI applications. It lets you route requests to 1,600+ LLMs (OpenAI, Anthropic, Google, open-source models, and more) through a single, unified API endpoint. Built-in features include automatic retries with fallbacks, caching, rate limiting, guardrails, and observability. Portkey is the perfect self-hosted solution for teams that need reliability, cost control, and monitoring across multiple AI providers without vendor lock-in. Deploy it in minutes with Docker on your own infrastructure.

Requirements

Min vCPU
1
Min RAM
4096 MB
Min Disk
10 GB
Rec vCPU
2
Rec RAM
1024 MB
Rec Disk
20 GB

Recommended VPS

Hostinger · KVM 2

2 vCPU · 8192 MB · 100 GB

$6.99
View plan

Hostinger · KVM 2

2 vCPU · 8192 MB · 100 GB

$6.99
View plan

Hostinger · KVM 4

4 vCPU · 16384 MB · 200 GB

$11.99
View plan

Affiliate disclosure

Docker Compose

# Generated by Run This Ai — docker-compose.yml
services:
  portkey-ai-gateway:
    image: portkeyai/gateway:latest
    restart: unless-stopped
    ports:
      - 8080:8080
    volumes:
      - ./data/portkey-ai-gateway:/data

Best VPS for Portkey AI Gateway →

Related tools

AutoGPT

Build, Deploy, and Run AI Agents — autonomous AI that chains tasks to reach goals

Browser Use

Make websites accessible for AI agents — automate any online task

n8n

Workflow automation with AI nodes

OpenHands

AI-driven development platform — an autonomous coding agent that writes, runs, and debugs code

MetaGPT

Multi-Agent Framework for AI Software Teams

Dify

Open-source LLM app development platform

Guides & articles

How to Deploy Portkey AI Gateway with Docker: A Quick Start Guide

Deploy Portkey AI Gateway with Docker in under 60 seconds. Complete step-by-step guide with curl examples, Docker Compose setup, and configuration for retries, caching, guardrails, and more.

Jun 27, 2026

Portkey AI Gateway: The Ultimate Self-Hosted API Gateway for LLMs

Route requests to 1,600+ LLMs through a single, self-hosted gateway with automatic retries, caching, guardrails, and observability.

Jun 27, 2026