Run This Ai
EN DE

BricksLLM

Enterprise-grade LLM API gateway for cost and rate limiting per API key. Supports OpenAI, Azure, Anthropic, vLLM, and open-source LLMs with fine-grained access control.

★ 1,217 GitHub MIT llm-gatewayapi-gatewayrate-limitingopenaicost-managementproxy Automation Tools

Overview

BricksLLM is an enterprise-grade API gateway built specifically for LLM providers. It gives you fine-grained control over how your team uses AI APIs — set cost limits per API key, enforce rate limits per user/application/environment, and monitor usage across your entire organization. With support for OpenAI, Azure OpenAI, Anthropic, vLLM, and any open-source LLM behind a compatible API, BricksLLM acts as a unified proxy layer. The admin dashboard lets you create API keys with custom rules, view real-time usage analytics, and set budget alerts. Deploy it as a Docker container alongside your existing infrastructure — it integrates with your database (PostgreSQL) and Redis for high-performance rate limiting. Features include per-key cost tracking, rate limiting by RPM/TPM, usage analytics dashboard, webhook alerts for budget thresholds, PII-redaction logging, and multi-environment support (dev/staging/prod). Originally built by Y Combinator S22 founders and backed by Afore Capital.

Requirements

Min vCPU
1
Min RAM
1024 MB
Min Disk
10 GB
Rec vCPU
2
Rec RAM
2048 MB
Rec Disk
20 GB

Recommended VPS

Hostinger · KVM 2

2 vCPU · 8192 MB · 100 GB

$6.99
View plan

Hostinger · KVM 2

2 vCPU · 8192 MB · 100 GB

$6.99
View plan

Hostinger · KVM 4

4 vCPU · 16384 MB · 200 GB

$11.99
View plan

Affiliate disclosure

Docker Compose

# Generated by Run This Ai — docker-compose.yml
services:
  bricksllm:
    image: luyuanxin1995/bricksllm:latest
    restart: unless-stopped
    ports:
      - 8080:8080
    volumes:
      - ./data/bricksllm:/data

Best VPS for BricksLLM →

Related tools

Guides & articles