Run This Ai
EN DE

LangWatch

Open-source platform for LLM evaluations and AI agent testing — simulate, evaluate, and monitor LLM-powered agents end-to-end

★ 3,365 GitHub Apache-2.0 llm-evaluationai-observabilityagent-testingllmopsai-gateway AI Agents

Overview

LangWatch is an open-source platform for LLM evaluations and AI agent testing. It helps teams test, simulate, evaluate, and monitor LLM-powered agents end-to-end, both before release and in production. Features include end-to-end agent simulations, a complete trace-to-evaluate-to-optimize workflow, OpenTelemetry-native integration with any framework, an AI Gateway for governance and cost control, and collaborative tools for teams to review runs and annotate failures. Self-host with Docker Compose, Kubernetes, or the npx CLI.

Requirements

Min vCPU
2
Min RAM
4096 MB
Min Disk
10 GB
Rec vCPU
4
Rec RAM
8192 MB
Rec Disk
20 GB

Recommended VPS

Hostinger · KVM 4

4 vCPU · 16384 MB · 200 GB

$11.99
View plan

Hostinger · KVM 4

4 vCPU · 16384 MB · 200 GB

$11.99
View plan

Hostinger · KVM 8

8 vCPU · 32256 MB · 400 GB

$20.00
View plan

Affiliate disclosure

Docker Compose

# Generated by Run This Ai — docker-compose.yml
services:
  langwatch:
    image: langwatch/langwatch:latest
    restart: unless-stopped
    ports:
      - 8080:8080
    volumes:
      - ./data/langwatch:/data

Best VPS for LangWatch →

Related tools

AutoGPT

Build, Deploy, and Run AI Agents — autonomous AI that chains tasks to reach goals

Browser Use

Make websites accessible for AI agents — automate any online task

n8n

Workflow automation with AI nodes

OpenHands

AI-driven development platform — an autonomous coding agent that writes, runs, and debugs code

MetaGPT

Multi-Agent Framework for AI Software Teams

Dify

Open-source LLM app development platform

Guides & articles

LangWatch Tutorial: Set Up LLM Agent Testing in 15 Minutes

Step-by-step tutorial to deploy LangWatch with Docker, create your first project, run agent simulations, and start tracing production LLM calls.

Jul 15, 2026

LangWatch Guide: LLM Evaluation and Agent Testing Platform

An in-depth guide to LangWatch — the open-source platform for LLM evaluations, agent testing, and AI observability with simulation, tracing, and an AI Gateway.

Jul 15, 2026