Run This Ai
EN DE

How to Install text-generation-webui on Ubuntu 24.04

Install text-generation-webui on Ubuntu 24.04 with Docker Compose.

text-generation-webui (also known as oobabooga) is an open-source desktop application for running large language models locally. It supports text generation, vision (multimodal), tool-calling, and provides an OpenAI/Anthropic-compatible API — all 100%% private. With 47k+ GitHub stars, it is one of the most popular local LLM interfaces, supporting models like Llama, Mistral, Gemma, and thousands more from Hugging Face. Features include chat mode, notebook mode, custom extensions, GPU acceleration (CUDA, ROCm, Metal), LoRA/QLoRA training, and a built-in one-click installer for Windows, Linux, and macOS.

Requirements · text-generation-webui

See the full tool page: text-generation-webui →