How to Install FastChat on Ubuntu 24.04
Install FastChat on Ubuntu 24.04 with Docker Compose.
FastChat is the open-source platform behind Vicuna and Chatbot Arena (lmsys.org), built to train, serve, and evaluate LLMs. It started as a simple chatbot UI and grew into one of the most popular LLM serving frameworks, powering million-user platforms. FastChat supports multiple models simultaneously, provides OpenAI-compatible APIs, and includes tools for benchmarking and evaluation — all in one package.
Requirements · FastChat
See the full tool page: FastChat →