TabbyAPI System Requirements (CPU, RAM, Disk)
System requirements for TabbyAPI: CPU, RAM, and disk space.
TabbyAPI is the official API backend server for ExLlamaV2 and ExLlamaV3, providing a lightweight, fast FastAPI-based application for generating text using large language models. It offers a fully OpenAI-compatible API with support for loading/unloading models, HuggingFace model downloading, tool calling, LoRA adapters, and more. TabbyAPI publishes a CUDA-ready Docker image via GitHub Container Registry, making deployment straightforward on GPU-equipped servers. It is designed for hobbyist and small-scale use, with easy setup via Docker or manual Python installation.
Requirements · TabbyAPI
Min vCPU
2
Min RAM
4,096 MB
Min Disk
10 GB
Rec vCPU
8
Rec RAM
16,384 MB
Rec Disk
20 GB
See the full tool page: TabbyAPI →