Aphrodite Engine System Requirements (CPU, RAM, Disk)
System requirements for Aphrodite Engine: CPU, RAM, and disk space.
Aphrodite Engine is a high-performance inference engine built on vLLM's Paged Attention technology, optimized for serving HuggingFace-compatible models at scale. It powers PygmalionAI's chat platforms and API infrastructure. Aphrodite supports an extensive range of quantization methods including AWQ, GPTQ, GGUF, ExLlamaV3, Bitsandbytes, and more. It features continuous batching, efficient K/V cache management, distributed inference, speculative decoding (EAGLE, DFlash, MTP), multi-LoRA support, multimodal support, and modern samplers like DRY, XTC, and Mirostat.
Requirements · Aphrodite Engine
Min vCPU
2
Min RAM
4,096 MB
Min Disk
10 GB
Rec vCPU
8
Rec RAM
16,384 MB
Rec Disk
20 GB
See the full tool page: Aphrodite Engine →