How to Install Aphrodite Engine on Ubuntu 24.04

Aphrodite Engine is a high-performance inference engine built on vLLM's Paged Attention technology, optimized for serving HuggingFace-compatible models at scale. It powers PygmalionAI's chat platforms and API infrastructure. Aphrodite supports an extensive range of quantization methods including AWQ, GPTQ, GGUF, ExLlamaV3, Bitsandbytes, and more. It features continuous batching, efficient K/V cache management, distributed inference, speculative decoding (EAGLE, DFlash, MTP), multi-LoRA support, multimodal support, and modern samplers like DRY, XTC, and Mirostat.