Aphrodite Engine Review — Self-Hosted AI Tool
Unser Test von Aphrodite Engine — Funktionen, Stärken und Schwächen.
Aphrodite Engine is a high-performance inference engine built on vLLM's Paged Attention technology, optimized for serving HuggingFace-compatible models at scale. It powers PygmalionAI's chat platforms and API infrastructure. Aphrodite supports an extensive range of quantization methods including AWQ, GPTQ, GGUF, ExLlamaV3, Bitsandbytes, and more. It features continuous batching, efficient K/V cache management, distributed inference, speculative decoding (EAGLE, DFlash, MTP), multi-LoRA support, multimodal support, and modern samplers like DRY, XTC, and Mirostat.