Aphrodite Engine System Requirements (CPU, RAM, Disk)
Systemanforderungen für Aphrodite Engine: CPU, RAM und Speicherplatz.
Aphrodite Engine is a high-performance inference engine built on vLLM's Paged Attention technology, optimized for serving HuggingFace-compatible models at scale. It powers PygmalionAI's chat platforms and API infrastructure. Aphrodite supports an extensive range of quantization methods including AWQ, GPTQ, GGUF, ExLlamaV3, Bitsandbytes, and more. It features continuous batching, efficient K/V cache management, distributed inference, speculative decoding (EAGLE, DFlash, MTP), multi-LoRA support, multimodal support, and modern samplers like DRY, XTC, and Mirostat.
Anforderungen · Aphrodite Engine
Min vCPU
2
Min RAM
4,096 MB
Min Disk
10 GB
Empf. vCPU
8
Empf. RAM
16,384 MB
Empf. Disk
20 GB
Siehe die detaillierte Werkzeugseite: Aphrodite Engine →