Aphrodite Engine
High-performance LLM inference engine for roleplay and chatbots
Überblick
Aphrodite Engine is a high-performance inference engine built on vLLM's Paged Attention technology, optimized for serving HuggingFace-compatible models at scale. It powers PygmalionAI's chat platforms and API infrastructure. Aphrodite supports an extensive range of quantization methods including AWQ, GPTQ, GGUF, ExLlamaV3, Bitsandbytes, and more. It features continuous batching, efficient K/V cache management, distributed inference, speculative decoding (EAGLE, DFlash, MTP), multi-LoRA support, multimodal support, and modern samplers like DRY, XTC, and Mirostat.
Anforderungen
Min vCPU
2
Min RAM
4096 MB
Min Disk
10 GB
Rec vCPU
8
Rec RAM
16384 MB
Rec Disk
20 GB
Empfohlener VPS
Hostinger · KVM 8
8 vCPU · 32256 MB · 400 GB
Affiliate-Hinweis
Docker Compose
# Generated by Run This Ai — docker-compose.yml
services:
aphrodite-engine:
image: ghcr.io/pygmalionai/aphrodite-engine:latest
restart: unless-stopped
ports:
- 8080:8080
volumes:
- ./data/aphrodite-engine:/data
Verwandte Tools
NextChat
Cross-platform ChatGPT web UI with multi-model support for Ollama, Claude, Gemini, and more
Lobe Chat
Extensible, open-source ChatGPT alternative with plugins, knowledge base, and multi-LLM support
Open WebUI
User-friendly WebUI for LLMs (Ollama, OpenAI API)
text-generation-webui
Run local LLMs with a powerful web interface — text, vision, tool-calling, and OpenAI-compatible API
Streamlit
Build and share data apps in pure Python — fast
Gradio
Build and share delightful machine learning apps in Python