Intel transformers

Intel transformers

Intel extension for transformers and LLM serving

Prerequisites

• Docker installed (version 24.0+)
• Docker Compose (version 2.20+)
• At least 1GB RAM (2GB recommended)

Quick start with Docker

# Pull the image
docker pull owner/image:latest

# Run the container
docker run -d --name intel-transformers -p 8080:8080 owner/image:latest

Key features

• Self-hosted and open source
• Docker-based deployment
• License: Apache-2.0
• Repository: https://github.com/intel/intel-extension-for-transformers

Intel transformers

Intel extension for transformers and LLM serving

Key features

• Self-hosted and open source
• Docker-based deployment
• License: Apache-2.0
• Repository: https://github.com/intel/intel-extension-for-transformers

What it's good for

Intel transformers runs entirely on your own infrastructure — your data never leaves your server.