Skip to content

v1.0.0 — Universal GPU Support

Choose a tag to compare

View all tags
@Betanu701 Betanu701 released this 01 Mar 22:27
· 1 commit to main since this release
v1.0.0
d4753ff

Orpheus-FastAPI v1.0.0 — Universal GPU Support

🎉 First release with support for all major GPU vendors

This release adds Intel Arc (XPU) support and a unified device abstraction layer to Orpheus-FastAPI, making it run on any graphics card.

Supported Hardware

GPU Vendor Docker Image Docker Compose
NVIDIA (CUDA) ghcr.io/betanu701/orpheus-fastapi:1.0.0-gpu-cuda docker-compose-gpu.yml
AMD (ROCm) ghcr.io/betanu701/orpheus-fastapi:1.0.0-gpu-rocm docker-compose-gpu-rocm.yml
Intel Arc (XPU) ghcr.io/betanu701/orpheus-fastapi:1.0.0-gpu-intel docker-compose-gpu-intel.yml
CPU only ghcr.io/betanu701/orpheus-fastapi:1.0.0-cpu docker-compose-cpu.yaml

Quick Start

# Clone the repo
git clone https://github.com/Betanu701/Orpheus-FastAPI.git
cd Orpheus-FastAPI
cp .env.example .env

# Pick your GPU:
docker compose -f docker-compose-gpu.yml up          # NVIDIA
docker compose -f docker-compose-gpu-rocm.yml up      # AMD
docker compose -f docker-compose-gpu-intel.yml up      # Intel Arc
docker compose -f docker-compose-cpu.yaml up           # CPU only

Or pull pre-built images directly:

docker pull ghcr.io/betanu701/orpheus-fastapi:1.0.0-gpu-intel

What's New

  • tts_engine/device.py — Unified device detection module supporting NVIDIA CUDA, AMD ROCm, Intel Arc XPU, and Apple MPS
  • Intel Arc Docker support — Dockerfile.gpu-intel + docker-compose-gpu-intel.yml using intel/oneapi-runtime and llama.cpp:server-intel
  • Explicit AMD ROCm detection — Now properly identifies AMD GPUs via torch.version.hip instead of showing as "CUDA GPU"
  • GPU fast-path extended — SNAC decoder on-device processing now works on both CUDA and XPU
  • CI/CD pipeline — GitHub Actions auto-builds and publishes all 4 Docker images to GHCR on every release
Assets 2
Loading