Skip to content

Releases: Betanu701/Orpheus-FastAPI

Release list

v1.0.1 — Intel Arc Build Fixes

v1.0.1 — Intel Arc Build Fixes Latest
Latest

Choose a tag to compare

View all tags
@Betanu701 Betanu701 released this 01 Mar 23:48
v1.0.1
9c20c6a
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

v1.0.1 — Intel Arc Build Fixes

Fixes from real-world testing on Intel Arc B580 (12GB VRAM) running on Unraid 7.1.4.

Fixes

  • Dockerfile.gpu-intel: Removed redundant intel-opencl-icd intel-level-zero-gpu level-zero apt packages (already present in intel/oneapi-runtime base image, caused unmet dependency errors)
  • Dockerfile.gpu-intel: Added pip install --upgrade pip setuptools wheel before torch install for Python 3.12 compatibility
  • requirements.txt: Bumped numpy from ==1.24.0 to >=1.26.0 (fixes pkgutil.ImpImporter removal in Python 3.12)
  • inference.py: Fixed GPU acceleration display to use is_gpu(device) instead of torch.cuda.is_available() (was showing "No" on Intel XPU)

Verified Working

  • ✅ Docker image builds successfully
  • ✅ SNAC model loads on xpu:0
  • ✅ TTS generation produces valid 24kHz WAV audio
  • ✅ device.py detects Intel XPU correctly
  • ✅ llama.cpp SYCL inference: ~20 tok/s

Docker Images

docker pull ghcr.io/betanu701/orpheus-fastapi:1.0.1-gpu-intel   # Intel Arc
docker pull ghcr.io/betanu701/orpheus-fastapi:1.0.1-gpu-cuda    # NVIDIA
docker pull ghcr.io/betanu701/orpheus-fastapi:1.0.1-gpu-rocm    # AMD
docker pull ghcr.io/betanu701/orpheus-fastapi:1.0.1-cpu          # CPU only
Assets 2
Loading

v1.0.0 — Universal GPU Support

v1.0.0 — Universal GPU Support

Choose a tag to compare

View all tags
@Betanu701 Betanu701 released this 01 Mar 22:27
v1.0.0
d4753ff

Orpheus-FastAPI v1.0.0 — Universal GPU Support

🎉 First release with support for all major GPU vendors

This release adds Intel Arc (XPU) support and a unified device abstraction layer to Orpheus-FastAPI, making it run on any graphics card.

Supported Hardware

GPU Vendor Docker Image Docker Compose
NVIDIA (CUDA) ghcr.io/betanu701/orpheus-fastapi:1.0.0-gpu-cuda docker-compose-gpu.yml
AMD (ROCm) ghcr.io/betanu701/orpheus-fastapi:1.0.0-gpu-rocm docker-compose-gpu-rocm.yml
Intel Arc (XPU) ghcr.io/betanu701/orpheus-fastapi:1.0.0-gpu-intel docker-compose-gpu-intel.yml
CPU only ghcr.io/betanu701/orpheus-fastapi:1.0.0-cpu docker-compose-cpu.yaml

Quick Start

# Clone the repo
git clone https://github.com/Betanu701/Orpheus-FastAPI.git
cd Orpheus-FastAPI
cp .env.example .env

# Pick your GPU:
docker compose -f docker-compose-gpu.yml up          # NVIDIA
docker compose -f docker-compose-gpu-rocm.yml up      # AMD
docker compose -f docker-compose-gpu-intel.yml up      # Intel Arc
docker compose -f docker-compose-cpu.yaml up           # CPU only

Or pull pre-built images directly:

docker pull ghcr.io/betanu701/orpheus-fastapi:1.0.0-gpu-intel

What's New

  • tts_engine/device.py — Unified device detection module supporting NVIDIA CUDA, AMD ROCm, Intel Arc XPU, and Apple MPS
  • Intel Arc Docker support — Dockerfile.gpu-intel + docker-compose-gpu-intel.yml using intel/oneapi-runtime and llama.cpp:server-intel
  • Explicit AMD ROCm detection — Now properly identifies AMD GPUs via torch.version.hip instead of showing as "CUDA GPU"
  • GPU fast-path extended — SNAC decoder on-device processing now works on both CUDA and XPU
  • CI/CD pipeline — GitHub Actions auto-builds and publishes all 4 Docker images to GHCR on every release
Loading