Skip to content

v1.2.0 - Multi-GPU Support (NVIDIA, AMD, CPU)

Choose a tag to compare

View all tags
@primoco primoco released this 02 Mar 06:53
· 257 commits to main since this release
1.2.0
8fa95f7
This commit was signed with the committer’s verified signature.
claude Claude
SSH Key Fingerprint: 32dP45eSMmVSt/G/CGvcxl/P+MO3Nwj9xeTh/GSA2wc
Verified
Learn about vigilant mode.

What's New

Multi-GPU Support

The system now supports NVIDIA (CUDA), AMD (ROCm), and CPU-only modes.

How it works

  • Set GPU_TYPE in .env (nvidia, amd, or cpu)
  • Docker Compose automatically loads the correct GPU overlay via COMPOSE_FILE
  • setup.sh now asks your GPU type and configures everything automatically

New Files

  • docker-compose.nvidia.yml — NVIDIA CUDA overlay (GPU reservations)
  • docker-compose.amd.yml — AMD ROCm overlay (ollama:rocm + /dev/kfd, /dev/dri)

Changes

  • docker-compose.yml — now GPU-agnostic base
  • .env.example — added GPU_TYPE and COMPOSE_FILE configuration
  • setup.sh — GPU selection step, conditional toolkit install, correct image pulls
  • README.md — updated prerequisites and troubleshooting for all GPU types

Full Changelog: v1.1.5...v1.2.0

Assets 2
Loading