Skip to content

v0.6.1 — Multi-GPU dashboard cards and llama.cpp PCI bus device ordering

Latest

Choose a tag to compare

@jimdawdy-hub jimdawdy-hub released this 01 Nov 04:10

Changes

  • Render a Dashboard metric card for every detected GPU (supporting 3+ GPUs) with a responsive auto-fit grid instead of only displaying GPU 0 and GPU 1.
  • Update the Dashboard VRAM Budget subtitle to reflect the actual number of detected GPUs (Used across all N GPUs, Used across both GPUs, Used on GPU, or No GPUs detected).
  • Set CUDA_DEVICE_ORDER=PCI_BUS_ID when probing llama-server --list-devices and launching llama.cpp so CUDA0, CUDA1, CUDA2, etc. match nvidia-smi PCI bus device numbering (consistent with vLLM and SGLang).
  • Show GPU model names alongside CUDA0/CUDA1/CUDA2 in the Launch tab's llama.cpp devices: summary line.