You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
v0.6.1 — Multi-GPU dashboard cards and llama.cpp PCI bus device ordering
Render a Dashboard metric card for every detected GPU (supporting 3+ GPUs) with a responsive auto-fit grid instead of only displaying GPU 0 and GPU 1.
Update the Dashboard VRAM Budget subtitle to reflect the actual number of detected GPUs (Used across all N GPUs, Used across both GPUs, Used on GPU, or No GPUs detected).
Set CUDA_DEVICE_ORDER=PCI_BUS_ID when probing llama-server --list-devices and launching llama.cpp so CUDA0, CUDA1, CUDA2, etc. match nvidia-smi PCI bus device numbering (consistent with vLLM and SGLang).
Show GPU model names alongside CUDA0/CUDA1/CUDA2 in the Launch tab's llama.cpp devices: summary line.