Skip to content

examples: add -g/--gpu-device option and GPU_DEVICE env support#3557

Merged
danbev merged 1 commit intoggml-org:masterfrom
brauliobo:feat/gpu-device-selection
Jan 21, 2026
Merged

examples: add -g/--gpu-device option and GPU_DEVICE env support#3557
danbev merged 1 commit intoggml-org:masterfrom
brauliobo:feat/gpu-device-selection

Conversation

@brauliobo
Copy link
Contributor

  • Added -g / --gpu-device CLI option to select a specific GPU device.
  • Added support for GPU_DEVICE environment variable as a fallback.
  • Updated whisper_params to store the gpu_device index.
  • Passed the selected device ID to whisper_context_params initialization.
  • Applied changes to both examples/cli/cli.cpp and examples/server/server.cpp.

@brauliobo brauliobo force-pushed the feat/gpu-device-selection branch from 45e7c55 to 7e9c8e0 Compare January 1, 2026 19:08
@brauliobo
Copy link
Contributor Author

brauliobo commented Jan 1, 2026

sorry for the delay @danbev, just updated the PR with the requested changes

@brauliobo brauliobo force-pushed the feat/gpu-device-selection branch from 7e9c8e0 to a2caf86 Compare January 1, 2026 19:39
Align device selection naming with llama.cpp.
@brauliobo brauliobo force-pushed the feat/gpu-device-selection branch from a2caf86 to 231242e Compare January 18, 2026 13:55
@danbev danbev merged commit 7aa8818 into ggml-org:master Jan 21, 2026
56 of 66 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants