Skip to content

GPU and CUDA

Chris Smashe edited this page Jun 17, 2026 · 4 revisions

GPU & CUDA

TypeWhisper ships an optional CUDA backend that runs the bundled whisper.cpp transcription engine on a compatible NVIDIA GPU. This page covers what it requires and what it currently applies to.

Requirements

To use the CUDA backend you need:

  • An NVIDIA GPU and driver.
  • CUDA 12 runtime/toolkit libraries providing libcudart.so.12 and libcublas.so.12.

If those libraries are missing, the Linux UI disables the relevant control and explains what's needed — see Troubleshooting.

Scope

CUDA currently applies to the bundled whisper.cpp engine. Other bundled local engines stay on CPU.

Related pages


Changelog

Date Change
2026-06-17 Initial version.

Clone this wiki locally