Problems with WebGPU backend in Apple M3 Pro macbook Pro

[caraya]

System Info

Transformers.js version 3.7.3
Browser: Chrome 140 and Chrome Canary 144
OS: macos Tahoe (26)
Hardware: macbookPro laptop, M3 Pro chip

No Node.js or bundler but the development site is served via Vite. The issue also happened when I tried to open the test-case file directly in the browser

Environment/Platform

• Website/web-app
• Browser extension
• Server-side (e.g., Node.js, Deno, Bun)
• Desktop app (e.g., Electron)
• Other (e.g., VSCode extension)

Description

Trying to use the Xenova/speecht5_tts with the WebGPU backend.

I get the following error:

WebGPU initialization failed. Attempting to fall back to WASM... 255951048

The WASM initialization also fails. I don't understand if it's the same issue or not, but wouldn't expect it to.

My expectation is that the WebGPU backend would load successfully and if that was not possible that the WASM/CPU backend would load as a replacement

Reproduction

Attached the test case I've been using to try and debug the issue. test-case.html

click the Run Test Button

look at the browser devtools console to see if either the WebGPU or WASM load successfully

[xenova]

Hi there 👋 Could you try using a different quantization? e.g., dtype: "q4". The error you are facing is typically an out-of-memory issue.

I tested and

{
  device: 'webgpu',
  dtype: 'q4',
};

seems to load fine. Not sure how it will affect quality though. See https://huggingface.co/docs/transformers.js/guides/dtypes for more information.