Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Web] Error: [WebGPU] Kernel "[Conv] /text_encoder/encoder/layers.0/feed_forward/conv_2/Conv" failed. Error: FILTER_IN_CHANNEL should be equal to DATA_CHANNEL #21108

Open
xenova opened this issue Jun 19, 2024 · 3 comments
Labels
ep:WebGPU ort-web webgpu provider model:transformer issues related to a transformer model: BERT, GPT2, Hugging Face, Longformer, T5, etc. platform:web issues related to ONNX Runtime web; typically submitted using template

Comments

@xenova
Copy link

xenova commented Jun 19, 2024

Describe the issue

Attempting to run Xenova/mms-tts-eng on WebGPU produces the following error:

Uncaught Error: [WebGPU] Kernel "[Conv] /text_encoder/encoder/layers.0/feed_forward/conv_2/Conv" failed. Error: FILTER_IN_CHANNEL should be equal to DATA_CHANNEL

To reproduce

  1. Download the model from the HF hub: https://huggingface.co/Xenova/mms-tts-eng/resolve/main/onnx/model.onnx?download=true
  2. Load the session and set execution provider to webgpu
  3. Run the model with attention_mask and input_ids as inputs
  4. Observe error.

Note that the WASM backend does not have this issue (the model runs correctly)

Urgency

Blocks vits/mms model usage in Transformers.js

ONNX Runtime Installation

Released Package

ONNX Runtime Version or Commit ID

1.18.0

Execution Provider

'webgpu' (WebGPU)

@xenova xenova added the platform:web issues related to ONNX Runtime web; typically submitted using template label Jun 19, 2024
@github-actions github-actions bot added the model:transformer issues related to a transformer model: BERT, GPT2, Hugging Face, Longformer, T5, etc. label Jun 19, 2024
@xenova
Copy link
Author

xenova commented Jun 19, 2024

cc @guschmue

@guschmue guschmue added the ep:WebGPU ort-web webgpu provider label Jun 20, 2024
Copy link
Contributor

This issue has been automatically marked as stale due to inactivity and will be closed in 30 days if no further activity occurs. If further support is needed, please provide an update and/or more details.

@github-actions github-actions bot added the stale issues that have not been addressed in a while; categorized by a bot label Jul 20, 2024
@xenova
Copy link
Author

xenova commented Jul 22, 2024

bump

@github-actions github-actions bot removed the stale issues that have not been addressed in a while; categorized by a bot label Jul 22, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
ep:WebGPU ort-web webgpu provider model:transformer issues related to a transformer model: BERT, GPT2, Hugging Face, Longformer, T5, etc. platform:web issues related to ONNX Runtime web; typically submitted using template
Projects
None yet
Development

No branches or pull requests

2 participants