You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
For convenience, current implementation of WebGPU backend copys data every time when executing a operator. HPC is all about data movement. It's hard to imagine how much time we spent on these useless data movement.
Consider replace data field with WebGPU buffer type member in WebGPU tensor definition.
And computePass() function should be modified as well, never copy back result back in its end.
The text was updated successfully, but these errors were encountered:
For convenience, current implementation of WebGPU backend copys data every time when executing a operator.
HPC is all about data movement. It's hard to imagine how much time we spent on these useless data movement.
Consider replace
data
field with WebGPU buffer type member in WebGPU tensor definition.And
computePass()
function should be modified as well, never copy back result back in its end.The text was updated successfully, but these errors were encountered: