You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
The current code in Plugin only supports data slicing on CPU for the normal Shuffle path, and leverages the CPU codec to do partition compression.
This issue is to track the try of moving the slicing to GPU and supporting GPU compression to see if it can get any performance improvement, especially when working with Celeborn.
The text was updated successfully, but these errors were encountered:
This is one of the sub tasks for issue #10790 .
The current code in Plugin only supports data slicing on CPU for the normal Shuffle path, and leverages the CPU codec to do partition compression.
This issue is to track the try of moving the slicing to GPU and supporting GPU compression to see if it can get any performance improvement, especially when working with Celeborn.
The text was updated successfully, but these errors were encountered: