Skip to content

[VL] Makes resizeBatches.shuffleOutput work only for hash shuffle #10988

@wForget

Description

@wForget

Description

The sort-based shuffle reader already respects the batch size configuration, so we don't need to support resizeBatches.shuffleOutput for it.

https://github.com/apache/incubator-gluten/blob/2f7b138f24f16a249cea57217e50962d3b1a8ee4/cpp/velox/shuffle/VeloxShuffleReader.cc#L602

Gluten version

None

Metadata

Metadata

Assignees

Labels

enhancementNew feature or request

Type

No type
No fields configured for issues without a type.

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions