Skip to content

Convert AQEShuffleReadExec to native implementation. #2125

@guixiaowen

Description

@guixiaowen

Convert AQEShuffleReadExec to native implementation

eg:

select /*+ REBALANCE(a) */ * from xxx_uuu_xxxx_datasource

after convert

InputAdapter
+- AQEShuffleRead coalesced
+- ShuffleQueryStage 0
+- NativeShuffleExchange hashpartitioning(a#0, 1000), REBALANCE_PARTITIONS_BY_COL, [id=#24]
+- InputAdapter [#0]
+- NativeOrcScan test.xxx_uuu_xxxx_datasource (FileScan orc bigdata_qa.xxx_uuu_xxxx_datasource[a#0] Batched: true, DataFilters: [], Format: ORC, Location: InMemoryFileIndex(1 paths)[-----, PartitionFilters: [], PushedFilters: [], ReadSchema: struct<a:string>)

AQEShuffleReadExec never convert to native

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions