Skip to content

[GLUTEN-7267][CORE][CH] Move schema pruning optimization of HiveTableScan to an individual post-transform rule#8008

Merged
zhztheplayer merged 2 commits intoapache:mainfrom
zhztheplayer:wip-follow-7268
Nov 21, 2024
Merged

[GLUTEN-7267][CORE][CH] Move schema pruning optimization of HiveTableScan to an individual post-transform rule#8008
zhztheplayer merged 2 commits intoapache:mainfrom
zhztheplayer:wip-follow-7268

Conversation

@zhztheplayer
Copy link
Member

@zhztheplayer zhztheplayer commented Nov 20, 2024

Following #7268, move the new code to an individual rule PruneNestedColumnsInHiveTableScan.

The reason is HiveTableScanNestedColumnPruning actually matches on a project + hive scan pattern so is not simply offloading a project. Move the code out from OffloadSingleNode which targets to handle one single query plan node.

@github-actions github-actions bot added CORE works for Gluten Core CLICKHOUSE labels Nov 20, 2024
@github-actions
Copy link

#7267

@apache apache deleted a comment from github-actions bot Nov 20, 2024
@zhztheplayer
Copy link
Member Author

Hi @KevinyhZou @rui-mo Would you help review this, thanks.

@github-actions
Copy link

Run Gluten Clickhouse CI on x86

@KevinyhZou
Copy link
Contributor

LGTM

@zhztheplayer zhztheplayer marked this pull request as ready for review November 20, 2024 08:07
@zhztheplayer zhztheplayer merged commit 16f68a2 into apache:main Nov 21, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

CLICKHOUSE CORE works for Gluten Core

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants