Skip to content

[GLUTEN-11766][VL] Implement the executeCollect() method in ColumnarCollectLimitExec#11802

Open
JkSelf wants to merge 3 commits intoapache:mainfrom
JkSelf:collect-fix
Open

[GLUTEN-11766][VL] Implement the executeCollect() method in ColumnarCollectLimitExec#11802
JkSelf wants to merge 3 commits intoapache:mainfrom
JkSelf:collect-fix

Conversation

@JkSelf
Copy link
Contributor

@JkSelf JkSelf commented Mar 20, 2026

What changes are proposed in this pull request?

Fix #11766

How was this patch tested?

Manual test.

Before this PR:

image

After this PR

image

Was this patch authored or co-authored using generative AI tooling?

No

@github-actions github-actions bot added CORE works for Gluten Core VELOX labels Mar 20, 2026
@github-actions
Copy link

Run Gluten Clickhouse CI on x86

Copy link
Contributor

@jinchengchenghh jinchengchenghh left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks!

Copy link
Member

@zhouyuan zhouyuan left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

code looks good, could you please also add a test on this?

@github-actions
Copy link

Run Gluten Clickhouse CI on x86

@github-actions
Copy link

Run Gluten Clickhouse CI on x86

override def executeCollect(): Array[InternalRow] = {
child match {
case l: ColumnarCollectLimitBaseExec =>
l.executeCollect()
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Do we need to support this for ch backend?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@jackylee-ch No. Move this changes into VeloxColumnarToRowExec.

@github-actions github-actions bot removed the CORE works for Gluten Core label Mar 23, 2026
@JkSelf
Copy link
Contributor Author

JkSelf commented Mar 23, 2026

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[VL] Gluten performs over 10x slower than Vanilla Spark on simple "select ... limit ..." queries

4 participants