Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[GLUTEN-4039][VL] Implement stack function #5813

Merged
merged 1 commit into from
May 22, 2024

Conversation

xumingming
Copy link
Contributor

We insert a ProjectExec before GenerateExec to organize stack's params as several arrays, these arrays then would be unnested using Unnest operator, for query:

select stack(2, id, name, id1, name1)

The plan is:

Generate stack(2, id#122, name#123, id1#124, name1#125), false, [col0#137, col1#138] +- Project [id#122, name#123, id1#124, name1#125, array(id#122, id1#124) AS _pre_0#141, array(name#123,name1#125) AS _pre_1#142]
+- RewrittenNodeWall LocalTableScan [id#122, name#123, id1#124, name1#125]

@xumingming
Copy link
Contributor Author

@marin-ma Can you help review?

Copy link

#4039

Copy link

Run Gluten Clickhouse CI

@marin-ma
Copy link
Contributor

LGTM. Thanks.

Could you rebase and run mvn spotless:apply -Pbackends-clickhouse -Pspark-3.2 -Pspark-ut -Pceleborn
mvn spotless:apply -Pbackends-clickhouse -Pspark-3.3 -Pspark-ut -Pceleborn
to fix the CH codestyle?

Copy link

Run Gluten Clickhouse CI

We insert a ProjectExec before GenerateExec to organize stack's
params as several arrays, these arrays then would be unnested
using Unnest operator, for query:

select stack(2, id, name, id1, name1)

The plan is:

Generate stack(2, id#122, name#123, id1#124, name1#125), false, [col0#137, col1#138]
+- Project [id#122, name#123, id1#124, name1#125, array(id#122, id1#124) AS _pre_0#141, array(name#123,name1#125) AS _pre_1#142]
  +- RewrittenNodeWall LocalTableScan [id#122, name#123, id1#124, name1#125]
Copy link

Run Gluten Clickhouse CI

@xumingming
Copy link
Contributor Author

xumingming commented May 21, 2024

LGTM. Thanks.

Could you rebase and run mvn spotless:apply -Pbackends-clickhouse -Pspark-3.2 -Pspark-ut -Pceleborn mvn spotless:apply -Pbackends-clickhouse -Pspark-3.3 -Pspark-ut -Pceleborn to fix the CH codestyle?

@marin-ma Rebased, and the test passed. Just curious, do we always need to keep our PR branch update to date with gluten's main branch? After the test passed, the main branch updated again and the PR says "This branch is out-of-date with the base branch" again.

@marin-ma
Copy link
Contributor

@xumingming We don't. But if there are any conflict with main branch, the merging will be blocked.

@marin-ma marin-ma merged commit c987bd2 into apache:main May 22, 2024
40 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants