Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[SPARK-42239][SQL][3.4] Integrate MUST_AGGREGATE_CORRELATED_SCALAR_SUBQUERY #39831

Closed
wants to merge 1 commit into from

Conversation

itholic
Copy link
Contributor

@itholic itholic commented Feb 1, 2023

What changes were proposed in this pull request?

backport for #39806

Why are the changes needed?

We should want to include PRs related to error classes into Spark 3.4.

Does this PR introduce any user-facing change?

No.

How was this patch tested?

The CI should pass.

### What changes were proposed in this pull request?

This is raised from https://github.com/apache/spark/pull/39543/files#r1082159637, to integrate the `MUST_AGGREGATE_CORRELATED_SCALAR_SUBQUERY` and `MUST_AGGREGATE_CORRELATED_SCALAR_SUBQUERY_OUTPUT`

### Why are the changes needed?

Logically, `MUST_AGGREGATE_CORRELATED_SCALAR_SUBQUERY` and `MUST_AGGREGATE_CORRELATED_SCALAR_SUBQUERY_OUTPUT` are exactly the same.

We should deduplicate the error classes when possible.

### Does this PR introduce _any_ user-facing change?

No.

### How was this patch tested?

Updated the existing UT.

Closes apache#39806 from itholic/MUST_AGGREGATE_CORRELATED_SCALAR_SUBQUERY1.

Authored-by: itholic <haejoon.lee@databricks.com>
Signed-off-by: Max Gekk <max.gekk@gmail.com>
@itholic itholic changed the title [SPARK-42239][SQL] Integrate MUST_AGGREGATE_CORRELATED_SCALAR_SUBQUERY [3.4][SPARK-42239][SQL] Integrate MUST_AGGREGATE_CORRELATED_SCALAR_SUBQUERY Feb 1, 2023
Copy link
Member

@MaxGekk MaxGekk left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Waiting for CI.

@MaxGekk
Copy link
Member

MaxGekk commented Feb 1, 2023

+1, LGTM. Merging to 3.4.
Thank you, @itholic.

MaxGekk pushed a commit that referenced this pull request Feb 1, 2023
…UBQUERY`

### What changes were proposed in this pull request?

backport for #39806

### Why are the changes needed?

We should want to include PRs related to error classes into Spark 3.4.

### Does this PR introduce _any_ user-facing change?

No.

### How was this patch tested?

The CI should pass.

Closes #39831 from itholic/42239-3.4.

Authored-by: itholic <haejoon.lee@databricks.com>
Signed-off-by: Max Gekk <max.gekk@gmail.com>
@MaxGekk MaxGekk closed this Feb 1, 2023
@itholic itholic changed the title [3.4][SPARK-42239][SQL] Integrate MUST_AGGREGATE_CORRELATED_SCALAR_SUBQUERY [SPARK-42239][SQL][3.4] Integrate MUST_AGGREGATE_CORRELATED_SCALAR_SUBQUERY Feb 3, 2023
@itholic itholic deleted the 42239-3.4 branch April 22, 2023 05:48
snmvaughan pushed a commit to snmvaughan/spark that referenced this pull request Jun 20, 2023
…UBQUERY`

### What changes were proposed in this pull request?

backport for apache#39806

### Why are the changes needed?

We should want to include PRs related to error classes into Spark 3.4.

### Does this PR introduce _any_ user-facing change?

No.

### How was this patch tested?

The CI should pass.

Closes apache#39831 from itholic/42239-3.4.

Authored-by: itholic <haejoon.lee@databricks.com>
Signed-off-by: Max Gekk <max.gekk@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants