Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[SPARK-32528][SQL][TEST][3.0] The analyze method should make sure the plan is analyzed #29400

Closed
wants to merge 1 commit into from

Conversation

cloud-fan
Copy link
Contributor

@cloud-fan cloud-fan commented Aug 10, 2020

What changes were proposed in this pull request?

backport #29349 to 3.0.
This PR updates the analyze method to make sure the plan can be resolved. It also fixes some miswritten optimizer tests.

Why are the changes needed?

It's error-prone if the analyze method can return an unresolved plan.

Does this PR introduce any user-facing change?

no

How was this patch tested?

test only

… is analyzed

This PR updates the `analyze` method to make sure the plan can be resolved. It also fixes some miswritten optimizer tests.

It's error-prone if the `analyze` method can return an unresolved plan.

no

test only

Closes apache#29349 from cloud-fan/test.

Authored-by: Wenchen Fan <wenchen@databricks.com>
Signed-off-by: Wenchen Fan <wenchen@databricks.com>
@cloud-fan
Copy link
Contributor Author

cc @dongjoon-hyun

@dongjoon-hyun
Copy link
Member

dongjoon-hyun commented Aug 10, 2020

Got it. Thank you for this backporting, @cloud-fan .

Copy link
Member

@dongjoon-hyun dongjoon-hyun left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1, LGTM (Pending Jenkins)

@SparkQA
Copy link

SparkQA commented Aug 10, 2020

Test build #127291 has finished for PR 29400 at commit ac89655.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@dongjoon-hyun
Copy link
Member

Merged to branch-3.0.

dongjoon-hyun pushed a commit that referenced this pull request Aug 10, 2020
… plan is analyzed

### What changes were proposed in this pull request?

backport #29349 to 3.0.
This PR updates the `analyze` method to make sure the plan can be resolved. It also fixes some miswritten optimizer tests.

### Why are the changes needed?

It's error-prone if the `analyze` method can return an unresolved plan.

### Does this PR introduce _any_ user-facing change?

no

### How was this patch tested?

test only

Closes #29400 from cloud-fan/backport.

Authored-by: Wenchen Fan <wenchen@databricks.com>
Signed-off-by: Dongjoon Hyun <dongjoon@apache.org>
@dongjoon-hyun
Copy link
Member

Thank you so much, @cloud-fan !

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
3 participants