Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[SPARK-31010][SQL][DOC][FOLLOW-UP] Improve deprecated warning message for untyped scala udf #28311

Closed
wants to merge 5 commits into from

Conversation

Ngone51
Copy link
Member

@Ngone51 Ngone51 commented Apr 23, 2020

What changes were proposed in this pull request?

Give more friendly warning message/migration guide of deprecated scala udf to users.

Why are the changes needed?

User can not distinguish function signature between typed and untyped scala udf. Instead, we shall tell user what to do directly.

Does this PR introduce any user-facing change?

No, it's newly added in Spark 3.0.

How was this patch tested?

Pass Jenkins.

@Ngone51 Ngone51 changed the title [SPARK-31010][SQL[DOC] improve [SPARK-31010][SQL][DOC][FOLLOW-UP] improve Apr 23, 2020
@Ngone51 Ngone51 changed the title [SPARK-31010][SQL][DOC][FOLLOW-UP] improve [SPARK-31010][SQL][DOC][FOLLOW-UP] Improve deprecated warning message for untyped scala udf Apr 23, 2020
@SparkQA
Copy link

SparkQA commented Apr 23, 2020

Test build #121665 has started for PR 28311 at commit 09ab893.

docs/sql-migration-guide.md Outdated Show resolved Hide resolved
@Ngone51
Copy link
Member Author

Ngone51 commented Apr 23, 2020

cc @cloud-fan @gatorsmile

@SparkQA
Copy link

SparkQA commented Apr 23, 2020

Test build #121667 has finished for PR 28311 at commit 872ea0d.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@SparkQA
Copy link

SparkQA commented Apr 23, 2020

Test build #121680 has finished for PR 28311 at commit 47783f3.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

Copy link
Member

@HyukjinKwon HyukjinKwon left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@SparkQA
Copy link

SparkQA commented Apr 24, 2020

Test build #121711 has finished for PR 28311 at commit da33825.

  • This patch fails due to an unknown error code, -9.
  • This patch merges cleanly.
  • This patch adds no public classes.

@SparkQA
Copy link

SparkQA commented Apr 24, 2020

Test build #121716 has finished for PR 28311 at commit d868e2c.

  • This patch fails due to an unknown error code, -9.
  • This patch merges cleanly.
  • This patch adds no public classes.

@HyukjinKwon
Copy link
Member

retest this please

@HyukjinKwon
Copy link
Member

Let me just merge this since the related checks such as build and linter passed.

@HyukjinKwon
Copy link
Member

Merged to master and branch-3.0.

HyukjinKwon pushed a commit that referenced this pull request Apr 24, 2020
… for untyped scala udf

### What changes were proposed in this pull request?

Give more friendly warning message/migration guide of deprecated scala udf to users.

### Why are the changes needed?

User can not distinguish function signature between typed and untyped scala udf. Instead, we shall tell user what to do directly.

### Does this PR introduce any user-facing change?

No, it's newly added in Spark 3.0.

### How was this patch tested?

Pass Jenkins.

Closes #28311 from Ngone51/update_udf_doc.

Authored-by: yi.wu <yi.wu@databricks.com>
Signed-off-by: HyukjinKwon <gurwls223@apache.org>
(cherry picked from commit 463c544)
Signed-off-by: HyukjinKwon <gurwls223@apache.org>
@SparkQA
Copy link

SparkQA commented Apr 24, 2020

Test build #121736 has finished for PR 28311 at commit d868e2c.

  • This patch fails Spark unit tests.
  • This patch merges cleanly.
  • This patch adds no public classes.

@Ngone51
Copy link
Member Author

Ngone51 commented Apr 24, 2020

thanks all!!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
5 participants