Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[SPARK-30423][SQL] Deprecate UserDefinedAggregateFunction #27193

Closed
wants to merge 2 commits into from

Conversation

erikerlandson
Copy link
Contributor

What changes were proposed in this pull request?

  • Annotate UserDefinedAggregateFunction as deprecated by SPARK-27296
  • Update user doc examples to reflect new ability to register typed Aggregator[IN, BUF, OUT] as an untyped aggregating UDF

Why are the changes needed?

UserDefinedAggregateFunction is being deprecated

Does this PR introduce any user-facing change?

Changes are to user documentation, and deprecation annotations.

How was this patch tested?

Testing was via package build to verify doc generation, deprecation warnings, and successful example compilation.

@cloud-fan
Copy link
Contributor

OK to test

@SparkQA
Copy link

SparkQA commented Jan 13, 2020

Test build #116650 has finished for PR 27193 at commit ea3fcd9.

  • This patch passes all tests.
  • This patch merges cleanly.
  • This patch adds the following public classes (experimental):
  • public static class Average implements Serializable
  • public static class MyAverage extends Aggregator<Long, Average, Double>
  • case class Average(var sum: Long, var count: Long)

@cloud-fan
Copy link
Contributor

thanks, merging to master!

@cloud-fan cloud-fan closed this in 176b696 Jan 14, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
4 participants