Skip to content

[SPARK-50265][CONNECT] Support spark.udf.registerJavaUdf in Connect#49759

Closed
hvanhovell wants to merge 2 commits intoapache:masterfrom
hvanhovell:SPARK-50265
Closed

[SPARK-50265][CONNECT] Support spark.udf.registerJavaUdf in Connect#49759
hvanhovell wants to merge 2 commits intoapache:masterfrom
hvanhovell:SPARK-50265

Conversation

@hvanhovell
Copy link
Contributor

What changes were proposed in this pull request?

This PR adds support for UDFRegistration.registerJavaUdf(..) to the Connect Scala Client.

Why are the changes needed?

This increase compatibility between the Classic and Connect implementations.

Does this PR introduce any user-facing change?

Yes. It enables Scala client users to use UDFRegistration.registerJavaUdf(..).

How was this patch tested?

I have added a Unit tests to the UserDefinedFunctionE2ETestSuite.

Was this patch authored or co-authored using generative AI tooling?

Copy link
Contributor

@LuciferYang LuciferYang left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, pending tests

@hvanhovell
Copy link
Contributor Author

Merging to master/4.0.

@asfgit asfgit closed this in bf442c5 Feb 1, 2025
asfgit pushed a commit that referenced this pull request Feb 1, 2025
### What changes were proposed in this pull request?
This PR adds support for `UDFRegistration.registerJavaUdf(..)` to the Connect Scala Client.

### Why are the changes needed?
This increase compatibility between the Classic and Connect implementations.

### Does this PR introduce _any_ user-facing change?
Yes. It enables Scala client users to use `UDFRegistration.registerJavaUdf(..)`.

### How was this patch tested?
I have added a Unit tests to the `UserDefinedFunctionE2ETestSuite`.

### Was this patch authored or co-authored using generative AI tooling?

Closes #49759 from hvanhovell/SPARK-50265.

Authored-by: Herman van Hovell <herman@databricks.com>
Signed-off-by: Herman van Hovell <herman@databricks.com>
(cherry picked from commit bf442c5)
Signed-off-by: Herman van Hovell <herman@databricks.com>
zifeif2 pushed a commit to zifeif2/spark that referenced this pull request Nov 14, 2025
### What changes were proposed in this pull request?
This PR adds support for `UDFRegistration.registerJavaUdf(..)` to the Connect Scala Client.

### Why are the changes needed?
This increase compatibility between the Classic and Connect implementations.

### Does this PR introduce _any_ user-facing change?
Yes. It enables Scala client users to use `UDFRegistration.registerJavaUdf(..)`.

### How was this patch tested?
I have added a Unit tests to the `UserDefinedFunctionE2ETestSuite`.

### Was this patch authored or co-authored using generative AI tooling?

Closes apache#49759 from hvanhovell/SPARK-50265.

Authored-by: Herman van Hovell <herman@databricks.com>
Signed-off-by: Herman van Hovell <herman@databricks.com>
(cherry picked from commit f0dbe48)
Signed-off-by: Herman van Hovell <herman@databricks.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants