Skip to content

[SPARK-49851][CONNECT][PYTHON] API compatibility check for Protobuf#48576

Closed
itholic wants to merge 1 commit intoapache:masterfrom
itholic:compat_protobuf
Closed

[SPARK-49851][CONNECT][PYTHON] API compatibility check for Protobuf#48576
itholic wants to merge 1 commit intoapache:masterfrom
itholic:compat_protobuf

Conversation

@itholic
Copy link
Contributor

@itholic itholic commented Oct 21, 2024

What changes were proposed in this pull request?

This PR proposes to add API compatibility check for Spark SQL Protobuf functions

Why are the changes needed?

To guarantee of the same behavior between Spark Classic and Spark Connect

Does this PR introduce any user-facing change?

No

How was this patch tested?

Added UTs

Was this patch authored or co-authored using generative AI tooling?

No

@itholic itholic closed this in 2632544 Oct 21, 2024
@itholic
Copy link
Contributor Author

itholic commented Oct 21, 2024

Merged to master. Thanks @zhengruifeng for review!

ericm-db pushed a commit to ericm-db/spark that referenced this pull request Oct 22, 2024
### What changes were proposed in this pull request?

This PR proposes to add API compatibility check for Spark SQL Protobuf functions

### Why are the changes needed?

To guarantee of the same behavior between Spark Classic and Spark Connect

### Does this PR introduce _any_ user-facing change?

No

### How was this patch tested?

Added UTs

### Was this patch authored or co-authored using generative AI tooling?

No

Closes apache#48576 from itholic/compat_protobuf.

Authored-by: Haejoon Lee <haejoon.lee@databricks.com>
Signed-off-by: Haejoon Lee <haejoon.lee@databricks.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants