Skip to content

[SPARK-56359][PYTHON] Remove unused ArrowStreamArrowUDFSerializer#55212

Closed
Yicong-Huang wants to merge 1 commit intoapache:masterfrom
Yicong-Huang:SPARK-56359/cleanup/arrow-stream-arrow-udf-serializer
Closed

[SPARK-56359][PYTHON] Remove unused ArrowStreamArrowUDFSerializer#55212
Yicong-Huang wants to merge 1 commit intoapache:masterfrom
Yicong-Huang:SPARK-56359/cleanup/arrow-stream-arrow-udf-serializer

Conversation

@Yicong-Huang
Copy link
Copy Markdown
Contributor

What changes were proposed in this pull request?

Remove ArrowStreamArrowUDFSerializer from serializers.py. This class is no longer used after:

  • SPARK-55577 refactored SQL_SCALAR_ARROW_ITER_UDF to use ArrowStreamSerializer directly
  • SPARK-56348 deleted ArrowBatchUDFSerializer (child)
  • SPARK-56349 deleted ArrowStreamAggArrowUDFSerializer (child)

Why are the changes needed?

Dead code cleanup. Part of SPARK-55384 (Refactor PySpark Serializers).

Does this PR introduce any user-facing change?

No.

How was this patch tested?

Existing tests. No behavior change.

Was this patch authored or co-authored using generative AI tooling?

No

@HyukjinKwon
Copy link
Copy Markdown
Member

Merged to master.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants