Skip to content

Conversation

@dongjoon-hyun
Copy link
Member

@dongjoon-hyun dongjoon-hyun commented Nov 10, 2025

What changes were proposed in this pull request?

This PR aims to simplify pyspark/util.py doctests by removing Python 3.9+ condition.

Why are the changes needed?

Since Apache Spark 4.1.0 dropped Python 3.9 support, we can assume that this doctests are Python 3.10+ always.

Does this PR introduce any user-facing change?

No, this is a test change.

How was this patch tested?

Pass the CIs.

Was this patch authored or co-authored using generative AI tooling?

No.

@dongjoon-hyun
Copy link
Member Author

Thank you, @HyukjinKwon .

dongjoon-hyun added a commit that referenced this pull request Nov 10, 2025
…emoving Python 3.9+ condition

### What changes were proposed in this pull request?

This PR aims to simplify `pyspark/util.py` doctests by removing Python 3.9+ condition.

### Why are the changes needed?

Since Apache Spark 4.1.0 dropped `Python 3.9` support, we can assume that this doctests are Python 3.10+ always.
- #51416
- #51259
- #52974

### Does this PR introduce _any_ user-facing change?

No, this is a test change.

### How was this patch tested?

Pass the CIs.

### Was this patch authored or co-authored using generative AI tooling?

No.

Closes #52975 from dongjoon-hyun/SPARK-54278.

Authored-by: Dongjoon Hyun <dongjoon@apache.org>
Signed-off-by: Dongjoon Hyun <dongjoon@apache.org>
(cherry picked from commit dbc643e)
Signed-off-by: Dongjoon Hyun <dongjoon@apache.org>
@dongjoon-hyun
Copy link
Member Author

Merged to master/4.1.

@dongjoon-hyun dongjoon-hyun deleted the SPARK-54278 branch November 10, 2025 18:03
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants