Skip to content

[SPARK-45448][PYTHON] Fix imports according to PEP8: pyspark.testing, pyspark.mllib, pyspark.resource and pyspark.streaming#43256

Closed
HyukjinKwon wants to merge 1 commit intoapache:masterfrom
HyukjinKwon:SPARK-45448
Closed

[SPARK-45448][PYTHON] Fix imports according to PEP8: pyspark.testing, pyspark.mllib, pyspark.resource and pyspark.streaming#43256
HyukjinKwon wants to merge 1 commit intoapache:masterfrom
HyukjinKwon:SPARK-45448

Conversation

@HyukjinKwon
Copy link
Member

@HyukjinKwon HyukjinKwon commented Oct 7, 2023

What changes were proposed in this pull request?

This PR proposes to fix imports according to PEP8 in pyspark.testing, pyspark.mllib, pyspark.resource and pyspark.streaming, see https://peps.python.org/pep-0008/#imports.

Why are the changes needed?

I have not been fixing them as they are too minor. However, this practice is being propagated across the whole PySpark packages, and I think we should fix them all so other users do not follow the non-standard practice.

Does this PR introduce any user-facing change?

No.

How was this patch tested?

Existing linters and tests should cover.

Was this patch authored or co-authored using generative AI tooling?

No.

@HyukjinKwon
Copy link
Member Author

cc @zhengruifeng @WeichenXu123 Fyi

Copy link
Member

@dongjoon-hyun dongjoon-hyun left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1, LGTM. Thank you, @HyukjinKwon .
The pyspark-connect module failure is irrelevant to this PR.

@HyukjinKwon HyukjinKwon deleted the SPARK-45448 branch January 15, 2024 00:51
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants