[SPARK-36977][DOCS][PYTHON] Drop references to Python 3.6 support in docs and python/docs #34242
Conversation
| Spark {{site.SPARK_VERSION}} works with Python 3.6+. It can use the standard CPython interpreter, | ||
| so C libraries like NumPy can be used. It also works with PyPy 2.3+. | ||
| Spark {{site.SPARK_VERSION}} works with Python 3.7+. It can use the standard CPython interpreter, | ||
| so C libraries like NumPy can be used. It also works with PyPy 7.3.6+. |
There was a problem hiding this comment.
Note: Updated PyPy version (it seems like it hasn't been updated in ages).
There was a problem hiding this comment.
In practice, we could probably target a bit lower (seems like 7.3.4 is the first version with stable 3.7 support).
|
Test build #144087 has finished for PR 34242 at commit
|
|
Kubernetes integration test starting |
|
Kubernetes integration test status failure |
|
We'll have to fix setup.py for Python version, and remove things like https://github.com/apache/spark/blob/master/python/pyspark/context.py#L233-L239 but they can be done separately. Merged to master. |
|
Thanks @HyukjinKwon
Yeah, I wanted to avoid code changes here. There are things you mentioned, but also some pieces of code, that target earlier Python versions, which could be safely removed. |
What changes were proposed in this pull request?
Remove or adjust references to Python 3.6 in
docsandpython/docs.Why are the changes needed?
To reflect removal of support in Spark 3.3 (SPARK-36145).
Does this PR introduce any user-facing change?
Updated documentation only.
How was this patch tested?
Manual rendering of individual docs.