From acc37531deb9a01555c7ce691aab2629f42c25b0 Mon Sep 17 00:00:00 2001 From: Hyukjin Kwon Date: Mon, 13 May 2024 13:43:27 +0800 Subject: [PATCH] [SPARK-47993][PYTHON][FOLLOW-UP] Update migration guide about Python 3.8 dropped ### What changes were proposed in this pull request? This PR is a followup of https://github.com/apache/spark/pull/46228 that updates migration guide about Python 3.8 being dropped. ### Why are the changes needed? To guide end users about the migration to Spark 4.0. ### Does this PR introduce _any_ user-facing change? Yes, it fixes the documentation. ### How was this patch tested? CI in this PR. ### Was this patch authored or co-authored using generative AI tooling? No. Closes #46545 from HyukjinKwon/SPARK-47993-followup. Authored-by: Hyukjin Kwon Signed-off-by: yangjie01 --- python/docs/source/migration_guide/pyspark_upgrade.rst | 1 + 1 file changed, 1 insertion(+) diff --git a/python/docs/source/migration_guide/pyspark_upgrade.rst b/python/docs/source/migration_guide/pyspark_upgrade.rst index 26fc634307879..0f252519e7daf 100644 --- a/python/docs/source/migration_guide/pyspark_upgrade.rst +++ b/python/docs/source/migration_guide/pyspark_upgrade.rst @@ -22,6 +22,7 @@ Upgrading PySpark Upgrading from PySpark 3.5 to 4.0 --------------------------------- +* In Spark 4.0, Python 3.8 support was dropped in PySpark. * In Spark 4.0, the minimum supported version for Pandas has been raised from 1.0.5 to 2.0.0 in PySpark. * In Spark 4.0, the minimum supported version for Numpy has been raised from 1.15 to 1.21 in PySpark. * In Spark 4.0, the minimum supported version for PyArrow has been raised from 4.0.0 to 10.0.0 in PySpark.