diff --git a/python/docs/source/tutorial/sql/arrow_pandas.rst b/python/docs/source/tutorial/sql/arrow_pandas.rst index 386fe83b4821..608307266f1f 100644 --- a/python/docs/source/tutorial/sql/arrow_pandas.rst +++ b/python/docs/source/tutorial/sql/arrow_pandas.rst @@ -379,15 +379,10 @@ and tuples to strings can yield ambiguous results. Arrow Python UDFs, on the oth capabilities to standardize type coercion and address these issues effectively. Type coercion differences are introduced by the following changes: -* Since Spark 4.2, Arrow optimization is enabled by default for regular Python UDFs. -The full type coercion difference is summarized in the tables `here `__. -To disable Arrow optimization, set ``spark.sql.execution.pythonUDF.arrow.enabled`` to false. -* Since Spark 4.1, unnecessary conversion to pandas instances in Arrow-optimized Python UDF is removed in the serializer -when ``spark.sql.legacy.execution.pythonUDF.pandas.conversion.enabled`` is disabled. +* Since Spark 4.2, Arrow optimization is enabled by default for regular Python UDFs. The full type coercion difference is summarized in the tables `here `__. To disable Arrow optimization, set ``spark.sql.execution.pythonUDF.arrow.enabled`` to false. -The behavior difference is summarized in the tables `here `__. -To restore the legacy behavior, set ``spark.sql.legacy.execution.pythonUDF.pandas.conversion.enabled`` to true. +* Since Spark 4.1, unnecessary conversion to pandas instances in Arrow-optimized Python UDF is removed in the serializer when ``spark.sql.legacy.execution.pythonUDF.pandas.conversion.enabled`` is disabled. The behavior difference is summarized in the tables `here `__. To restore the legacy behavior, set ``spark.sql.legacy.execution.pythonUDF.pandas.conversion.enabled`` to true. Usage Notes -----------