Regenerate PySpark API documentation for Spark 3.2.1#381
Regenerate PySpark API documentation for Spark 3.2.1#381xinrong-meng wants to merge 3 commits intoapache:asf-sitefrom
Conversation
|
Out of curiosity what creates all the changes - is it just formatting or any substantive change? |
dongjoon-hyun
left a comment
There was a problem hiding this comment.
This is wrong, isn't it? @xinrong-databricks
- <title>abc — PySpark 3.2.1 documentation</title>
+ <title>abc — PySpark master documentation</title>
cc @HyukjinKwon and @gengliangwang
HyukjinKwon
left a comment
There was a problem hiding this comment.
We should regenerate the docs by setting GIT_HASH and RELEASE_VERSION environments properly (see https://github.com/apache/spark/blob/master/python/docs/source/conf.py). BTW, I wonder why this failed to generate the docs this time .. I fixed it here apache/spark@03750c0
Same question here. |
|
Sorry for the confusion. I added PR descriptions. Let me know if there are any questions. |
|
It's hard to evaluate by looking at the diff but if it was merely regenerated from the 3.2.1 release to fix rendering of links, that seems OK |
|
Merged. |
This PR regenerates PySpark API documentation for Spark 3.2.1.
Specifically, files under https://github.com/apache/spark-website/tree/asf-site/site/docs/3.2.1/api/python have been updated.
Currently, API of pandas API on Spark 3.2.1 are not associated with links, for example, API under https://spark.apache.org/docs/latest/api/python/reference/pyspark.pandas/series.html. So we wanted to regenerate it with correct dependencies.
How it gets updated:
v3.2.1Sparkspark/python/docs/build/htmltospark-website/site/docs/3.2.1/api/python.