Skip to content

[SPARK-XXXXX][PYTHON][DOCS] Added Returns and See Also sections in pyspark.sql.functions documentation. - #57529

Open
art000109 wants to merge 8 commits into
apache:masterfrom
art000109:master
Open

[SPARK-XXXXX][PYTHON][DOCS] Added Returns and See Also sections in pyspark.sql.functions documentation.#57529
art000109 wants to merge 8 commits into
apache:masterfrom
art000109:master

Conversation

@art000109

@art000109 art000109 commented Jul 25, 2026

Copy link
Copy Markdown
Contributor

What changes were proposed in this pull request?

Fixed some links in pyspark.sql.DataFrame, TVF and Pandas-On-Spark-DataFrame, SparkSession classes.
Added Returns and See Also sections in pyspark.sql.functions documentation.
The documentation for some st_ functions corrected.
Shortened links in pandas.group_ops, pandas.functions, functions, SparkContext, SparkSession, DataFrame

Why are the changes needed?

The documentation will be more comprehensive.

Does this PR introduce any user-facing change?

No. This is a documentation-only change.

How was this patch tested?

Manual review.

Was this patch authored or co-authored using generative AI tooling?

No.

…sql.functions documentation.

### What changes were proposed in this pull request?
Fixed some links in pyspark.sql.DataFrame, TVF and Pandas-On-Spark-DataFrame classes.
Added Returns and See Also sections in pyspark.sql.functions documentation.
The documentation for some st_ functions corrected.

### Why are the changes needed?
The documentation will be more comprehensive.

### Does this PR introduce any user-facing change?
No. This is a documentation-only change.

### How was this patch tested?
Manual review.

### Was this patch authored or co-authored using generative AI tooling?
No.
@art000109
art000109 marked this pull request as ready for review July 25, 2026 15:11
@art000109

Copy link
Copy Markdown
Contributor Author

@HyukjinKwon Hi! This PR is synchronized with #57359 and follows up on another one #57185. References to DataStreamReader/Writer have been removed. Is it possible to trigger the GitHub Pages deployment CI and file a JIRA? I am unable to create a task in JIRA.

Returns
-------
:class:`pyspark.sql.conf.RuntimeConfig`
:class:`~pyspark.sql.conf.RuntimeConfig`

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Are these required changes?

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

No, this is a cosmetic change so that the web version of the documentation does not show the entire class, but only RuntimeConfig, but the link to it remains

@HyukjinKwon

Copy link
Copy Markdown
Member

Let's file a JIRA

@art000109 art000109 changed the title [MINOR][PYTHON][DOCS] Added Returns and See Also sections in pyspark.sql.functions documentation. [SPARK-XXXXX][PYTHON][DOCS] Added Returns and See Also sections in pyspark.sql.functions documentation. Jul 27, 2026
@art000109

art000109 commented Jul 27, 2026

Copy link
Copy Markdown
Contributor Author

@HyukjinKwon I’ve reviewed the documentation tasks in Jira. I suppose we can also close SPARK-48828 [c757a5f, previous PR #47244] and SPARK-57095 [duplicate of SPARK-57116 SPARK-54785, #53548].

@art000109

Copy link
Copy Markdown
Contributor Author

@uros-b Hi! Can I ask you to do a review too?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants