Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[SPARK-45965][DOCS][FOLLOW-UP] Document DSv2 partitioning expressions moved to functions.partitioning #43887

Closed
wants to merge 1 commit into from

Conversation

HyukjinKwon
Copy link
Member

What changes were proposed in this pull request?

This PR is a followup of #43858 that documents the newly moved functions:

  • org.apache.spark.sql.functions.partitioning.* becomes Scala-specific because they can't be used in Java side.
  • org.apache.spark.sql.functions.* remain as Java-specific.
  • Document pyspark.sql.functions.partitioning.*, and remove deprecated pyspark.sql.functions.*.

Why are the changes needed?

For users to use the moved functions.

Does this PR introduce any user-facing change?

The main change has not been released out yet, so no. It adds the newly moved functions into the docs.

How was this patch tested?

Manually tested by building docs (Python).

Was this patch authored or co-authored using generative AI tooling?

No.

@HyukjinKwon
Copy link
Member Author

@HyukjinKwon
Copy link
Member Author

Merged to master.

@HyukjinKwon HyukjinKwon deleted the SPARK-45965-folowup branch January 15, 2024 00:51
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants