Skip to content

Conversation

@sryza
Copy link
Contributor

@sryza sryza commented Nov 25, 2025

What changes were proposed in this pull request?

Includes the pyspark.pipelines package in the API reference.

Why are the changes needed?

To document pyspark.pipelines functionality.

Does this PR introduce any user-facing change?

No

How was this patch tested?

Was this patch authored or co-authored using generative AI tooling?

@dongjoon-hyun dongjoon-hyun changed the title [SPARK-54503] Include pyspark.pipelines in API reference [SPARK-54503][PYTHON] Include pyspark.pipelines in API reference Nov 25, 2025
@dongjoon-hyun dongjoon-hyun changed the title [SPARK-54503][PYTHON] Include pyspark.pipelines in API reference [SPARK-54503][PYTHON][DOCS] Include pyspark.pipelines in API reference Nov 25, 2025
Copy link
Member

@dongjoon-hyun dongjoon-hyun left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1, LGTM (Pending CIs). Thank you, @sryza .

@dongjoon-hyun dongjoon-hyun self-assigned this Nov 25, 2025
dongjoon-hyun pushed a commit that referenced this pull request Nov 25, 2025
### What changes were proposed in this pull request?

Includes the pyspark.pipelines package in the API reference.

### Why are the changes needed?

To document pyspark.pipelines functionality.

### Does this PR introduce _any_ user-facing change?

No

### How was this patch tested?

### Was this patch authored or co-authored using generative AI tooling?

Closes #53213 from sryza/api-reference.

Authored-by: Sandy Ryza <sandy.ryza@databricks.com>
Signed-off-by: Dongjoon Hyun <dongjoon@apache.org>
(cherry picked from commit 64c9d89)
Signed-off-by: Dongjoon Hyun <dongjoon@apache.org>
@dongjoon-hyun
Copy link
Member

Merged to master/4.1 for Apache Spark 4.1.0.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants