Skip to content

[SPARK-38417][CORE] Remove Experimental from RDD.cleanShuffleDependencies API#35736

Closed
dongjoon-hyun wants to merge 1 commit intoapache:masterfrom
dongjoon-hyun:SPARK-38417
Closed

[SPARK-38417][CORE] Remove Experimental from RDD.cleanShuffleDependencies API#35736
dongjoon-hyun wants to merge 1 commit intoapache:masterfrom
dongjoon-hyun:SPARK-38417

Conversation

@dongjoon-hyun
Copy link
Member

@dongjoon-hyun dongjoon-hyun commented Mar 4, 2022

What changes were proposed in this pull request?

This PR aims to remove Experimental from RDD.cleanShuffleDependencies API at Apache Spark 3.3.

Why are the changes needed?

This API has been used since Apache Spark 3.1.0.

Does this PR introduce any user-facing change?

No. This has been used for a long time in 3.1.1 ~ 3.2.1 since April 7, 2020.

How was this patch tested?

Manual review because this is a human-oriented doc change.

@github-actions github-actions bot added the CORE label Mar 4, 2022
@dongjoon-hyun
Copy link
Member Author

cc @holdenk , @viirya , @sunchao

Copy link
Member

@viirya viirya left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Seems okay. It exists for a long time, and I don't remember there is an issue reported for it.

Copy link
Member

@sunchao sunchao left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM 2

Copy link
Member Author

@dongjoon-hyun dongjoon-hyun left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you so much, @viirya and @sunchao .

@holdenk
Copy link
Contributor

holdenk commented Mar 5, 2022

LGTM as this keeps the dev api annotation.

@dongjoon-hyun
Copy link
Member Author

Yes, right. Thank you, @holdenk .
Merged to master for Apache Spark 3.3.0.

@dongjoon-hyun dongjoon-hyun deleted the SPARK-38417 branch March 5, 2022 00:59
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants