Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[SPARK-47875][CORE] Remove spark.deploy.recoverySerializer #46087

Closed
wants to merge 3 commits into from

Conversation

dongjoon-hyun
Copy link
Member

@dongjoon-hyun dongjoon-hyun commented Apr 16, 2024

What changes were proposed in this pull request?

This is a logical revert of SPARK-46205

Why are the changes needed?

The initial implementation didn't handle the class initialization logic properly.
Until we have a fix, I'd like to revert this from master branch.

Does this PR introduce any user-facing change?

No, this is not released yet.

How was this patch tested?

Pass the CIs.

Was this patch authored or co-authored using generative AI tooling?

No.

@dongjoon-hyun
Copy link
Member Author

Sorry but could you review this reverting PR, @viirya ? While I've running this, I found my mistake.

@viirya
Copy link
Member

viirya commented Apr 16, 2024

Pending CI. Thanks @dongjoon-hyun

@dongjoon-hyun
Copy link
Member Author

Thank you so much for swift help. I'll make it sure that all CIes passes.

Copy link
Member

@viirya viirya left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

In original PR, there are a few change to FileSystemPersistenceEngine.scala, do we need to revert it too?

@dongjoon-hyun
Copy link
Member Author

Yes, there are other commits about compression code and some neutral changes. I believe it will be okay and the final goal is to bring it back again.

@dongjoon-hyun
Copy link
Member Author

I removed the missed SPARK-46205 test case.

@dongjoon-hyun dongjoon-hyun deleted the SPARK-47875 branch April 17, 2024 00:57
szehon-ho pushed a commit to szehon-ho/spark that referenced this pull request Aug 7, 2024
This is a logical revert of SPARK-46205
- apache#44113
- apache#44118

The initial implementation didn't handle the class initialization logic properly.
Until we have a fix, I'd like to revert this from `master` branch.

No, this is not released yet.

Pass the CIs.

No.

Closes apache#46087 from dongjoon-hyun/SPARK-47875.

Authored-by: Dongjoon Hyun <dhyun@apple.com>
Signed-off-by: Dongjoon Hyun <dhyun@apple.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants