-
Notifications
You must be signed in to change notification settings - Fork 28.2k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[SPARK-47875][CORE] Remove spark.deploy.recoverySerializer
#46087
Conversation
Sorry but could you review this reverting PR, @viirya ? While I've running this, I found my mistake. |
Pending CI. Thanks @dongjoon-hyun |
Thank you so much for swift help. I'll make it sure that all CIes passes. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
In original PR, there are a few change to FileSystemPersistenceEngine.scala
, do we need to revert it too?
Yes, there are other commits about |
I removed the missed SPARK-46205 test case. |
This is a logical revert of SPARK-46205 - apache#44113 - apache#44118 The initial implementation didn't handle the class initialization logic properly. Until we have a fix, I'd like to revert this from `master` branch. No, this is not released yet. Pass the CIs. No. Closes apache#46087 from dongjoon-hyun/SPARK-47875. Authored-by: Dongjoon Hyun <dhyun@apple.com> Signed-off-by: Dongjoon Hyun <dhyun@apple.com>
What changes were proposed in this pull request?
This is a logical revert of SPARK-46205
PersistenceEngine
performance withKryoSerializer
#44113Why are the changes needed?
The initial implementation didn't handle the class initialization logic properly.
Until we have a fix, I'd like to revert this from
master
branch.Does this PR introduce any user-facing change?
No, this is not released yet.
How was this patch tested?
Pass the CIs.
Was this patch authored or co-authored using generative AI tooling?
No.