Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[#1064] improvement(tez): Make shuffle data send thread pool configurable in WriteBufferManager. #1065

Merged

Conversation

zhuyaogai
Copy link
Contributor

@zhuyaogai zhuyaogai commented Aug 2, 2023

What changes were proposed in this pull request?

Currently the number of threads in the send data thread pool in WriteBufferManager is fixed at 1, making it configurable.

Why are the changes needed?

Fix: #1064

Does this PR introduce any user-facing change?

No.

How was this patch tested?

Existing tests can cover it.

jerqi
jerqi previously approved these changes Aug 2, 2023
Copy link
Contributor

@jerqi jerqi left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, thanks @zhuyaogai , wait for CI.

@jerqi
Copy link
Contributor

jerqi commented Aug 2, 2023

You should run the command to fix style issues.

mvn spotless:apply -Pspark3 -Pspark2 -Ptez -Pmr -Phadoop2.8

@jerqi jerqi merged commit d149d57 into apache:master Aug 2, 2023
30 checks passed
@jerqi
Copy link
Contributor

jerqi commented Aug 2, 2023

Thanks @zhuyaogai , merged to master.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants