Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Consider rebalance_timeout on join request #943

Closed
wants to merge 1 commit into from

Conversation

abicky
Copy link
Contributor

@abicky abicky commented May 17, 2022

This PR resolves #941.

As the coordinator waits for each member to rejoin when rebalancing the group, the timeout of join request should be greater than rebalance_timeout.

rebalance_timeout_ms : The maximum time in milliseconds that the coordinator will wait for each member to rejoin when rebalancing the group.

cf. https://kafka.apache.org/protocol.html#The_Messages_JoinGroup

Otherwise, each member might send join requests over and over, and as a result, the following problems occur:

  • Some partitions are never processed until session_timeout passes
  • It takes much time for rebalance that occurs in a short time to finish

This commit resolves zendesk#941.

As the coordinator waits for each member to rejoin when rebalancing
the group, the timeout of join request should be greater than
rebalance_timeout. Otherwise, each member might send join requests
over and over, and as a result, the following problems occur:

* Some partitions are never processed until session_timeout passes
* It takes much time for rebalance that occurs in a short time to finish
@abicky abicky force-pushed the consider-rebalance-timeout branch from 135b10a to 310b483 Compare June 11, 2022 09:05
@abicky
Copy link
Contributor Author

abicky commented Dec 9, 2022

I'll close this PR because this PR will never seem to be merged cf. a5491ac.

@abicky abicky closed this Dec 9, 2022
@abicky abicky deleted the consider-rebalance-timeout branch March 20, 2023 02:36
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Join request timeout doesn't consider rebalance_timeout
1 participant