Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

KAFKA-7152: Avoid moving a replica out of isr if its LEO equals leader's LEO #5412

Closed
wants to merge 1 commit into from

Conversation

hzxa21
Copy link
Contributor

@hzxa21 hzxa21 commented Jul 21, 2018

When there are many inactive partitions in the cluster, we observed constant churn of URP in the cluster even if follower can catch up with leader's byte-in-rate because leader broker frequently moves replicas of inactive partitions out of ISR. This PR mitigates this issue by not moving replica out of ISR if follower's LEO == leader's LEO.

Committer Checklist (excluded from commit message)

  • Verify design and implementation
  • Verify test coverage and CI build status
  • Verify documentation (including upgrade notes)

@hzxa21
Copy link
Contributor Author

hzxa21 commented Jul 21, 2018

@lindong28 Could you help review this PR. Thanks!

@lindong28 lindong28 self-assigned this Jul 21, 2018
@lindong28
Copy link
Member

Thanks @hzxa21. It seems that the description of the PR is a bit confusing. This patch is typically useful when there are a large number of inactive partitions. But The change of this PR will take effect whether or not the partitions count per broker is relatively large. Can you update the description as appropriate?

@hzxa21
Copy link
Contributor Author

hzxa21 commented Jul 21, 2018

@lindong28 Thanks for pointing out. I have updated the description accordingly.

@lindong28 lindong28 changed the title KAFKA-7152: Avoid kicking a replic out of isr if its LEO equals leader's LEO KAFKA-7152: Avoid moving a replica out of isr if its LEO equals leader's LEO Jul 21, 2018
@lindong28
Copy link
Member

@hzxa21 Thanks for the patch. LGTM. I made some change to the description. Merged to trunk.

@lindong28 lindong28 closed this in 9a7f29c Jul 21, 2018
@hzxa21
Copy link
Contributor Author

hzxa21 commented Jul 21, 2018

@lindong28 Thanks, Dong!

@hachikuji
Copy link
Contributor

Nice find!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
3 participants