mimic: qa/suites/rados/multimon/tasks/mon_clock_with_skews: disable ntpd etc #34370
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sometimes the clock skew prevents the mon quorum from making progress and processing the osd boot messages. Signed-off-by: Sage Weil <sage@redhat.com> (cherry picked from commit 1991faa)
Signed-off-by: Sage Weil <sage@redhat.com> (cherry picked from commit 8d137b9)
If the leader is the one with the accurate clock, it can still form quorum, but if the leader has the skewed clock, all other mons appear skewed from its perspective and no quorum is formed. This leads to intermittent failures, depending on the non-deterministic teuthology deployment order and how the mon IPs sort. Fix by reducing the skew. This is enough skew to trigger a warning, but not enough that it will break quorum. This ensures that the parts of the teuthology test that issue random mon commands won't fail (e.g., 'ceph osd dump'). Fixes: http://tracker.ceph.com/issues/40112 Signed-off-by: Sage Weil <sage@redhat.com> (cherry picked from commit fd00136)
Fixes: https://tracker.ceph.com/issues/43889 Signed-off-by: Sage Weil <sage@redhat.com> (cherry picked from commit 9f2a854)
The skewed clock makes some mons miss elections. Signed-off-by: Sage Weil <sage@redhat.com> (cherry picked from commit 08b6a2b)
neha-ojha
approved these changes
Apr 2, 2020
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
backport trackers:
backport of
parent trackers:
this backport was staged using ceph-backport.sh version 15.1.1.389
find the latest version at https://github.com/ceph/ceph/blob/master/src/script/ceph-backport.sh