Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Retry monitor storage creation and only on Leader #4333

Merged
merged 3 commits into from
Oct 5, 2015
Merged

Conversation

otoolep
Copy link
Contributor

@otoolep otoolep commented Oct 5, 2015

With this change the monitor sub-system will retry creation of its internal storage. Previously any failure would cause internal storage to cease, meaning any temporary problems on the cluster would cause storage to cease until a node restart. Instead try every monitor cycle until creation is successful.

Furthermore, this creation only needs to be executed by one node, so only attempt it on the Leader.

This functionality is idempotent and is storage has been successfully
created, no attempt will be made to re-create it. This allows the system
to keep trying every cycle, but stop when successful.
Since only the leader can create it, the system might as well only
attempt creation on the leader.
@corylanou
Copy link
Contributor

+1

otoolep added a commit that referenced this pull request Oct 5, 2015
Retry monitor storage creation and only on Leader
@otoolep otoolep merged commit a542d55 into master Oct 5, 2015
@otoolep otoolep deleted the retry_mon_create branch October 5, 2015 22:54
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants