Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

mimic: Fix ceph-mgr restarts #22051

Merged
merged 2 commits into from May 20, 2018
Merged

mimic: Fix ceph-mgr restarts #22051

merged 2 commits into from May 20, 2018

Conversation

b-ranto
Copy link
Contributor

@b-ranto b-ranto commented May 17, 2018

This PR contains a mimic back-port for shutdown/restart fix for prometheus module and a patch to fix the shutdown/restart with dashboard module enabled in the similar way.

The prometheus serve method uses block which it should not as it can
cause several problems when shutting down (restarting) ceph-mgr. As a
result the restart of the ceph-mgr module will block until time-out if
the prometheus module is enabled. This fixes the problem by using a
simple simple shutdown_event instead of block() and stopping the server
afterwards.

Signed-off-by: Boris Ranto <branto@redhat.com>
(cherry picked from commit a662caa)
The dashboard serve method uses block which it should not as it can
cause several problems when shutting down (restarting) ceph-mgr. As a
result the restart of the ceph-mgr module will block until time-out if
the dashboard module is enabled. This fixes the problem by using a
simple simple shutdown_event instead of block() and stopping the server
afterwards.

Signed-off-by: Boris Ranto <branto@redhat.com>
@b-ranto b-ranto requested review from jan--f and jcsp May 17, 2018 09:10
@jan--f
Copy link
Contributor

jan--f commented May 17, 2018

The prometheus part lgtm. Adding @rjfd for the dashboard commit.

@rjfd
Copy link
Contributor

rjfd commented May 17, 2018

@s0nea could you run the dashboard QA tests with this PR? (notice this is targeting mimic)

@s0nea
Copy link
Member

s0nea commented May 17, 2018

@rjfd yes, I'm going to try it (I'm not really sure if this will be successful because of the issues I'm currently facing in Teuthology).

Copy link
Contributor

@jan--f jan--f left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

the prometheus part lgtm

@s0nea
Copy link
Member

s0nea commented May 17, 2018

@b-ranto
Copy link
Contributor Author

b-ranto commented May 17, 2018

That is great. @rjfd ok to merge?

@s0nea s0nea removed the needs-qa label May 18, 2018
@jcsp
Copy link
Contributor

jcsp commented May 18, 2018

Possibly related: http://tracker.ceph.com/issues/24166

@liewegas liewegas changed the title Fix ceph-mgr restarts mimic: Fix ceph-mgr restarts May 18, 2018
@liewegas liewegas added this to the mimic milestone May 18, 2018
@tchaikov tchaikov merged commit e1cac82 into ceph:mimic May 20, 2018
@tchaikov
Copy link
Contributor

already tested. so no need to run rados qa suite again.

@b-ranto b-ranto deleted the wip-mgr-restarts branch May 21, 2018 06:44
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
7 participants