Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

controller/status: set Degraded if rollout is hung. #358

Merged
merged 1 commit into from Nov 13, 2019
Merged

controller/status: set Degraded if rollout is hung. #358

merged 1 commit into from Nov 13, 2019

Conversation

squeed
Copy link
Contributor

@squeed squeed commented Oct 21, 2019

If we find ourselves with a DaemonSet or Deployment that hasn't made any progress for the past 10 minutes, then highlight this to the operator as a Degraded state.

This doesn't affect any of the other states (Progressing, Available, etc.).

/cc @danwinship @rcarrillocruz

@openshift-ci-robot openshift-ci-robot added size/L Denotes a PR that changes 100-499 lines, ignoring generated files. approved Indicates a PR has been approved by an approver from all required OWNERS files. labels Oct 21, 2019
Copy link
Contributor

@danwinship danwinship left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

cool

pkg/controller/statusmanager/status_manager.go Outdated Show resolved Hide resolved
pkg/controller/statusmanager/status_manager.go Outdated Show resolved Hide resolved
pkg/controller/statusmanager/status_manager.go Outdated Show resolved Hide resolved
pkg/controller/statusmanager/status_manager.go Outdated Show resolved Hide resolved
pkg/controller/statusmanager/status_manager_test.go Outdated Show resolved Hide resolved
@openshift-ci-robot openshift-ci-robot added size/XL Denotes a PR that changes 500-999 lines, ignoring generated files. and removed size/L Denotes a PR that changes 100-499 lines, ignoring generated files. labels Oct 28, 2019
@squeed
Copy link
Contributor Author

squeed commented Oct 28, 2019

@danwinship rewrote this to store status in a type and marshal it to json. Thanks

@squeed
Copy link
Contributor Author

squeed commented Oct 29, 2019

/retest

@squeed
Copy link
Contributor Author

squeed commented Oct 29, 2019

Uh... I was kind of tired when I wrote that comment. I meant to say: I rewrote this to store state in an annotation on the ClusterOperator in json.

pkg/controller/statusmanager/pod_status.go Show resolved Hide resolved
pkg/controller/statusmanager/pod_status.go Outdated Show resolved Hide resolved
pkg/controller/statusmanager/pod_status.go Outdated Show resolved Hide resolved
pkg/controller/statusmanager/pod_status.go Outdated Show resolved Hide resolved
pkg/controller/statusmanager/pod_status.go Outdated Show resolved Hide resolved
pkg/controller/statusmanager/pod_status.go Outdated Show resolved Hide resolved
If we find ourselves with a DaemonSet or Deployment that hasn't made any
progress for the past 10 minutes, then highlight this to the operator as
a Degraded state.

This doesn't affect any of the other states (Progressing, Available,
etc.).
@squeed
Copy link
Contributor Author

squeed commented Nov 13, 2019

Test failure is due to https://bugzilla.redhat.com/show_bug.cgi?id=1765280
/retest

@squeed
Copy link
Contributor Author

squeed commented Nov 13, 2019

@danwinship updated, PTAL

@danwinship
Copy link
Contributor

/lgtm

@openshift-ci-robot openshift-ci-robot added the lgtm Indicates that a PR is ready to be merged. label Nov 13, 2019
@openshift-ci-robot
Copy link
Contributor

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: danwinship, squeed

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@openshift-merge-robot openshift-merge-robot merged commit def4c64 into openshift:master Nov 13, 2019
@squeed squeed deleted the status-improvements branch October 14, 2020 16:07
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
approved Indicates a PR has been approved by an approver from all required OWNERS files. lgtm Indicates that a PR is ready to be merged. size/XL Denotes a PR that changes 500-999 lines, ignoring generated files.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

4 participants