New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Do not report error when deleting an attached volume #31978
Do not report error when deleting an attached volume #31978
Conversation
cc @kubernetes/sig-storage |
Do we want this in 1.4 (maybe 1.4.1) ? On Fri, Sep 2, 2016 at 7:52 AM, Kubernetes Submit Queue <
|
9a18e50
to
3197036
Compare
glog.V(4).Infof("deleteVolumeOperation [%s]: failed to mark volume as failed: %v", volume.Name, err) | ||
// Save failed, retry on the next deletion attempt | ||
return | ||
if vol.IsTryAgain(err) { |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
How frequent is the retry? Is it worth doing exponential backoff?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Every controller sync, which is 15 seconds by default. And it does not start new delete until an old one (on the same PV) returns.
9023ec9
to
d20131d
Compare
d20131d
to
a24e6a9
Compare
rebased |
1 similar comment
GCE e2e build/test passed for commit 9903b38. |
I am shadowing this review. lgtm! |
LGTM |
@k8s-bot test this [submit-queue is verifying that this PR is safe to merge] |
Jenkins GKE smoke e2e failed for commit 9903b38. Full PR test history. The magic incantation to run this job again is |
Automatic merge from submit-queue |
Automatic merge from submit-queue Do not report error when deleting an attached volume Persistent volume controller should not send warning events to a PV and mark the PV as failed when the volume is still attached. This happens when a user quickly deletes a pod and associated PVC - PV is slowly detaching, while the PVC is already deleted and the PV enters Failed phase. `Deleter.Deleter` can now return `tryAgainError`, which is sent as INFO to the PV to let the user know we did not forget to delete the PV, however the PV stays in Released state. The controller tries again in the next sync (15 seconds by default). Fixes kubernetes#31511
Persistent volume controller should not send warning events to a PV and mark the PV as failed when the volume is still attached.
This happens when a user quickly deletes a pod and associated PVC - PV is slowly detaching, while the PVC is already deleted and the PV enters Failed phase.
Deleter.Deleter
can now returntryAgainError
, which is sent as INFO to the PV to let the user know we did not forget to delete the PV, however the PV stays in Released state. The controller tries again in the next sync (15 seconds by default).Fixes #31511
This change is