Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix AWS cloud provider cleanup sometimes getting stuck when cleaning up tags #8879

Merged
merged 1 commit into from Feb 4, 2022

Conversation

xrstf
Copy link
Contributor

@xrstf xrstf commented Feb 4, 2022

What does this PR do / Why do we need it:
This fixes the rare case were all resources have been cleaned up already, but the finalizer was still stuck, leading to

{"level":"error","time":"2022-02-04T14:46:35.780Z","logger":"controller.kubermatic_cloud_controller","caller":"controller/controller.go:317","msg":"Reconciler error","name":"jmh6qqjgg7","namespace":"","error":"failed cloud provider cleanup: failed to clean up tags: InvalidParameterValue: Value ( ) for parameter resourceId is invalid. Null/empty value for resourceId is invalid\n\tstatus code: 400, request id: 8edbfe54-2ca5-4dc9-9277-f0fcbde4597b","errorCauses":[{"error":"failed cloud provider cleanup: failed to clean up tags: InvalidParameterValue: Value ( ) for parameter resourceId is invalid. Null/empty value for resourceId is invalid\n\tstatus code: 400, request id: 8edbfe54-2ca5-4dc9-9277-f0fcbde4597b"}]}

Does this PR introduce a user-facing change?:

fix AWS cloud provider cleanup sometimes getting stuck when cleaning up tags

@kubermatic-bot kubermatic-bot added release-note Denotes a PR that will be considered when it comes time to generate release notes. dco-signoff: yes Denotes that all commits in the pull request have the valid DCO signoff message. sig/cluster-management Denotes a PR or issue as being assigned to SIG Cluster Management. labels Feb 4, 2022
@kubermatic-bot
Copy link
Contributor

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: xrstf

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@kubermatic-bot kubermatic-bot added approved Indicates a PR has been approved by an approver from all required OWNERS files. size/S Denotes a PR that changes 10-29 lines, ignoring generated files. labels Feb 4, 2022
@xrstf
Copy link
Contributor Author

xrstf commented Feb 4, 2022

/cherrypick release/v2.19
/cherrypick release/v2.20

@kubermatic-bot
Copy link
Contributor

@xrstf: once the present PR merges, I will cherry-pick it on top of release/v2.19 in a new PR and assign it to you.

In response to this:

/cherrypick release/v2.19
/cherrypick release/v2.20

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

@xrstf xrstf requested a review from embik February 4, 2022 15:40
@kubermatic-bot kubermatic-bot added the lgtm Indicates that a PR is ready to be merged. label Feb 4, 2022
@kubermatic-bot
Copy link
Contributor

LGTM label has been added.

Git tree hash: a35c8d94196be4368618d224d922a869eba0159a

@xrstf
Copy link
Contributor Author

xrstf commented Feb 4, 2022

/retest

@kubermatic-triage-bot
Copy link

/retest
This bot automatically retries jobs that failed/flaked on approved PRs

Review the full test history

Silence the bot with an /lgtm cancel or /hold comment for consistent failures.

1 similar comment
@kubermatic-triage-bot
Copy link

/retest
This bot automatically retries jobs that failed/flaked on approved PRs

Review the full test history

Silence the bot with an /lgtm cancel or /hold comment for consistent failures.

@kubermatic-bot
Copy link
Contributor

@xrstf: new pull request created: #8885

In response to this:

/cherrypick release/v2.19
/cherrypick release/v2.20

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

@kubermatic-bot
Copy link
Contributor

@xrstf: new pull request created: #8886

In response to this:

/cherrypick release/v2.19
/cherrypick release/v2.20

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

@xrstf xrstf deleted the fix-aws-cleanup branch February 5, 2022 00:17
@moadqassem moadqassem changed the title fix AWS cloud provider cleanup sometimes getting stuck when cleaning up tags fix AWS cloud provider cleanup sometimes getting stuck when cleaning up tags - Test Release 2.20 Feb 18, 2022
@kron4eg kron4eg changed the title fix AWS cloud provider cleanup sometimes getting stuck when cleaning up tags - Test Release 2.20 fix AWS cloud provider cleanup sometimes getting stuck when cleaning up tags Feb 23, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
approved Indicates a PR has been approved by an approver from all required OWNERS files. dco-signoff: yes Denotes that all commits in the pull request have the valid DCO signoff message. lgtm Indicates that a PR is ready to be merged. release-note Denotes a PR that will be considered when it comes time to generate release notes. sig/cluster-management Denotes a PR or issue as being assigned to SIG Cluster Management. size/S Denotes a PR that changes 10-29 lines, ignoring generated files.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

4 participants