Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix conflicted cache when the requests are canceled by other Azure operations #81282

Merged
merged 1 commit into from
Aug 12, 2019

Conversation

feiskyer
Copy link
Member

What type of PR is this?

Uncomment only one /kind <> line, hit enter to put that in a new line, and remove leading whitespaces from that line:

/kind api-change
/kind bug
/kind cleanup
/kind design
/kind documentation
/kind failing-test
/kind feature
/kind flake

/kind bug

What this PR does / why we need it:

When a new requests are sending to an Azure resource, the ongoing requests may be canceled with error:

Code="Canceled" Message="Operation was canceled." Details=[{"code":"CanceledAndSupersededDueToAnotherOperation","message":"Operation PutLoadBalancerOperation (c29592fc-da61-47c3-b032-b4a2df0cc62a) was canceled and superseded by operation PutLoadBalancerOperation (b0a47269-40c5-461a-b704-2f162f8300f3)."}]

In such case, the resource has already been changed by other requests. So this PR invalidates the cache and then abort the backoff retry. In next controller loop run, cloud provider would GET a new resource from Azure API, and then try updating again.

Which issue(s) this PR fixes:

Fixes #

Special notes for your reviewer: Need cherry pick to v1.15.

Does this PR introduce a user-facing change?:

Fix conflicted cache when the requests are canceled by other Azure operations.

Additional documentation e.g., KEPs (Kubernetes Enhancement Proposals), usage docs, etc.:


/kind bug
/area provider/azure
/priority critical-urgent
/sig cloud-provider

@k8s-ci-robot k8s-ci-robot added release-note Denotes a PR that will be considered when it comes time to generate release notes. kind/bug Categorizes issue or PR as related to a bug. size/M Denotes a PR that changes 30-99 lines, ignoring generated files. area/provider/azure Issues or PRs related to azure provider priority/critical-urgent Highest priority. Must be actively worked on as someone's top priority right now. cncf-cla: yes Indicates the PR's author has signed the CNCF CLA. sig/cloud-provider Categorizes an issue or PR as relevant to SIG Cloud Provider. labels Aug 12, 2019
@feiskyer feiskyer added this to In progress in Provider Azure via automation Aug 12, 2019
@k8s-ci-robot k8s-ci-robot added the approved Indicates a PR has been approved by an approver from all required OWNERS files. label Aug 12, 2019
@feiskyer
Copy link
Member Author

/assign @andyzhangx

@feiskyer
Copy link
Member Author

/test pull-kubernetes-e2e-aks-engine-azure

Copy link
Member

@andyzhangx andyzhangx left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

/lgtm
/approve

@k8s-ci-robot k8s-ci-robot added the lgtm "Looks good to me", indicates that a PR is ready to be merged. label Aug 12, 2019
@k8s-ci-robot
Copy link
Contributor

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: andyzhangx, feiskyer

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@fejta-bot
Copy link

/retest
This bot automatically retries jobs that failed/flaked on approved PRs (send feedback to fejta).

Review the full test history for this PR.

Silence the bot with an /lgtm cancel or /hold comment for consistent failures.

@k8s-ci-robot k8s-ci-robot merged commit ae45744 into kubernetes:master Aug 12, 2019
Provider Azure automation moved this from In progress to Done Aug 12, 2019
@k8s-ci-robot k8s-ci-robot added this to the v1.16 milestone Aug 12, 2019
@feiskyer feiskyer deleted the fix-az-cancel branch August 13, 2019 01:26
k8s-ci-robot added a commit that referenced this pull request Aug 14, 2019
…82-upstream-release-1.15

Automated cherry pick of #81282: Fix conflicted cache when the requests are canceled by other Azure requests
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
approved Indicates a PR has been approved by an approver from all required OWNERS files. area/cloudprovider area/provider/azure Issues or PRs related to azure provider cncf-cla: yes Indicates the PR's author has signed the CNCF CLA. kind/bug Categorizes issue or PR as related to a bug. lgtm "Looks good to me", indicates that a PR is ready to be merged. priority/critical-urgent Highest priority. Must be actively worked on as someone's top priority right now. release-note Denotes a PR that will be considered when it comes time to generate release notes. sig/cloud-provider Categorizes an issue or PR as relevant to SIG Cloud Provider. size/M Denotes a PR that changes 30-99 lines, ignoring generated files.
Projects
Development

Successfully merging this pull request may close these issues.

None yet

4 participants