Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

OCPBUGS-14241: nto: pao avoid timeout when there are too many CSV #731

Merged
merged 1 commit into from Oct 3, 2023

Conversation

jlojosnegros
Copy link
Contributor

@jlojosnegros jlojosnegros commented Jul 26, 2023

Adding pagination to CSVs list operation while deleting PAO OLM operator elements.

From versions >= 4.11 PAO has been integrated into NTO
For that reason PAO OLM operator elements (ClusterServiceVersion, Subscriptions .. ) should be deleted

As part of this operation CSVs are listed. This operation can take too long in some clusters due to the number of elements to be listed, and so the operation will hit a timeout and the pod will crash. This could end on a Crashbackloopsituation.

Adding pagination to the list operation should avoid this situation.

@openshift-ci openshift-ci bot added the do-not-merge/work-in-progress Indicates that a PR should not merge because it is a work in progress. label Jul 26, 2023
@openshift-ci
Copy link
Contributor

openshift-ci bot commented Jul 26, 2023

Skipping CI for Draft Pull Request.
If you want CI signal for your change, please convert it to an actual PR.
You can still manually trigger a test run with /test all

@jlojosnegros
Copy link
Contributor Author

/cc @yanirq
/test all

@openshift-ci openshift-ci bot requested a review from yanirq July 26, 2023 09:38
@yanirq
Copy link
Contributor

yanirq commented Jul 26, 2023

fix PR description: PAO is included in NTO since 4.11 (including)

@jlojosnegros
Copy link
Contributor Author

/test e2e-gcp-pao-updating-profile

@jlojosnegros
Copy link
Contributor Author

fix PR description: PAO is included in NTO since 4.11 (including)

thanks, done.

@jlojosnegros jlojosnegros marked this pull request as ready for review July 26, 2023 12:59
@openshift-ci openshift-ci bot removed the do-not-merge/work-in-progress Indicates that a PR should not merge because it is a work in progress. label Jul 26, 2023
@openshift-ci openshift-ci bot requested review from ffromani and jmencak July 26, 2023 13:08
@jlojosnegros jlojosnegros changed the title OCPBUGS-14241 nto: pao avoid timeout when there are too many CSV OCPBUGS-14241: nto: pao avoid timeout when there are too many CSV Jul 26, 2023
@openshift-ci-robot openshift-ci-robot added jira/severity-important Referenced Jira bug's severity is important for the branch this PR is targeting. jira/valid-reference Indicates that this PR references a valid Jira ticket of any type. jira/invalid-bug Indicates that a referenced Jira bug is invalid for the branch this PR is targeting. labels Jul 26, 2023
@openshift-ci-robot
Copy link
Contributor

@jlojosnegros: This pull request references Jira Issue OCPBUGS-14241, which is invalid:

  • expected the bug to target the "4.14.0" version, but no target version was set

Comment /jira refresh to re-evaluate validity if changes to the Jira bug are made, or edit the title of this pull request to link to a different bug.

The bug has been updated to refer to the pull request using the external bug tracker.

In response to this:

Adding pagination to CSVs list operation while deleting PAO OLM operator elements.

From versions >= 4.11 PAO has been integrated into NTO
For that reason PAO OLM operator elements (ClusterServiceVersion, Subscriptions .. ) should be deleted

As part of this operation CSVs are listed. This operation can take too long in some clusters due to the number of elements to be listed, and so the operation will hit a timeout and the pod will crash. This could end on a Crashbackloopsituation.

Adding pagination to the list operation should avoid this situation.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

@jlojosnegros
Copy link
Contributor Author

/jira refresh

@openshift-ci-robot
Copy link
Contributor

@jlojosnegros: This pull request references Jira Issue OCPBUGS-14241, which is invalid:

  • expected the bug to target only the "4.14.0" version, but multiple target versions were set

Comment /jira refresh to re-evaluate validity if changes to the Jira bug are made, or edit the title of this pull request to link to a different bug.

In response to this:

/jira refresh

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

@jlojosnegros
Copy link
Contributor Author

/jira refresh

@openshift-ci-robot openshift-ci-robot added jira/valid-bug Indicates that a referenced Jira bug is valid for the branch this PR is targeting. and removed jira/invalid-bug Indicates that a referenced Jira bug is invalid for the branch this PR is targeting. labels Jul 26, 2023
@openshift-ci-robot
Copy link
Contributor

@jlojosnegros: This pull request references Jira Issue OCPBUGS-14241, which is valid. The bug has been moved to the POST state.

3 validation(s) were run on this bug
  • bug is open, matching expected state (open)
  • bug target version (4.14.0) matches configured target version for branch (4.14.0)
  • bug is in the state ASSIGNED, which is one of the valid states (NEW, ASSIGNED, POST)

No GitHub users were found matching the public email listed for the QA contact in Jira (liqcui@redhat.com), skipping review request.

In response to this:

/jira refresh

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

@jlojosnegros
Copy link
Contributor Author

/retest

@jlojosnegros jlojosnegros force-pushed the csv-crash branch 2 times, most recently from 349da89 to eb6aa65 Compare July 28, 2023 09:44
@jlojosnegros jlojosnegros requested a review from yanirq July 28, 2023 10:59
@jlojosnegros
Copy link
Contributor Author

/retest

@MarSik
Copy link
Contributor

MarSik commented Aug 1, 2023

The logic looks sound to me. However this needs manual validation, because our CI will not test the proper scenario on the main branch.

/lgtm
/approved

@openshift-ci openshift-ci bot added the acknowledge-critical-fixes-only Indicates if the issuer of the label is OK with the policy. label Sep 11, 2023
@jlojosnegros
Copy link
Contributor Author

@yanirq PTAL
Thanks

@yanirq
Copy link
Contributor

yanirq commented Sep 26, 2023

/payload-job periodic-ci-openshift-release-master-ci-4.15-upgrade-from-stable-4.14-e2e-gcp-ovn-upgrade

@openshift-ci
Copy link
Contributor

openshift-ci bot commented Sep 26, 2023

@yanirq: trigger 1 job(s) for the /payload-(job|aggregate) command

  • periodic-ci-openshift-release-master-ci-4.15-upgrade-from-stable-4.14-e2e-gcp-ovn-upgrade

See details on https://pr-payload-tests.ci.openshift.org/runs/ci/891fb440-5c66-11ee-83dd-0839f5003567-0

@yanirq
Copy link
Contributor

yanirq commented Oct 2, 2023

/lgtm

@openshift-ci openshift-ci bot added the lgtm Indicates that a PR is ready to be merged. label Oct 2, 2023
@openshift-ci-robot openshift-ci-robot added jira/invalid-bug Indicates that a referenced Jira bug is invalid for the branch this PR is targeting. and removed jira/valid-bug Indicates that a referenced Jira bug is valid for the branch this PR is targeting. labels Oct 2, 2023
@openshift-ci-robot
Copy link
Contributor

@jlojosnegros: This pull request references Jira Issue OCPBUGS-14241, which is invalid:

  • expected the bug to target the "4.15.0" version, but it targets "4.14.0" instead

Comment /jira refresh to re-evaluate validity if changes to the Jira bug are made, or edit the title of this pull request to link to a different bug.

In response to this:

Adding pagination to CSVs list operation while deleting PAO OLM operator elements.

From versions >= 4.11 PAO has been integrated into NTO
For that reason PAO OLM operator elements (ClusterServiceVersion, Subscriptions .. ) should be deleted

As part of this operation CSVs are listed. This operation can take too long in some clusters due to the number of elements to be listed, and so the operation will hit a timeout and the pod will crash. This could end on a Crashbackloopsituation.

Adding pagination to the list operation should avoid this situation.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

@jlojosnegros
Copy link
Contributor Author

/jira refresh

@openshift-ci-robot openshift-ci-robot added jira/valid-bug Indicates that a referenced Jira bug is valid for the branch this PR is targeting. and removed jira/invalid-bug Indicates that a referenced Jira bug is invalid for the branch this PR is targeting. labels Oct 2, 2023
@openshift-ci-robot
Copy link
Contributor

@jlojosnegros: This pull request references Jira Issue OCPBUGS-14241, which is valid.

3 validation(s) were run on this bug
  • bug is open, matching expected state (open)
  • bug target version (4.15.0) matches configured target version for branch (4.15.0)
  • bug is in the state POST, which is one of the valid states (NEW, ASSIGNED, POST)

No GitHub users were found matching the public email listed for the QA contact in Jira (liqcui@redhat.com), skipping review request.

In response to this:

/jira refresh

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

@jlojosnegros
Copy link
Contributor Author

/hold cancel
do not know why it still has the hold label

@openshift-ci openshift-ci bot removed the do-not-merge/hold Indicates that a PR should not merge because someone has issued a /hold command. label Oct 2, 2023
Sometimes NTO timesout when listing CSVs.
Adding pagination should solve this problem.

Signed-off-by: Jose Luis Ojosnegros Manchón <jojosneg@redhat.com>
@openshift-ci openshift-ci bot removed the lgtm Indicates that a PR is ready to be merged. label Oct 2, 2023
@jlojosnegros
Copy link
Contributor Author

jlojosnegros commented Oct 2, 2023

code rebased over latest master to overcome conflicts

@openshift-ci
Copy link
Contributor

openshift-ci bot commented Oct 2, 2023

@jlojosnegros: all tests passed!

Full PR test history. Your PR dashboard.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.

@ffromani
Copy link
Contributor

ffromani commented Oct 2, 2023

/cherry-pick release-4.14

@openshift-cherrypick-robot

@ffromani: once the present PR merges, I will cherry-pick it on top of release-4.14 in a new PR and assign it to you.

In response to this:

/cherry-pick release-4.14

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

@openshift-ci
Copy link
Contributor

openshift-ci bot commented Oct 3, 2023

@jlojosnegros: you cannot LGTM your own PR.

In response to this:

/lgtm

Label dropped due to rebase.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

@MarSik
Copy link
Contributor

MarSik commented Oct 3, 2023

/lgtm

@openshift-ci openshift-ci bot added the lgtm Indicates that a PR is ready to be merged. label Oct 3, 2023
@openshift-ci openshift-ci bot merged commit 7ec3a92 into openshift:master Oct 3, 2023
13 checks passed
@openshift-ci-robot
Copy link
Contributor

@jlojosnegros: Jira Issue OCPBUGS-14241: All pull requests linked via external trackers have merged:

Jira Issue OCPBUGS-14241 has been moved to the MODIFIED state.

In response to this:

Adding pagination to CSVs list operation while deleting PAO OLM operator elements.

From versions >= 4.11 PAO has been integrated into NTO
For that reason PAO OLM operator elements (ClusterServiceVersion, Subscriptions .. ) should be deleted

As part of this operation CSVs are listed. This operation can take too long in some clusters due to the number of elements to be listed, and so the operation will hit a timeout and the pod will crash. This could end on a Crashbackloopsituation.

Adding pagination to the list operation should avoid this situation.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

@openshift-cherrypick-robot

@ffromani: #731 failed to apply on top of branch "release-4.14":

Applying: nto: avoid timeout when there are too many CSV
Using index info to reconstruct a base tree...
M	cmd/cluster-node-tuning-operator/main.go
Falling back to patching base and 3-way merge...
Auto-merging cmd/cluster-node-tuning-operator/main.go
CONFLICT (content): Merge conflict in cmd/cluster-node-tuning-operator/main.go
error: Failed to merge in the changes.
hint: Use 'git am --show-current-patch=diff' to see the failed patch
Patch failed at 0001 nto: avoid timeout when there are too many CSV
When you have resolved this problem, run "git am --continue".
If you prefer to skip this patch, run "git am --skip" instead.
To restore the original branch and stop patching, run "git am --abort".

In response to this:

/cherry-pick release-4.14

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
acknowledge-critical-fixes-only Indicates if the issuer of the label is OK with the policy. approved Indicates a PR has been approved by an approver from all required OWNERS files. jira/severity-important Referenced Jira bug's severity is important for the branch this PR is targeting. jira/valid-bug Indicates that a referenced Jira bug is valid for the branch this PR is targeting. jira/valid-reference Indicates that this PR references a valid Jira ticket of any type. lgtm Indicates that a PR is ready to be merged.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

6 participants