Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Mitigate flaky install plan e2e test #2668

Merged

Conversation

perdasilva
Copy link
Collaborator

@perdasilva perdasilva commented Feb 21, 2022

Signed-off-by: perdasilva perdasilva@redhat.com

Description of the change:
This PR adds a mitigation around a flaky installplan e2e test. I ran out of time to properly fix the issue and didn't want to lose the work on the RCA. So I've created an issue that describes the problem and tracks the problem: #2667

Motivation for the change:
Fixing a flaky e2e test

Closes #2645

Reviewer Checklist

  • Implementation matches the proposed design, or proposal is updated to match implementation
  • Sufficient unit test coverage
  • Sufficient end-to-end test coverage
  • Docs updated or added to /doc
  • Commit messages sensible and descriptive
  • Tests marked as [FLAKE] are truly flaky
  • Tests that remove the [FLAKE] tag are no longer flaky

@openshift-ci
Copy link

openshift-ci bot commented Feb 21, 2022

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: perdasilva

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@openshift-ci openshift-ci bot added the approved Indicates a PR has been approved by an approver from all required OWNERS files. label Feb 21, 2022
@perdasilva
Copy link
Collaborator Author

/hold don't merge until flake analysis is complete

@openshift-ci openshift-ci bot added the do-not-merge/hold Indicates that a PR should not merge because someone has issued a /hold command. label Feb 21, 2022
@perdasilva
Copy link
Collaborator Author

Looks like it's no longer flaky. At least on local:

$ for i in (seq 1 50); make e2e-local TEST="can reconcile InstallPlan status" ; end | tee flake_test_run.txt
$ cat flake_test_run.txt | grep -i "1 Passed" | wc -l 
50

@perdasilva
Copy link
Collaborator Author

/unhold

@openshift-ci openshift-ci bot removed the do-not-merge/hold Indicates that a PR should not merge because someone has issued a /hold command. label Feb 21, 2022
@timflannagan timflannagan reopened this Feb 21, 2022
Signed-off-by: perdasilva <perdasilva@redhat.com>
Copy link
Member

@dinhxuanvu dinhxuanvu left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

/lgtm

@openshift-ci openshift-ci bot added the lgtm Indicates that a PR is ready to be merged. label Feb 22, 2022
@openshift-merge-robot openshift-merge-robot merged commit acf3db0 into operator-framework:master Feb 22, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
approved Indicates a PR has been approved by an approver from all required OWNERS files. lgtm Indicates that a PR is ready to be merged.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[FLAKE] can reconcile InstallPlan status
4 participants