test: Allow sequential upgrades to be passed to upgrade test #24570
Conversation
Some of the operator tests must create pods within the openshift namespaces and they can report failures. Exclude them explicitly.
Upgrade test now accepts comma-delimited images or versions in `openshift-tests run-upgrade --image A,B`. This simplifies bulk testing of upgrades and will allow us to test existing upgrade paths.
When running the test over multiple upgrades, we need to be duration independent and have a higher test timeout.
openshift-ci-robot
added
the
size/L
|
/cherry-pick release-4.4 |
|
@smarterclayton: once the present PR merges, I will cherry-pick it on top of release-4.4 in a new PR and assign it to you. In response to this:
Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. |
|
[APPROVALNOTIFIER] This PR is APPROVED This pull-request has been approved by: smarterclayton The full list of commands accepted by this bot can be found here. The pull request process is described here
Needs approval from an approver in each of these files:
Approvers can indicate their approval by writing |
openshift-ci-robot
added
the
approved
|
/retest |
|
4.4 Bug is 1805457 and 4.3 is 1805459. I'll have to cherry-pick a few changes into it. |
|
/override ci/prow/e2e-gcp-builds |
|
@smarterclayton: Overrode contexts on behalf of smarterclayton: ci/prow/e2e-gcp-builds In response to this:
Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. |
|
/retest Please review the full test history for this PR and help us cut down flakes. |
12 similar comments
|
/retest Please review the full test history for this PR and help us cut down flakes. |
|
/retest Please review the full test history for this PR and help us cut down flakes. |
|
/retest Please review the full test history for this PR and help us cut down flakes. |
|
/retest Please review the full test history for this PR and help us cut down flakes. |
|
/retest Please review the full test history for this PR and help us cut down flakes. |
|
/retest Please review the full test history for this PR and help us cut down flakes. |
|
/retest Please review the full test history for this PR and help us cut down flakes. |
|
/retest Please review the full test history for this PR and help us cut down flakes. |
|
/retest Please review the full test history for this PR and help us cut down flakes. |
|
/retest Please review the full test history for this PR and help us cut down flakes. |
|
/retest Please review the full test history for this PR and help us cut down flakes. |
|
/retest Please review the full test history for this PR and help us cut down flakes. |
|
/retest Please review the full test history for this PR and help us cut down flakes. |
8 similar comments
|
/retest Please review the full test history for this PR and help us cut down flakes. |
|
/retest Please review the full test history for this PR and help us cut down flakes. |
|
/retest Please review the full test history for this PR and help us cut down flakes. |
|
/retest Please review the full test history for this PR and help us cut down flakes. |
|
/retest Please review the full test history for this PR and help us cut down flakes. |
|
/retest Please review the full test history for this PR and help us cut down flakes. |
|
/retest Please review the full test history for this PR and help us cut down flakes. |
|
/retest Please review the full test history for this PR and help us cut down flakes. |
|
@smarterclayton: new pull request created: #24588 In response to this:
Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. |
Upgrade test now accepts comma-delimited images or versions in
openshift-tests run-upgrade --image A,B. This simplifies bulk testing ofupgrades and will allow us to test existing upgrade paths.
This will allow us to test upgrades over multiple releases more easily
and allows us to avoid testing at ecah upgrade interval.
Will be used in 4.4 to test multiple input upgrades.