Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Bug 1840707: oVirt, skip network service tests #25012

Merged

Conversation

Gal-Zaidman
Copy link
Contributor

This PR skips the network service tests for ovirt.
we didn't know the reason until recently and now there is a fix which is targeted for RHEL 8.3 [1] and there are openshift bugs for tracking the fix in openshift [2][3][4].
Since this is now a very known issue and is currently failing our CI and making it hard to distinguish between a red failed CI and a false one we decided to skip those test for ovirt until the fix will land.

Tracker-Bug-Url: https://bugzilla.redhat.com/show_bug.cgi?id=1838751

[1] https://bugzilla.redhat.com/show_bug.cgi?id=1794714
[2] https://bugzilla.redhat.com/show_bug.cgi?id=1822714
[3] https://bugzilla.redhat.com/show_bug.cgi?id=1822755
[4] https://bugzilla.redhat.com/show_bug.cgi?id=1822766

Signed-off-by: Gal-Zaidman gzaidman@redhat.com

@Gal-Zaidman
Copy link
Contributor Author

/assign @derekwaynecarr

`\[sig-network\] Networking Granular Checks: Services should function for endpoint-Service`,
`\[sig-network\] Networking Granular Checks: Services should function for node-Service`,
`\[sig-network\] Networking Granular Checks: Services should function for pod-Service`,
},
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

i don't believe this does what you want. you need an actual change in the test to invoke skip when the ovirt platform is detected.

see that https://github.com/openshift/origin/pull/25012/files#diff-6ba77494282f6e840f44b01ce97335afR300 will not match this.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think that is the wrong URL

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

it's right but github doesn't autoexpand for you.

line 300 of this file.

see also:
https://github.com/openshift/origin/blob/master/test/extended/oauth/requestheaders.go#L66-L68

as an example of how this is normally done.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looking at other PRs such as:

Are you sure I don't need to just edit zz_generated.annotations.go ?

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I am reasonably certain what you've done here will accomplish nothing other than adding a [Skipped:ovirt] prefix to the tests in question.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think that its what needs to be done, I looked into:
https://github.com/openshift/origin/blob/master/cmd/openshift-tests/provider.go#L57-L63
and it seems that the tests will be skipped if we have [Skipped:ovirt] in them.

Plus the tests come from kubernetes so I don't think we need to send a patch there:
https://github.com/kubernetes/kubernetes/blob/2fd8debe9b913f18b20a2269117409212391ef19/test/e2e/network/networking.go#L162

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

hack/update-generated-bindata.sh should update the other file for you

This PR skips the network service tests for ovirt.
we didn't know the reason until recently and now there is a fix which is targeted for RHEL 8.3 [1] and there are openshift bugs for tracking the fix in openshift [2][3][4].
Since this is now a very known issue and is currently failing our CI and making it hard to distinguish between a red failed CI and a false one we decided to skip those test for ovirt until the fix will land.

Tracker-Bug-Url: https://bugzilla.redhat.com/show_bug.cgi?id=1838751

[1] https://bugzilla.redhat.com/show_bug.cgi?id=1794714
[2] https://bugzilla.redhat.com/show_bug.cgi?id=1822714
[3] https://bugzilla.redhat.com/show_bug.cgi?id=1822755
[4] https://bugzilla.redhat.com/show_bug.cgi?id=1822766

Signed-off-by: Gal-Zaidman <gzaidman@redhat.com>
@Gal-Zaidman
Copy link
Contributor Author

/assign smarterclayton

@bparees
Copy link
Contributor

bparees commented May 22, 2020

@squeed @danwinship one of you can probably approve this. There is a bug tracking that these tests need to be re-enabled on ovirt once the rhel issues are resolved.

@Gal-Zaidman
Copy link
Contributor Author

/retest

@Gal-Zaidman
Copy link
Contributor Author

/test e2e-gcp

1 similar comment
@Gal-Zaidman
Copy link
Contributor Author

/test e2e-gcp

@squeed
Copy link
Contributor

squeed commented May 25, 2020

/lgtm

@openshift-ci-robot openshift-ci-robot added the lgtm Indicates that a PR is ready to be merged. label May 25, 2020
@danwinship
Copy link
Contributor

@squeed @danwinship one of you can probably approve this. There is a bug tracking that these tests need to be re-enabled on ovirt once the rhel issues are resolved.

I can confirm that it makes sense to disable those tests on oVirt until OCP has a kernel containing a fix for the vxlan offload bug, but I don't have /approve power there.
/lgtm

@derekwaynecarr
Copy link
Member

/approve

@openshift-ci-robot
Copy link

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: danwinship, derekwaynecarr, Gal-Zaidman, squeed

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@openshift-ci-robot openshift-ci-robot added the approved Indicates a PR has been approved by an approver from all required OWNERS files. label May 26, 2020
@Gal-Zaidman
Copy link
Contributor Author

/bugzilla refresh

@openshift-ci-robot
Copy link

@Gal-Zaidman: No Bugzilla bug is referenced in the title of this pull request.
To reference a bug, add 'Bug XXX:' to the title of this pull request and request another bug refresh with /bugzilla refresh.

In response to this:

/bugzilla refresh

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

@Gal-Zaidman
Copy link
Contributor Author

/retitle Bug 1840707: oVirt, skip network service tests

@openshift-ci-robot openshift-ci-robot changed the title oVirt: skip network service tests Bug 1840707: oVirt, skip network service tests May 27, 2020
@openshift-ci-robot openshift-ci-robot added the bugzilla/severity-unspecified Referenced Bugzilla bug's severity is unspecified for the PR. label May 27, 2020
@openshift-ci-robot
Copy link

@Gal-Zaidman: This pull request references Bugzilla bug 1840707, which is invalid:

  • expected the bug to target the "4.5.0" release, but it targets "---" instead

Comment /bugzilla refresh to re-evaluate validity if changes to the Bugzilla bug are made, or edit the title of this pull request to link to a different bug.

In response to this:

Bug 1840707: oVirt, skip network service tests

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

@openshift-ci-robot openshift-ci-robot added the bugzilla/invalid-bug Indicates that a referenced Bugzilla bug is invalid for the branch this PR is targeting. label May 27, 2020
@Gal-Zaidman
Copy link
Contributor Author

/bugzilla refresh

@openshift-ci-robot openshift-ci-robot removed the bugzilla/severity-unspecified Referenced Bugzilla bug's severity is unspecified for the PR. label May 27, 2020
@openshift-ci-robot
Copy link

@Gal-Zaidman: This pull request references Bugzilla bug 1840707, which is invalid:

  • expected the bug to target the "4.5.0" release, but it targets "---" instead

Comment /bugzilla refresh to re-evaluate validity if changes to the Bugzilla bug are made, or edit the title of this pull request to link to a different bug.

In response to this:

/bugzilla refresh

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

@openshift-ci-robot openshift-ci-robot added the bugzilla/severity-high Referenced Bugzilla bug's severity is high for the branch this PR is targeting. label May 27, 2020
@Gal-Zaidman
Copy link
Contributor Author

/bugzilla refresh

@openshift-ci-robot
Copy link

@Gal-Zaidman: This pull request references Bugzilla bug 1840707, which is invalid:

  • expected the bug to target the "4.5.0" release, but it targets "4.5.z" instead

Comment /bugzilla refresh to re-evaluate validity if changes to the Bugzilla bug are made, or edit the title of this pull request to link to a different bug.

In response to this:

/bugzilla refresh

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

@Gal-Zaidman
Copy link
Contributor Author

/bugzilla refresh

@openshift-ci-robot openshift-ci-robot added the bugzilla/valid-bug Indicates that a referenced Bugzilla bug is valid for the branch this PR is targeting. label May 27, 2020
@openshift-ci-robot
Copy link

@Gal-Zaidman: This pull request references Bugzilla bug 1840707, which is valid. The bug has been moved to the POST state. The bug has been updated to refer to the pull request using the external bug tracker.

3 validation(s) were run on this bug
  • bug is open, matching expected state (open)
  • bug target release (4.5.0) matches configured target release for branch (4.5.0)
  • bug is in the state NEW, which is one of the valid states (NEW, ASSIGNED, ON_DEV, POST, POST)

In response to this:

/bugzilla refresh

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

@openshift-ci-robot openshift-ci-robot removed the bugzilla/invalid-bug Indicates that a referenced Bugzilla bug is invalid for the branch this PR is targeting. label May 27, 2020
@openshift-bot
Copy link
Contributor

/retest

Please review the full test history for this PR and help us cut down flakes.

1 similar comment
@openshift-bot
Copy link
Contributor

/retest

Please review the full test history for this PR and help us cut down flakes.

@openshift-merge-robot openshift-merge-robot merged commit 144c666 into openshift:master May 27, 2020
@openshift-ci-robot
Copy link

@Gal-Zaidman: All pull requests linked via external trackers have merged: openshift/origin#25012. Bugzilla bug 1840707 has been moved to the MODIFIED state.

In response to this:

Bug 1840707: oVirt, skip network service tests

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

@Gal-Zaidman
Copy link
Contributor Author

/cherry-pick release 4.4

@Gal-Zaidman
Copy link
Contributor Author

/cherry-pick release-4.4

@openshift-cherrypick-robot

@Gal-Zaidman: cannot checkout release 4.4: error checking out release 4.4: exit status 1. output: error: pathspec 'release 4.4' did not match any file(s) known to git.

In response to this:

/cherry-pick release 4.4

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

@openshift-cherrypick-robot

@Gal-Zaidman: #25012 failed to apply on top of branch "release-4.4":

error: Failed to merge in the changes.
Using index info to reconstruct a base tree...
M	test/extended/util/annotate/generated/zz_generated.annotations.go
M	test/extended/util/annotate/rules.go
Falling back to patching base and 3-way merge...
Auto-merging test/extended/util/annotate/rules.go
Auto-merging test/extended/util/annotate/generated/zz_generated.annotations.go
CONFLICT (content): Merge conflict in test/extended/util/annotate/generated/zz_generated.annotations.go
Patch failed at 0001 oVirt: skip network service tests

In response to this:

/cherry-pick release-4.4

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

Gal-Zaidman pushed a commit to Gal-Zaidman/origin that referenced this pull request Jun 7, 2020
This is a clone of PR openshift#25012
For release 4.4

This PR skips the network service tests for ovirt.
we didn't know the reason until recently and now there is a fix which is targeted for RHEL 8.3 [1] and there are openshift bugs for tracking the fix in openshift [2][3][4].
Since this is now a very known issue and is currently failing our CI and making it hard to distinguish between a red failed CI and a false one we decided to skip those test for ovirt until the fix will land.

Tracker-Bug-Url: https://bugzilla.redhat.com/show_bug.cgi?id=1838751

[1] https://bugzilla.redhat.com/show_bug.cgi?id=1794714
[2] https://bugzilla.redhat.com/show_bug.cgi?id=1822714
[3] https://bugzilla.redhat.com/show_bug.cgi?id=1822755
[4] https://bugzilla.redhat.com/show_bug.cgi?id=1822766

Signed-off-by: Gal-Zaidman <gzaidman@redhat.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
approved Indicates a PR has been approved by an approver from all required OWNERS files. bugzilla/severity-high Referenced Bugzilla bug's severity is high for the branch this PR is targeting. bugzilla/valid-bug Indicates that a referenced Bugzilla bug is valid for the branch this PR is targeting. lgtm Indicates that a PR is ready to be merged.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

10 participants