Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Skip kube-up related GCE tests when running e2e tests on kops #120628

Closed
wants to merge 1 commit into from

Conversation

upodroid
Copy link
Member

What type of PR is this?

What this PR does / why we need it:

I'm migrating away from kube-up clusters to kops clusters for k/k e2e testing. Some of our e2e tests are written to test functionality that is only present in kube-up so those tests now only run on kube-up clusters.

Which issue(s) this PR fixes:

Part of kubernetes/test-infra#30686

Special notes for your reviewer:

Does this PR introduce a user-facing change?

NONE

Additional documentation e.g., KEPs (Kubernetes Enhancement Proposals), usage docs, etc.:


@k8s-ci-robot k8s-ci-robot added release-note-none Denotes a PR that doesn't merit a release note. size/S Denotes a PR that changes 10-29 lines, ignoring generated files. cncf-cla: yes Indicates the PR's author has signed the CNCF CLA. do-not-merge/needs-kind Indicates a PR lacks a `kind/foo` label and requires one. do-not-merge/needs-sig Indicates an issue or PR lacks a `sig/foo` label and requires one. needs-triage Indicates an issue or PR lacks a `triage/foo` label and requires one. labels Sep 13, 2023
@k8s-ci-robot
Copy link
Contributor

This issue is currently awaiting triage.

If a SIG or subproject determines this is a relevant issue, they will accept it by applying the triage/accepted label and provide further guidance.

The triage/accepted label can be added by org members by writing /triage accepted in a comment.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

@k8s-ci-robot k8s-ci-robot added the needs-priority Indicates a PR lacks a `priority/foo` label and requires one. label Sep 13, 2023
@k8s-ci-robot k8s-ci-robot added area/e2e-test-framework Issues or PRs related to refactoring the kubernetes e2e test framework area/test sig/network Categorizes an issue or PR as relevant to SIG Network. sig/testing Categorizes an issue or PR as relevant to SIG Testing. and removed do-not-merge/needs-sig Indicates an issue or PR lacks a `sig/foo` label and requires one. labels Sep 13, 2023
@dims
Copy link
Member

dims commented Sep 13, 2023

/assign @BenTheElder @michelle192837

@upodroid
Copy link
Member Author

/kind cleanup

@k8s-ci-robot k8s-ci-robot added kind/cleanup Categorizes issue or PR as related to cleaning up code, process, or technical debt. and removed do-not-merge/needs-kind Indicates a PR lacks a `kind/foo` label and requires one. labels Sep 13, 2023
@upodroid
Copy link
Member Author

/cc @aojea @pohly

@k8s-ci-robot
Copy link
Contributor

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by: upodroid
Once this PR has been reviewed and has the lgtm label, please ask for approval from bentheelder. For more information see the Kubernetes Code Review Process.

The full list of commands accepted by this bot can be found here.

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@upodroid
Copy link
Member Author

/retest

@upodroid
Copy link
Member Author

/retest

@aojea
Copy link
Member

aojea commented Sep 20, 2023

/hold

we don't want to make the e2e test framework smart, and the goal is to remove all these cloud provider skips from the framework not add more ... the jobs should use the regex to skip tests, Patrick also had a kep to improve this mechanism using ginkgo tags

@k8s-ci-robot k8s-ci-robot added the do-not-merge/hold Indicates that a PR should not merge because someone has issued a /hold command. label Sep 20, 2023
@aojea
Copy link
Member

aojea commented Sep 20, 2023

@upodroid you definitely have to write a KEP under sig-testing if you plan to touch on kubernetes code base and making impactful changes on jobs and behaviors, so the SIGs can evaluate and be aware of the changes https://github.com/kubernetes/enhancements/tree/master/keps/sig-testing

@pohly
Copy link
Contributor

pohly commented Sep 20, 2023

I agree, TestContext.Tooling looks like a candidate for removal. My PR for labeling is #112894 (will get back to it soonish) and the kind-of-related KEP is https://github.com/kubernetes/enhancements/tree/master/keps/sig-testing/3041-node-conformance-and-features (might need a new owner).

@upodroid
Copy link
Member Author

/retest

As we discussed yesterday, I'm writing a doc that will form the KEP for this project.

In the meanwhile, can we remove the tests in test/e2e/network/firewall.go file? It tests gcp infra that is created by kube-up scripts, has nothing to do with Kubernetes functionality or the gcp cloud provider. If we can do that, then I don't have to introduce extra logic that uses the tooling flag.

@upodroid
Copy link
Member Author

/test pull-kubernetes-e2e-gce-cos-kubetest2

@k8s-ci-robot
Copy link
Contributor

@upodroid: The following test failed, say /retest to rerun all failed tests or /retest-required to rerun all mandatory failed tests:

Test name Commit Details Required Rerun command
pull-kubernetes-e2e-gce-cos-kubetest2 65e8871 link false /test pull-kubernetes-e2e-gce-cos-kubetest2

Full PR test history. Your PR dashboard. Please help us cut down on flakes by linking to an open issue when you hit one in your PR.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.

@@ -398,7 +398,7 @@ func RegisterClusterFlags(flags *flag.FlagSet) {
// If this becomes true as well, they should be refactored into RegisterCommonFlags.
flags.BoolVar(&TestContext.PrepullImages, "prepull-images", false, "If true, prepull images so image pull failures do not cause test failures.")
flags.StringVar(&TestContext.Provider, "provider", "", "The name of the Kubernetes provider (gce, gke, local, skeleton (the fallback if not set), etc.)")
flags.StringVar(&TestContext.Tooling, "tooling", "", "The tooling in use (kops, gke, etc.)")
flags.StringVar(&TestContext.Tooling, "tooling", "kube-up", "The tooling used to create the cluster (kops, gke, kube-up).")
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

we should not set this default

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This PR is being closed out. I needed to check something in the kubetest2 test.

/close

@k8s-ci-robot
Copy link
Contributor

@upodroid: Closed this PR.

In response to this:

This PR is being closed out. I needed to check something in the kubetest2 test.

/close

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/e2e-test-framework Issues or PRs related to refactoring the kubernetes e2e test framework area/test cncf-cla: yes Indicates the PR's author has signed the CNCF CLA. do-not-merge/hold Indicates that a PR should not merge because someone has issued a /hold command. kind/cleanup Categorizes issue or PR as related to cleaning up code, process, or technical debt. needs-priority Indicates a PR lacks a `priority/foo` label and requires one. needs-triage Indicates an issue or PR lacks a `triage/foo` label and requires one. release-note-none Denotes a PR that doesn't merit a release note. sig/network Categorizes an issue or PR as relevant to SIG Network. sig/testing Categorizes an issue or PR as relevant to SIG Testing. size/S Denotes a PR that changes 10-29 lines, ignoring generated files.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

7 participants