Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

add a dedicated job for testing vac feature #31717

Merged

Conversation

carlory
Copy link
Member

@carlory carlory commented Jan 25, 2024

There's no job which can be used to run e2e tests for the VolumeAttributes feature. This PR adds a dedicated job in the sig-storage directory.

e2e tests for vac:

Some discussion can be found in the #31666.

/cc @pohly @xing-yang @msau42 @sunnylovestiramisu

@k8s-ci-robot k8s-ci-robot added cncf-cla: yes Indicates the PR's author has signed the CNCF CLA. size/L Denotes a PR that changes 100-499 lines, ignoring generated files. area/config Issues or PRs related to code in /config area/jobs sig/storage Categorizes an issue or PR as relevant to SIG Storage. sig/testing Categorizes an issue or PR as relevant to SIG Testing. labels Jan 25, 2024
@carlory carlory force-pushed the add-dedicated-job-for-vac-feature branch 3 times, most recently from 4625d59 to 68df848 Compare January 25, 2024 06:14
@k8s-ci-robot k8s-ci-robot added size/M Denotes a PR that changes 30-99 lines, ignoring generated files. and removed size/L Denotes a PR that changes 100-499 lines, ignoring generated files. labels Jan 25, 2024
@carlory carlory force-pushed the add-dedicated-job-for-vac-feature branch from 68df848 to 394d2ec Compare January 25, 2024 06:37
@@ -54,6 +54,54 @@ presubmits:
cpu: "2"
memory: "6Gi"

# This jobs runs e2e.test with a focus on tests for the VolumeAttributesClass feature (currently alpha)
# on a kind cluster
- name: pull-kubernetes-e2e-storage-kind-vac-feature
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Does SIG Storage have other features that need a special cluster?

It might make more sense to have a pull-kubernetes-e2e-storage-kind-alpha-features job where SIG storage alpha feature gates + API groups are enabled and then all tests for those run. Because this is a job owned by the SIG, you know when to update this job during feature promotion.

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I don't know but I believe that the answer will be yes. Perhaps we need the feature owner to complete this section as well when they add e2e tests.

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

even if the feature is promoted to beta, the cluster created by the alpha job still turns on the feature gate regardless of what the feature-gate stage is.

So I want to rename the job to pull-kubernetes-e2e-storage-kind-alpha-beta-features in order to void the confusion.

cc @pohly

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

That name works for me.

We still have the confusion between "job that tests alpha/beta features" (this one here) vs. "job which tests GA features with alpha/beta features enabled" (the SIG Testing jobs), but I can't think of better names.

config/jobs/kubernetes/sig-storage/sig-storage-kind.yaml Outdated Show resolved Hide resolved
config/jobs/kubernetes/sig-storage/sig-storage-kind.yaml Outdated Show resolved Hide resolved
config/jobs/kubernetes/sig-storage/sig-storage-kind.yaml Outdated Show resolved Hide resolved
Co-authored-by: Patrick Ohly <patrick.ohly@intel.com>
@carlory carlory force-pushed the add-dedicated-job-for-vac-feature branch from fcb1467 to e9853a7 Compare January 25, 2024 07:41
@@ -54,6 +54,52 @@ presubmits:
cpu: "2"
memory: "6Gi"

# This jobs runs e2e.test with a focus on tests for all alpha storage features on a kind cluster
- name: pull-kubernetes-e2e-storage-kind-alpha-features
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Does this mean even for a change without alpha feature change, it will still run to make sure the PR does not break our alpha changes?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It need be triggered manually by PR author via /test pull-kubernetes-e2e-storage-kind-alpha-features command. I'm not sure whether it should be run automatically when PR is created or not. cc @pohly i.e.

always_run: true
optional: true

There's a periodic job ci-kubernetes-e2e-storage-kind-alpha-features that runs this test periodically.

Once the feature is GA, we can drop \[Feature:VolumeAttributesClass\] from the FOCUS env.

@sunnylovestiramisu
Copy link
Contributor

/lgtm

@k8s-ci-robot k8s-ci-robot added the lgtm "Looks good to me", indicates that a PR is ready to be merged. label Feb 5, 2024
@k8s-ci-robot k8s-ci-robot added the do-not-merge/hold Indicates that a PR should not merge because someone has issued a /hold command. label Feb 6, 2024
@sunnylovestiramisu
Copy link
Contributor

Discussed with @msau42, we should move everything to kind, and not use sig-cloud-provider, the future of sig-cloud-provider is uncertain and each provider is not committed to make sure it is up to date.

@carlory
Copy link
Member Author

carlory commented Feb 23, 2024

/hold cancel

@k8s-ci-robot k8s-ci-robot removed the do-not-merge/hold Indicates that a PR should not merge because someone has issued a /hold command. label Feb 23, 2024
@carlory
Copy link
Member Author

carlory commented Feb 23, 2024

/cc @pohly

@xing-yang
Copy link
Contributor

/lgtm
/approve

@k8s-ci-robot
Copy link
Contributor

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: carlory, xing-yang

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@k8s-ci-robot k8s-ci-robot added the approved Indicates a PR has been approved by an approver from all required OWNERS files. label Feb 27, 2024
@k8s-ci-robot k8s-ci-robot merged commit fe136cc into kubernetes:master Feb 27, 2024
7 checks passed
@k8s-ci-robot
Copy link
Contributor

@carlory: Updated the job-config configmap in namespace default at cluster test-infra-trusted using the following files:

  • key sig-storage-kind.yaml using file config/jobs/kubernetes/sig-storage/sig-storage-kind.yaml

In response to this:

There's no job which can be used to run e2e tests for the VolumeAttributes feature. This PR adds a dedicated job in the sig-storage directory.

e2e tests for vac:

Some discussion can be found in the #31666.

/cc @pohly @xing-yang @msau42 @sunnylovestiramisu

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
approved Indicates a PR has been approved by an approver from all required OWNERS files. area/config Issues or PRs related to code in /config area/jobs cncf-cla: yes Indicates the PR's author has signed the CNCF CLA. lgtm "Looks good to me", indicates that a PR is ready to be merged. sig/storage Categorizes an issue or PR as relevant to SIG Storage. sig/testing Categorizes an issue or PR as relevant to SIG Testing. size/M Denotes a PR that changes 30-99 lines, ignoring generated files.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

7 participants