automation: Backport e2e tests to 2.8 #10552
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
yonasberhe23
force-pushed
the
backport_e2e_tests
branch
from
e001ca1
to
0eda85f
Compare
|
Thanks for consolidating all this @yonasberhe23, as discussed offline these are existing tests recently merged on latest but I'll defer to @richard-cox the code implementation to make it work on the 2.8 branch. This is the first backport too so this will set precedence for future backports and having feedback from dev is very important. LGTM from me. |
yonasberhe23
force-pushed
the
backport_e2e_tests
branch
from
3f1d1a1
to
8446089
Compare
yonasberhe23
force-pushed
the
backport_e2e_tests
branch
from
8446089
to
c1d8ee4
Compare
richard-cox
requested changes
Mar 22, 2024
There was a problem hiding this comment.
I've done a brief run through. Parrity with the latest e2e tests would be great, but it's a rather large investment.
The check-e2e-tags test job and script should be backported as well, to ensure all tests run.
Once this merges as well we should bring in branch protection blocking merging until e2e ci jobs pass (give me a prod when so and i'll update repo settings)
yonasberhe23
force-pushed
the
backport_e2e_tests
branch
from
6d34ffa
to
d28803b
Compare
richard-cox
approved these changes
Apr 2, 2024
* actions on cluster tests --------- Co-authored-by: Yonas Berhe <yberhe@Yonass-MacBook-Pro.local>
* actions on cluster tests * initial iteration for cluster drivers tests * node drivers tests * rke templates tests * cloud credentials tests and initial node templates tests * completed node templates tests * pod security admissions and policy templates * MachineDeployments MachineSets and Machines tests * repositories tests * filter out tests with @Jenkins tag
* amazon ec2 rke2 cluster tests * update saveAndWaitForRequest fn * add loading po and use in test * updates per change requests --------- Co-authored-by: Yonas Berhe <yberhe@Yonass-MacBook-Pro.local>
* Create matrix for E2E job * Create utility for mapping skipped tests for given dirs * Allow to filter any dir for given env vars Add Rancher setup phase in test CI Restore skip setup variable for other checks * Cypress config cleanup * Avoid use of tags for setup test Add setup tag * Add specs dir to the matrix Correct matrix to use each role Add tag prefix on command * Correct coverage path * Simplify cypress utility * Implement only env var filtering logic Update env var filtering with a menageable definition Update CI to filter paths by new logic Reorganize tests file tree Add tags for each section Combine roles and features specs Update new specs to the tag format Grouping tags Fix issues with specs and admin spec/username for login parallelization Fix issue pre-pending @ character Remove coupling Remove Docker stop Enable all the tests in groups Allow E2E matrix to fail with strategy flag fail-fast * Add role for setup in combination to features * Change tag AND to OR (space instead plus) * Exclude non tagged tests instead of skip * Correct standard user name * Use object for matrix definition; Restore usernames for tests; Remove hackish tag for role * Pair matrix role tag to multiple matrix features * Disable failing tests * Move diagnostic from extension to generic * Remove build dashboard flag for setup * Correct screenshot naming to match coverage file naming * Move Cypress utils out of shell * Remove View API check for fleet * Add documentation * Update skip logic and documentation * Update env template
* get support page tests * add navTo method for home page and enabled skipped tests after bug fix rancher/rancher-docs#727 * update support link per rancher#9870
yonasberhe23
force-pushed
the
backport_e2e_tests
branch
from
d28803b
to
71ee5bc
Compare
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Summary
Fixes # rancher/qa-tasks#1189
Technical notes summary
Backport the provisioning e2e tests (and their dependencies) to 2.8
-- Note: needed to add rke2PageTitle() fn manually to make aws test pass (the fn came from this Add missing routing segments or query parameters for cluster creation with RKE1/2 #10284)
-- cca20dc
-- e001ca1
-- 41fdf41
-- 3f1d1a1
Update: I've also added the changes to support running e2e tests in parallel in this backport to reduce the time it takes for the test run to complete
#9887
Checklist