-
Notifications
You must be signed in to change notification settings - Fork 3.3k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[#12059] Separate stable and unstable E2E tests #12515
[#12059] Separate stable and unstable E2E tests #12515
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
The changes from this PR doesn't solve the problem. It is merely separating to a different step, which means if all 5 attempts failed, everything (including the stable tests) needs to be started from the beginning.
Folks, This PR seems to be stalling (no activities for the past 7 days). 🐌 😢 |
@wkurniawan07 / any other contributors free to review this PR? I'm not familiar with GitHub workflows... Also, should the "E2E-testing (firefox)" check still be there? Not sure if by updating the workflow it should be removed: |
Fixes #12059
Outline of Solution
Moves tests that frequently require multiple test runs into a separate Github job within the same E2E testing workflow.
Created a new command within build.gradle to run only tests specified in
src/e2e/resources/testng-unstable-e2e.xml
Run stable tests:
./gradleW e2eTests
Run unstable tests:
./gradleW e2eTests -Punstable