Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Temporary improvement for CI success rate #4136

Merged
merged 12 commits into from
Jan 20, 2022
Merged

Conversation

castelblanque
Copy link
Collaborator

Description of the change

Trying to put some remediation to the CI problems we are having.

This PR mainly disables the 05-missing-permissions.js for now, until we complete migration to new test engine (#2898).

There is also an increase in the replicas for some deployments to rule out the possibility of requests being lost due to single replica.

Some workarounds in Puppeteer are included too, like await Promise.all([ ... ]) for waiting events. Explained in official documentation here.

Benefits

CI pipelines should have a higher success rate leaving 05 out of the list.

Possible drawbacks

This should be a temporary workaround until new e2e test engine is in place.

Applicable issues

Rafa Castelblanque added 12 commits January 18, 2022 14:57
Signed-off-by: Rafa Castelblanque <rcastelblanq@vmware.com>
Signed-off-by: Rafa Castelblanque <rcastelblanq@vmware.com>
Signed-off-by: Rafa Castelblanque <rcastelblanq@vmware.com>
Signed-off-by: Rafa Castelblanque <rcastelblanq@vmware.com>
Signed-off-by: Rafa Castelblanque <rcastelblanq@vmware.com>
Signed-off-by: Rafa Castelblanque <rcastelblanq@vmware.com>
Signed-off-by: Rafa Castelblanque <rcastelblanq@vmware.com>
Signed-off-by: Rafa Castelblanque <rcastelblanq@vmware.com>
Signed-off-by: Rafa Castelblanque <rcastelblanq@vmware.com>
Signed-off-by: Rafa Castelblanque <rcastelblanq@vmware.com>
Signed-off-by: Rafa Castelblanque <rcastelblanq@vmware.com>
Signed-off-by: Rafa Castelblanque <rcastelblanq@vmware.com>
@castelblanque castelblanque changed the title 4102 ci tests failing Temporary improvement for CI success rate Jan 20, 2022
Copy link
Contributor

@antgamdia antgamdia left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1 as it is a temporary workaround and we are actively working on spinning up a new e2e engine. Let's see if our CI pass rate improves.

@castelblanque castelblanque merged commit 70f0fe8 into master Jan 20, 2022
@castelblanque castelblanque deleted the 4102-CI-tests-failing branch January 20, 2022 11:47
@castelblanque
Copy link
Collaborator Author

With 05 test disabled, 4 out of 5 runs in CI have succeeded. Looks promising!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Step 5 of E2E tests is consistently failing
2 participants