Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

test: revert ganache termination on fixtures #7343

Merged
merged 1 commit into from
Sep 28, 2023
Merged

test: revert ganache termination on fixtures #7343

merged 1 commit into from
Sep 28, 2023

Conversation

seaona
Copy link
Contributor

@seaona seaona commented Sep 27, 2023

Description

This PR brings back ganache termination on withFixtures after discovering the root cause for the flaky tests.
Ganache termination was moved to hooks, because it seemed to help reduce the flaky tests, but now that we've discovered the real root cause of the problem, ganache termination can be moved back to fixtures, where it was.

There was a PR merged a couple of weeks ago which introduced maxWorkers: 3 on ci. This makes tests run in parallel but does not parallelize the environment, making all our servers using the same ports to collision and fail.To confirm the theory, in this branch I disabled maxWorkers and all Confirmations tests run successfully.
https://app.bitrise.io/app/be69d4368ee7e86d/pipelines/8381384d-19f4-4b91-a259-4f5de572e264

Manual testing steps

Running all Confirmations test without parallelization.
Successful run here: https://app.bitrise.io/app/be69d4368ee7e86d/pipelines/8381384d-19f4-4b91-a259-4f5de572e264

Screenshots/Recordings

Screenshot from 2023-09-27 13-59-32

Before

/

After

/

Related issues

Fixes https://github.com/MetaMask/mobile-planning/issues/1286

Pre-merge author checklist

  • I’ve followed MetaMask Coding Standards.
  • I've clearly explained:
    • What problem this PR is solving.
    • How this problem was solved.
    • How reviewers can test my changes.
  • I’ve indicated what issue this PR is linked to: Fixes #???
  • I’ve included tests if applicable.
  • I’ve documented any added code.
  • I’ve applied the right labels on the PR (see labeling guidelines).
  • I’ve properly set the pull request status:
    • In case it's not yet "ready for review", I've set it to "draft".
    • In case it's "ready for review", I've changed it from "draft" to "non-draft".

Pre-merge reviewer checklist

  • I've manually tested the PR (e.g. pull and build branch, run the app, test code being changed).
  • I confirm that this PR addresses all acceptance criteria described in the ticket it closes and includes the necessary testing evidence such as recordings and or screenshots.

@seaona seaona added the team-confirmations-secure-ux-PR PR from the confirmations team label Sep 27, 2023
@github-actions
Copy link
Contributor

CLA Signature Action: All authors have signed the CLA. You may need to manually re-run the blocking PR check if it doesn't pass in a few minutes.

@sonarcloud
Copy link

sonarcloud bot commented Sep 27, 2023

Kudos, SonarCloud Quality Gate passed!    Quality Gate passed

Bug A 0 Bugs
Vulnerability A 0 Vulnerabilities
Security Hotspot A 0 Security Hotspots
Code Smell A 0 Code Smells

No Coverage information No Coverage information
No Duplication information No Duplication information

@seaona seaona marked this pull request as ready for review September 27, 2023 12:35
@seaona seaona requested a review from a team as a code owner September 27, 2023 12:35
@seaona seaona merged commit ea72e26 into main Sep 28, 2023
30 checks passed
@seaona seaona deleted the test-reorg branch September 28, 2023 13:37
@github-actions github-actions bot locked and limited conversation to collaborators Sep 28, 2023
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

4 participants