Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[e2e] Brody/e2e parallel #5786

Merged
merged 8 commits into from
May 31, 2024
Merged

[e2e] Brody/e2e parallel #5786

merged 8 commits into from
May 31, 2024

Conversation

BrodyHughes
Copy link
Member

@BrodyHughes BrodyHughes commented May 29, 2024

What changed (plus any additional context for devs)

  • increased num of workers so tests can run in parallel
  • reduced num of retries (just extends failure time. 3 seems sufficient)

@BrodyHughes BrodyHughes changed the title [WIP] [e2e] Brody/e2e parallel [e2e] Brody/e2e parallel May 30, 2024
Comment on lines +25 to +27
"detox:ios:tests": "detox test -c ios.sim.debug --maxWorkers 2 -- --bail 1",
"detox:ios": "detox build -c ios.sim.debug | xcpretty --color && yarn detox:ios:tests",
"detox:ios:release": "detox build -c ios.sim.release && detox test -c ios.sim.release --maxWorkers 2 -- --bail 1",
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

what happens when maxWorkers > 2?

Copy link
Member Author

@BrodyHughes BrodyHughes May 31, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

more parallelization, but diminishing returns obvs. we have 6 tests RIGHT NOW with more to come.

1 worker = 16 mins
2 workers = 8 mins
3 workers = 5.33 mins

right now 4+ workers is awkward bc the tests become uneven so it caps out at 5.33 minutes until we hit 6 workers (num of tests).

once we add more workers and split up the tests more i think the flakiness could become a concern bc of how split resources become. i'll see how far i can push it tho! i think at least 3 is probably good.

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

yeah i tried it out it seemed like more than 2 workers currently introduces some flakiness

@BrodyHughes BrodyHughes merged commit a510759 into develop May 31, 2024
6 checks passed
@BrodyHughes BrodyHughes deleted the brody/e2e-parallel branch May 31, 2024 19:20
BrodyHughes added a commit that referenced this pull request Jun 1, 2024
…nt-test-3

* 'develop' of github.com:rainbow-me/rainbow:
  Bring in flashbots functionality for networks that support it (#5800)
  Swaps: logic, data flow, and performance fixes (#5787)
  remove limit from token to buy list (#5795)
  [e2e] Brody/e2e parallel (#5786)
BrodyHughes added a commit that referenced this pull request Jun 3, 2024
* 'develop' of github.com:rainbow-me/rainbow:
  Bring in flashbots functionality for networks that support it (#5800)
  Swaps: logic, data flow, and performance fixes (#5787)
  remove limit from token to buy list (#5795)
  [e2e] Brody/e2e parallel (#5786)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants