Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How can we repeat the failed test cases only without repeating the whole shared #636

Closed
moatazeldebsy opened this issue Feb 4, 2020 · 3 comments
Milestone

Comments

@moatazeldebsy
Copy link

How can we repeat the failed test cases only without repeating the whole shared

For example if we have 10 tests running on one device and we have 1 failed test, flank running the 10 tests again

@Kurt-Bonatz
Copy link
Contributor

num-flaky-test-attempts maps directly to Firebase's config so Firebase is the one who controls that.

It's seems like a possible feature for Flank to coalesce all failed tests in a matrix and retry them. However, it might be less performant then Firebase retrying an entire shard if they use the same allocated emulator for the re-run.

@bootstraponline
Copy link
Contributor

I think this will be solved once Flank adopts server side sharding. That should happen in the next 1-2 weeks.

@bootstraponline bootstraponline added this to the May 2020 milestone Mar 6, 2020
@bootstraponline
Copy link
Contributor

Flank master has support for server side sharding. Only failed test cases will be repeated when using server side sharding. :)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants