Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Introduce randomization iterator #41

Closed
trentmwillis opened this issue Jul 2, 2016 · 1 comment
Closed

Introduce randomization iterator #41

trentmwillis opened this issue Jul 2, 2016 · 1 comment
Assignees

Comments

@trentmwillis
Copy link
Member

trentmwillis commented Jul 2, 2016

We should introduce a new command that runs the tests in random orderings for a certain number of iterations. This would be useful as an offline job that helps verify the stability of the given test suite.

Currently this can be approximated by building the app once and then pointing to the output as the source for the test. In pseudo-code:

ember build
for 0...N
  ember exam --path dist --split 3 --parallel --random

We should set up a simple way to invoke this (maybe ember exam:iterate <num> <pass-through options>) and report all test failures at the end.

Should probably look into seeing if we can leverage/learn from ember-try for this, as they already run test suites multiple times.

@trentmwillis
Copy link
Member Author

Implemented via #56.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant