Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

when tests fail with `--shuffle`, how to run tests in the failing order? #656

Closed
gr2m opened this issue Nov 3, 2016 · 0 comments · Fixed by #657
Assignees
Labels
Milestone

Comments

@gr2m
Copy link

@gr2m gr2m commented Nov 3, 2016

I found an issue with our tests using the --shuffle flag. Now instead of manually changing the order of my tests to reproduce it, is there a way to run the tests in the order they fail?

rmehner added a commit to rmehner/lab that referenced this issue Nov 3, 2016
This is useful, when you run into an order dependent test failure. The
runner reports the used seed after the test run. If you want to maintain
the same test run order for the next run, you can re-use the seed and
you get the same order.

For example: `lab test/unit --shuffle --seed 1234`

Fixes hapijs#656
rmehner added a commit to rmehner/lab that referenced this issue Nov 3, 2016
This is useful, when you run into an order dependent test failure. The
runner reports the used seed after the test run. If you want to maintain
the same test run order for the next run, you can re-use the seed and
you get the same order.

For example: `lab test/unit --shuffle --seed 1234`

Fixes hapijs#656
rmehner added a commit to rmehner/lab that referenced this issue Nov 4, 2016
This is useful, when you run into an order dependent test failure. The
runner reports the used seed after the test run. If you want to maintain
the same test run order for the next run, you can re-use the seed and
you get the same order.

For example: `lab test/unit --shuffle --seed 1234`

Fixes hapijs#656
@geek geek added the request label Nov 5, 2016
rmehner added a commit to rmehner/lab that referenced this issue Nov 7, 2016
This is useful, when you run into an order dependent test failure. The
runner reports the used seed after the test run. If you want to maintain
the same test run order for the next run, you can re-use the seed and
you get the same order.

For example: `lab test/unit --shuffle --seed 1234`

Fixes hapijs#656
@geek geek closed this in #657 Nov 7, 2016
geek added a commit that referenced this issue Nov 7, 2016
This is useful, when you run into an order dependent test failure. The
runner reports the used seed after the test run. If you want to maintain
the same test run order for the next run, you can re-use the seed and
you get the same order.

For example: `lab test/unit --shuffle --seed 1234`

Fixes #656
@gr2m gr2m added feature and removed request labels Nov 7, 2016
@gr2m gr2m assigned geek Nov 7, 2016
@gr2m gr2m added this to the 11.2.0 milestone Nov 7, 2016
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
2 participants
You can’t perform that action at this time.