Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

When running multiple tests, failures can be "swallowed" #127

Closed
jteller opened this issue Oct 23, 2018 · 1 comment
Closed

When running multiple tests, failures can be "swallowed" #127

jteller opened this issue Oct 23, 2018 · 1 comment

Comments

@jteller
Copy link
Contributor

jteller commented Oct 23, 2018

We run multiple tests from a single config, and introduced an error in the second test in the group. This failure was not noticed, because each test reuses the same temp directory so report.json from the previous run is reused. That means that even though the run fails, we report data for the previous run.
@jteller
Copy link
Contributor Author

jteller commented Oct 23, 2018

I just tested, and #126 fixes my issue (failure will result in no data posted to the screen or remote reporter: which is the desired behavior).

@jteller jteller mentioned this issue Oct 23, 2018
Merged
@sf-wind sf-wind closed this as completed Oct 23, 2018
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@sf-wind @jteller