Join GitHub today
GitHub is home to over 40 million developers working together to host and review code, manage projects, and build software together.Sign up
Warn if any tests fail during baselining #111
I'd even go for failing if any test fails due this phase (by default). At least my tool for Ruby does go this way.
Its better for user education. Especially as baselining happens in parallel and most test suites by default cannot handle it at one or another point, its better to error out and force the user to think/fix that invariant.
This leads to less confusing end-user bug reports abut phantom coverage, and an overall better experience.
+1 for failing everything if baseline fails.
Btw I think I'll start working on that ASAP b/c I've seen it in production. Check out the change at:
The unmodified version of the code is a typo (or copy&paste error). There are many similar