Option to stop tests earlier if more than n fail

[hadley]

Because it typically indicates something is seriously wrong, and you just want to see the errors right away.

[hadley]

@krlmlr how do you feel about this being the default behaviour? i.e. if there are > getOption("testthat.summary.max_reports", 15L) we terminate reporter early?

[krlmlr]

Now included in #502.

[hadley]

This is mildly tricky as we need a new subclass of stop that will immediately terminate execution of the entire test suite, and not get captured like usual errors.

[krlmlr]

Could you please check if hadley@de82b5b would also work?

[hadley]

I wrote my comment on the plane a couple of days ago when I didn't have internet access and only just submitted it. I think your approach is fine.

[krlmlr]

Offline comments? Intriguing. (Or was it just an open browser tab? ;-) )

[hadley]

Open browser tab ;)