Currently we do not count any tests that are out of order as passed, so test files with out of order tests do not pass, but this is currently dumb luck. The parse_tapstream method needs to be modified to detect out of order tests and still count which pass and fail.
There was a bug where the final tally of failed tests was incorrect, because only 1 failing test was counted per file, instead of the number of tests that actually failed in that file. There are no tests to change because the harness code that prints results is not tested. This sucks, and if you don't like it, patches welcome!
I would rather get the cuser time, but Parrot does not yet support that. I have created TT#1379 (http://trac.parrot.org/parrot/ticket/1379) to track this.
…uments as well
…ternal projects # chromatic++ We now generate PBC for all PIR files and then load_bytecode() those instead of include()'ing PIR. Thanks to chromatic++ for showing me the ":load :anon" black magic trick.
Trying to debug this: (kadath)(~/git/tapir master )$ ~/svn/parrot/parrot t/harness.pir t/*.t t/00-sanity.t ................. failed 0/0 tests, exit code = 1 t/01-parse_plan.t ............. failed 0/0 tests, exit code = 1 t/02-parse_tapstream.t ........ failed 0/0 tests, exit code = 1 t/03-parse_tapstream_error.t .. failed 0/0 tests, exit code = 1 FAILED 4 test(s) in 4/4 files