Join GitHub today
GitHub is home to over 31 million developers working together to host and review code, manage projects, and build software together.Sign up
Running the testsuite several times fails #7792
Original bug ID: 7792
Running the testsuite several times results in spurious failures, due to the way some tests write to their log outputs -- they append to the log of the previous run instead of replacing them.
A workaround exists, namely running "make clean" in-between runs, but this behavior still results in confusing behaviors and some wasted time.
I have privately reported the issue to Sébastien Hinderer, the ocamltest author and maintainer, so I believe that the issue will eventually be fixed -- but it seems to be non-trivial. I am opening this issue for him to have a concrete MPR to refer to if useful, and in case other contributors would run into the same behavior and wonder if the issue is known.
Comment author: @gasche
For the record, below is the list of spurious failures that currently occur on subsequent runs:
List of failed tests:
List of unexpected errors: