You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Therefore I suspect that the tests 198, 412, 606, 674, and 699 are not deterministic and should be reviewed. More may be affected as well.
The results were obtained with sudo ./run-test-suite.sh.
The text was updated successfully, but these errors were encountered:
For many tests, the test suite has a timeout period for watching the log output for a string match. On slow machines, and particularly when using firewalld, this timeout period is sometimes not long enough. If we made it long enough for the slowest machines (a Raspberry Pi, for instance), the test suite would take a ridiculously long time to complete.
I'm not sure this explains every non-deterministic test, but was what I encountered when testing on non-x86 systems, about a year ago.
Running the tests twice, on
master
, with the same binaries, on the same Linux VM, yield different results:Therefore I suspect that the tests 198, 412, 606, 674, and 699 are not deterministic and should be reviewed. More may be affected as well.
The results were obtained with
sudo ./run-test-suite.sh
.The text was updated successfully, but these errors were encountered: