Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Random failures in test suite #1

Closed
tillea opened this issue Sep 4, 2018 · 2 comments
Closed

Random failures in test suite #1

tillea opened this issue Sep 4, 2018 · 2 comments

Comments

@tillea
Copy link

tillea commented Sep 4, 2018

Hi,
the Debian package of garli received a bug report about random failures in the build time test suite. The bug reporter did about 100 builds in a row and reported a failure rate might be around 10%. He linked three example build logs (no idea how longs these logs will persist).
My solution was for the moment to substitute randseed of -1 to 1 in all config files of the test suite to have reproducible results. I noticed that even than the output of different runs is not identical - no idea how the test can be made fully reproducible). This will solve the Fails-To-Build-From-Source issue in Debian but I think it is worth reporting the issue here for further inspection.
Kind regards, Andreas.

@Ashod
Copy link
Owner

Ashod commented Nov 9, 2018

Hi Andreas,
Thanks for the feedback. I'm not the maintainer of this project. Best to report upstream.
Thanks.

@Ashod Ashod closed this as completed Nov 9, 2018
@tillea
Copy link
Author

tillea commented Nov 9, 2018 via email

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants