Join GitHub today
GitHub is home to over 28 million developers working together to host and review code, manage projects, and build software together.
Sign upTests are not deterministic #1556
Comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Diggsey commentedFeb 15, 2018
Problem Description
Many of the existing tests execute a
SELECTquery without anORDER BYclause, and then compare the results against a list of expected rows. At least for postgres, the order of rows returned is not defined, so the tests will sometimes fail.What is the expected output?
The tests should use an unordered comparison, eg. by putting the results in a
BTreeSetbefore comparing them, or should use anORDER BYclause on anySELECTqueries.Steps to reproduce
Unclear: running the tests for the first time on a brand new database caused it for me. Rerunning the tests resulted in the result order stabilising, and the tests passed after that.
Checklist