Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix previously skipped tests that used to fail randomly #280

Merged
merged 20 commits into from
Aug 12, 2022

Conversation

rhugonnet
Copy link
Contributor

@rhugonnet rhugonnet commented Aug 9, 2022

This PR fixes 1 random failing test in test_fit.py by removing the pytest.skip (wrong behaviour fixed directly by scipy) and 2 failing tests in test_coreg.py due to changes in scipy.transform.warp NaN propagation.

Details below:

For the failure in test_fit.py, my best trick for fixing yet: waiting 😄! The issue with the random seed of scipy.optimize.basin_hopping seemed to have been fixed directly in scipy since the issue arose. I ran the test several times and it always passes now.

For the two tests that were skipped in test_coreg.py, they relate to issues with skimage.transform.warp. The tests let me think the behaviour has changed with NaNs, but I couldn't find anything in the release notes that would indicate it (https://scikit-image.org/docs/0.19.x/release_notes.html). We should keep in mind it's quite a young package.
Basically, warp now propagates NaNs with the order of interpolation, exactly the same as the "homemade" mask + dilation calculation that we use to do by default. So, using default parameters, results are unchanged. However, we cannot "ignore" the NaN propagation anymore, if that was part of the intended behaviour (I let @erikmannerfelt check that). There's probably more work needed to decide if we consistently use these functions within the package, as they are currently a bit apart.

Resolves #259
Resolves #209

@rhugonnet rhugonnet changed the title Unskip or fix tests that used to fail randomly Fix previously skipped tests that used to fail randomly Aug 9, 2022
Copy link
Member

@adehecq adehecq left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Great that the issues with tests are fixed !

@rhugonnet rhugonnet merged commit d7ef951 into GlacioHack:main Aug 12, 2022
@rhugonnet rhugonnet deleted the unskip_tests branch August 12, 2022 13:20
@adehecq
Copy link
Member

adehecq commented Aug 26, 2022

Which version of scipy is needed for the test_fit.py tests to run successfully?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Warp_dem tests failing after environment update between 10.21 and 04.22 Basinhopping randomly fails in CI
2 participants