Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

TST: flaky test_complex_iir_dlti #18738

Merged
merged 1 commit into from Jun 25, 2023

Conversation

tylerjereddy
Copy link
Contributor

  • deals with the second part of TST, MAINT: some tests blocking 1.11.0 on MacOS ARM64 with NumPy 1.25.0 #18732

  • I was able to reproduce locally, but this one was even flakier--analysis of patch success below, and possibly related to subtle low-level MacOS ARM issues upstream in BUG: SciPy is seeing incorrect warnings on MacOS M1 (M2?) array * scalar numpy/numpy#23996 (NumPy 1.25.0)

  • before this patch, 4 trials of this command with pytest-repeat:
    CC=clang CXX=clang++ FC=gfortran-12 python dev.py test -t scipy/signal/tests/test_signaltools.py::TestDecimate::test_complex_iir_dlti -- --count=20000
    81 failed, 19919 passed in 43.68s
    81 failed, 19919 passed in 43.79s
    20000 passed in 33.24s
    43 failed, 19957 passed in 35.17s

  • after this patch, 6 trials of the same command:
    20000 passed in 30.44s
    20000 passed in 33.08s
    20000 passed in 33.46s
    20000 passed in 33.45s
    20000 passed in 33.56s
    20000 passed in 33.30s

[skip circle]

* deals with the second part of scipygh-18732

* I was able to reproduce locally, but this one was even
flakier--analysis of patch success below, and possibly
related to subtle low-level MacOS ARM issues upstream
in numpy/numpy#23996 (NumPy
`1.25.0`)

* before this patch, 4 trials of this command
with `pytest-repeat`:
`CC=clang CXX=clang++ FC=gfortran-12 python dev.py test -t scipy/signal/tests/test_signaltools.py::TestDecimate::test_complex_iir_dlti -- --count=20000`
`81 failed, 19919 passed in 43.68s`
`81 failed, 19919 passed in 43.79s`
`20000 passed in 33.24s`
`43 failed, 19957 passed in 35.17s`

* after this patch, 6 trials of the same command:
`20000 passed in 30.44s`
`20000 passed in 33.08s`
`20000 passed in 33.46s`
`20000 passed in 33.45s`
`20000 passed in 33.56s`
`20000 passed in 33.30s`

[skip circle]
@tylerjereddy tylerjereddy added scipy.signal backport-candidate This fix should be ported by a maintainer to previous SciPy versions. labels Jun 24, 2023
@tylerjereddy tylerjereddy added this to the 1.12.0 milestone Jun 24, 2023
@ev-br
Copy link
Member

ev-br commented Jun 25, 2023

Allowing for atol/rtol for floating-point comparisons looks a straightforward improvement, as requiring exact equality is nearly always too optimistic. So the green button it is. Thanks Tyler.

@ev-br ev-br merged commit 3860355 into scipy:main Jun 25, 2023
21 of 24 checks passed
@tylerjereddy tylerjereddy modified the milestones: 1.12.0, 1.11.0 Jun 25, 2023
@tylerjereddy tylerjereddy removed the backport-candidate This fix should be ported by a maintainer to previous SciPy versions. label Jun 25, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants