Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

test_mpmath failures #3604

Closed
Arfrever opened this issue May 2, 2014 · 5 comments
Closed

test_mpmath failures #3604

Arfrever opened this issue May 2, 2014 · 5 comments
Labels
defect A clear bug or issue that prevents SciPy from being installed or used as expected scipy.special

Comments

@Arfrever
Copy link

Arfrever commented May 2, 2014

6 tests of scipy/special/tests/test_mpmath.py of SciPy 0.14.0rc2 fail with each version of Python (2.6, 2.7, 3.1, 3.2, 3.3, 3.4).
This problem does not occur in SciPy 0.13.3.

======================================================================
FAIL: test_mpmath.TestSystematic.test_airyai
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/usr/lib64/python3.4/site-packages/nose/case.py", line 198, in runTest
    self.test(*self.arg)
  File "/usr/lib64/python3.4/site-packages/numpy/testing/decorators.py", line 146, in skipper_func
    return f(*args, **kwargs)
  File "/var/tmp/portage/sci-libs/scipy-0.14.0_rc2-r1000/work/scipy-0.14.0rc2/test-3.4/lib/python/scipy/special/tests/test_mpmath.py", line 654, in test_airyai
    rtol=1e-5)
  File "/var/tmp/portage/sci-libs/scipy-0.14.0_rc2-r1000/work/scipy-0.14.0rc2/test-3.4/lib/python/scipy/special/tests/test_mpmath.py", line 492, in assert_mpmath_equal
    d.check()
  File "/var/tmp/portage/sci-libs/scipy-0.14.0_rc2-r1000/work/scipy-0.14.0rc2/test-3.4/lib/python/scipy/special/tests/test_mpmath.py", line 479, in check
    reraise(*sys.exc_info())
  File "/var/tmp/portage/sci-libs/scipy-0.14.0_rc2-r1000/work/scipy-0.14.0rc2/test-3.4/lib/python/scipy/lib/six.py", line 203, in reraise
    raise value
  File "/var/tmp/portage/sci-libs/scipy-0.14.0_rc2-r1000/work/scipy-0.14.0rc2/test-3.4/lib/python/scipy/special/tests/test_mpmath.py", line 475, in check
    nan_ok=True)
  File "/var/tmp/portage/sci-libs/scipy-0.14.0_rc2-r1000/work/scipy-0.14.0rc2/test-3.4/lib/python/scipy/special/_testutils.py", line 87, in assert_func_equal
    fdata.check()
  File "/var/tmp/portage/sci-libs/scipy-0.14.0_rc2-r1000/work/scipy-0.14.0rc2/test-3.4/lib/python/scipy/special/_testutils.py", line 292, in check
    assert_(False, "\n".join(msg))
  File "/usr/lib64/python3.4/site-packages/numpy/testing/utils.py", line 44, in assert_
    raise AssertionError(msg)
AssertionError: 
Max |adiff|: 0.000624184
Max |rdiff|: 1
Bad results (1 out of 4591) for the following points (in output 0):
            -837677.6400682924 =>          -0.015263082212163263 !=           -0.01463889811977961  (rdiff           0.042638734642211566)

======================================================================
FAIL: test_mpmath.TestSystematic.test_airyai_prime
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/usr/lib64/python3.4/site-packages/nose/case.py", line 198, in runTest
    self.test(*self.arg)
  File "/usr/lib64/python3.4/site-packages/numpy/testing/decorators.py", line 146, in skipper_func
    return f(*args, **kwargs)
  File "/var/tmp/portage/sci-libs/scipy-0.14.0_rc2-r1000/work/scipy-0.14.0rc2/test-3.4/lib/python/scipy/special/tests/test_mpmath.py", line 669, in test_airyai_prime
    rtol=1e-5)
  File "/var/tmp/portage/sci-libs/scipy-0.14.0_rc2-r1000/work/scipy-0.14.0rc2/test-3.4/lib/python/scipy/special/tests/test_mpmath.py", line 492, in assert_mpmath_equal
    d.check()
  File "/var/tmp/portage/sci-libs/scipy-0.14.0_rc2-r1000/work/scipy-0.14.0rc2/test-3.4/lib/python/scipy/special/tests/test_mpmath.py", line 479, in check
    reraise(*sys.exc_info())
  File "/var/tmp/portage/sci-libs/scipy-0.14.0_rc2-r1000/work/scipy-0.14.0rc2/test-3.4/lib/python/scipy/lib/six.py", line 203, in reraise
    raise value
  File "/var/tmp/portage/sci-libs/scipy-0.14.0_rc2-r1000/work/scipy-0.14.0rc2/test-3.4/lib/python/scipy/special/tests/test_mpmath.py", line 475, in check
    nan_ok=True)
  File "/var/tmp/portage/sci-libs/scipy-0.14.0_rc2-r1000/work/scipy-0.14.0rc2/test-3.4/lib/python/scipy/special/_testutils.py", line 87, in assert_func_equal
    fdata.check()
  File "/var/tmp/portage/sci-libs/scipy-0.14.0_rc2-r1000/work/scipy-0.14.0rc2/test-3.4/lib/python/scipy/special/_testutils.py", line 292, in check
    assert_(False, "\n".join(msg))
  File "/usr/lib64/python3.4/site-packages/numpy/testing/utils.py", line 44, in assert_
    raise AssertionError(msg)
AssertionError: 
Max |adiff|: 1.46753
Max |rdiff|: 1
Bad results (1 out of 4591) for the following points (in output 0):
            -837677.6400682924 =>              -9.10697866374365 !=            -10.574506085105641  (rdiff            0.13877976044942908)

======================================================================
FAIL: test_mpmath.TestSystematic.test_airybi
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/usr/lib64/python3.4/site-packages/nose/case.py", line 198, in runTest
    self.test(*self.arg)
  File "/usr/lib64/python3.4/site-packages/numpy/testing/decorators.py", line 146, in skipper_func
    return f(*args, **kwargs)
  File "/var/tmp/portage/sci-libs/scipy-0.14.0_rc2-r1000/work/scipy-0.14.0rc2/test-3.4/lib/python/scipy/special/tests/test_mpmath.py", line 684, in test_airybi
    rtol=1e-5)
  File "/var/tmp/portage/sci-libs/scipy-0.14.0_rc2-r1000/work/scipy-0.14.0rc2/test-3.4/lib/python/scipy/special/tests/test_mpmath.py", line 492, in assert_mpmath_equal
    d.check()
  File "/var/tmp/portage/sci-libs/scipy-0.14.0_rc2-r1000/work/scipy-0.14.0rc2/test-3.4/lib/python/scipy/special/tests/test_mpmath.py", line 479, in check
    reraise(*sys.exc_info())
  File "/var/tmp/portage/sci-libs/scipy-0.14.0_rc2-r1000/work/scipy-0.14.0rc2/test-3.4/lib/python/scipy/lib/six.py", line 203, in reraise
    raise value
  File "/var/tmp/portage/sci-libs/scipy-0.14.0_rc2-r1000/work/scipy-0.14.0rc2/test-3.4/lib/python/scipy/special/tests/test_mpmath.py", line 475, in check
    nan_ok=True)
  File "/var/tmp/portage/sci-libs/scipy-0.14.0_rc2-r1000/work/scipy-0.14.0rc2/test-3.4/lib/python/scipy/special/_testutils.py", line 87, in assert_func_equal
    fdata.check()
  File "/var/tmp/portage/sci-libs/scipy-0.14.0_rc2-r1000/work/scipy-0.14.0rc2/test-3.4/lib/python/scipy/special/_testutils.py", line 292, in check
    assert_(False, "\n".join(msg))
  File "/usr/lib64/python3.4/site-packages/numpy/testing/utils.py", line 44, in assert_
    raise AssertionError(msg)
AssertionError: 
Max |adiff|: 6.95924e+286
Max |rdiff|: 0.232353
Bad results (1 out of 4018) for the following points (in output 0):
            -837677.6400682924 =>           0.014238254060790373 !=            0.01155371444970392  (rdiff            0.23235294785697674)

======================================================================
FAIL: test_mpmath.TestSystematic.test_airybi_prime
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/usr/lib64/python3.4/site-packages/nose/case.py", line 198, in runTest
    self.test(*self.arg)
  File "/usr/lib64/python3.4/site-packages/numpy/testing/decorators.py", line 146, in skipper_func
    return f(*args, **kwargs)
  File "/var/tmp/portage/sci-libs/scipy-0.14.0_rc2-r1000/work/scipy-0.14.0rc2/test-3.4/lib/python/scipy/special/tests/test_mpmath.py", line 699, in test_airybi_prime
    rtol=1e-5)
  File "/var/tmp/portage/sci-libs/scipy-0.14.0_rc2-r1000/work/scipy-0.14.0rc2/test-3.4/lib/python/scipy/special/tests/test_mpmath.py", line 492, in assert_mpmath_equal
    d.check()
  File "/var/tmp/portage/sci-libs/scipy-0.14.0_rc2-r1000/work/scipy-0.14.0rc2/test-3.4/lib/python/scipy/special/tests/test_mpmath.py", line 479, in check
    reraise(*sys.exc_info())
  File "/var/tmp/portage/sci-libs/scipy-0.14.0_rc2-r1000/work/scipy-0.14.0rc2/test-3.4/lib/python/scipy/lib/six.py", line 203, in reraise
    raise value
  File "/var/tmp/portage/sci-libs/scipy-0.14.0_rc2-r1000/work/scipy-0.14.0rc2/test-3.4/lib/python/scipy/special/tests/test_mpmath.py", line 475, in check
    nan_ok=True)
  File "/var/tmp/portage/sci-libs/scipy-0.14.0_rc2-r1000/work/scipy-0.14.0rc2/test-3.4/lib/python/scipy/special/_testutils.py", line 87, in assert_func_equal
    fdata.check()
  File "/var/tmp/portage/sci-libs/scipy-0.14.0_rc2-r1000/work/scipy-0.14.0rc2/test-3.4/lib/python/scipy/special/_testutils.py", line 292, in check
    assert_(False, "\n".join(msg))
  File "/usr/lib64/python3.4/site-packages/numpy/testing/utils.py", line 44, in assert_
    raise AssertionError(msg)
AssertionError: 
Max |adiff|: 6.99493e+287
Max |rdiff|: 0.232353
Bad results (1 out of 4018) for the following points (in output 0):
            -837677.6400682924 =>            -10.285097874613685 !=             -13.39821213488822  (rdiff            0.23235296089753305)

======================================================================
FAIL: test_mpmath.TestSystematic.test_fresnelc
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/usr/lib64/python3.4/site-packages/nose/case.py", line 198, in runTest
    self.test(*self.arg)
  File "/usr/lib64/python3.4/site-packages/numpy/testing/decorators.py", line 146, in skipper_func
    return f(*args, **kwargs)
  File "/var/tmp/portage/sci-libs/scipy-0.14.0_rc2-r1000/work/scipy-0.14.0rc2/test-3.4/lib/python/scipy/special/tests/test_mpmath.py", line 1075, in test_fresnelc
    [Arg()])
  File "/var/tmp/portage/sci-libs/scipy-0.14.0_rc2-r1000/work/scipy-0.14.0rc2/test-3.4/lib/python/scipy/special/tests/test_mpmath.py", line 492, in assert_mpmath_equal
    d.check()
  File "/var/tmp/portage/sci-libs/scipy-0.14.0_rc2-r1000/work/scipy-0.14.0rc2/test-3.4/lib/python/scipy/special/tests/test_mpmath.py", line 479, in check
    reraise(*sys.exc_info())
  File "/var/tmp/portage/sci-libs/scipy-0.14.0_rc2-r1000/work/scipy-0.14.0rc2/test-3.4/lib/python/scipy/lib/six.py", line 203, in reraise
    raise value
  File "/var/tmp/portage/sci-libs/scipy-0.14.0_rc2-r1000/work/scipy-0.14.0rc2/test-3.4/lib/python/scipy/special/tests/test_mpmath.py", line 475, in check
    nan_ok=True)
  File "/var/tmp/portage/sci-libs/scipy-0.14.0_rc2-r1000/work/scipy-0.14.0rc2/test-3.4/lib/python/scipy/special/_testutils.py", line 87, in assert_func_equal
    fdata.check()
  File "/var/tmp/portage/sci-libs/scipy-0.14.0_rc2-r1000/work/scipy-0.14.0rc2/test-3.4/lib/python/scipy/special/_testutils.py", line 292, in check
    assert_(False, "\n".join(msg))
  File "/usr/lib64/python3.4/site-packages/numpy/testing/utils.py", line 44, in assert_
    raise AssertionError(msg)
AssertionError: 
Max |adiff|: 1.04287e-05
Max |rdiff|: 2.08577e-05
Bad results (4 out of 4685) for the following points (in output 0):
           -38370.724549227845 =>            -0.5000052143682604 !=            -0.4999947856315382  (rdiff         2.0857690963751944e-05)
           -23593.914430440476 =>            -0.5000031689724854 !=            -0.4999968310273683  (rdiff         1.2675970573844866e-05)
            23593.914430440476 =>             0.5000031689724854 !=             0.4999968310273683  (rdiff         1.2675970573844866e-05)
            38370.724549227845 =>             0.5000052143682604 !=             0.4999947856315382  (rdiff         2.0857690963751944e-05)

======================================================================
FAIL: test_mpmath.TestSystematic.test_fresnels
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/usr/lib64/python3.4/site-packages/nose/case.py", line 198, in runTest
    self.test(*self.arg)
  File "/usr/lib64/python3.4/site-packages/numpy/testing/decorators.py", line 146, in skipper_func
    return f(*args, **kwargs)
  File "/var/tmp/portage/sci-libs/scipy-0.14.0_rc2-r1000/work/scipy-0.14.0rc2/test-3.4/lib/python/scipy/special/tests/test_mpmath.py", line 1068, in test_fresnels
    [Arg()])
  File "/var/tmp/portage/sci-libs/scipy-0.14.0_rc2-r1000/work/scipy-0.14.0rc2/test-3.4/lib/python/scipy/special/tests/test_mpmath.py", line 492, in assert_mpmath_equal
    d.check()
  File "/var/tmp/portage/sci-libs/scipy-0.14.0_rc2-r1000/work/scipy-0.14.0rc2/test-3.4/lib/python/scipy/special/tests/test_mpmath.py", line 479, in check
    reraise(*sys.exc_info())
  File "/var/tmp/portage/sci-libs/scipy-0.14.0_rc2-r1000/work/scipy-0.14.0rc2/test-3.4/lib/python/scipy/lib/six.py", line 203, in reraise
    raise value
  File "/var/tmp/portage/sci-libs/scipy-0.14.0_rc2-r1000/work/scipy-0.14.0rc2/test-3.4/lib/python/scipy/special/tests/test_mpmath.py", line 475, in check
    nan_ok=True)
  File "/var/tmp/portage/sci-libs/scipy-0.14.0_rc2-r1000/work/scipy-0.14.0rc2/test-3.4/lib/python/scipy/special/_testutils.py", line 87, in assert_func_equal
    fdata.check()
  File "/var/tmp/portage/sci-libs/scipy-0.14.0_rc2-r1000/work/scipy-0.14.0rc2/test-3.4/lib/python/scipy/special/_testutils.py", line 292, in check
    assert_(False, "\n".join(msg))
  File "/usr/lib64/python3.4/site-packages/numpy/testing/utils.py", line 44, in assert_
    raise AssertionError(msg)
AssertionError: 
Max |adiff|: 2.3726e-05
Max |rdiff|: 4.74508e-05
Bad results (6 out of 4685) for the following points (in output 0):
           -55462.571295791044 =>           -0.49999772652574415 !=            -0.5000022734736361  (rdiff          9.093854434685964e-06)
           -40700.523944023385 =>           -0.49999625363304084 !=            -0.5000037463663554  (rdiff           1.49853543477814e-05)
            -8661.637419723042 =>            -0.4999881370065126 !=            -0.5000118629941194  (rdiff          4.745084939520253e-05)
             8661.637419723042 =>             0.4999881370065126 !=             0.5000118629941194  (rdiff          4.745084939520253e-05)
            40700.523944023385 =>            0.49999625363304084 !=             0.5000037463663554  (rdiff           1.49853543477814e-05)
            55462.571295791044 =>            0.49999772652574415 !=             0.5000022734736361  (rdiff          9.093854434685964e-06)

----------------------------------------------------------------------
Ran 17531 tests in 1568.640s

FAILED (KNOWNFAIL=329, SKIP=1186, failures=6)
@rgommers
Copy link
Member

rgommers commented May 3, 2014

Same version of numpy, same compilers?

I've also noticed that some mpmath tests are a bit fragile. These failures I haven't seen before though.

@pv
Copy link
Member

pv commented May 3, 2014

These are probably real failures, due to inaccuracies in the platform libc's implementation of cos and sin.

@pv
Copy link
Member

pv commented May 3, 2014

Apparently, this is Gentoo. If you are using some bleeding-edge version of GNU libc, there at least were some bugs in it https://sourceware.org/bugzilla/show_bug.cgi?id=16623

@Arfrever
Copy link
Author

Arfrever commented May 5, 2014

I rebuilt glibc with that fix and now these tests of SciPy pass.
I think that no changes in SciPy are needed.
I filed https://bugs.gentoo.org/show_bug.cgi?id=509494 which requests inclusion of patch in glibc in Gentoo.

@Arfrever Arfrever closed this as completed May 5, 2014
@rgommers
Copy link
Member

rgommers commented May 7, 2014

thanks @Arfrever

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
defect A clear bug or issue that prevents SciPy from being installed or used as expected scipy.special
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@pv @rgommers @Arfrever