Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

TEST: 1.12.x + blas variants #267

Closed
wants to merge 9 commits into from

Conversation

h-vetinari
Copy link
Member

Following the same scheme as #242, #224, #223, #199, #172, #153 & #130.

@conda-forge-webservices
Copy link

Hi! This is the friendly automated conda-forge-linting service.

I just wanted to let you know that I linted all conda-recipes in your PR (recipe) and found it was in an excellent condition.

@isuruf
Copy link
Member

isuruf commented Jan 23, 2024

@h-vetinari, azure is backed up at the moment. Is it okay to cancel the builds right now and restart a few hours later?

@h-vetinari
Copy link
Member Author

@h-vetinari, azure is backed up at the moment. Is it okay to cancel the builds right now and restart a few hours later?

Sorry, I didn't notice that and had started the job just before going to bed. It's nonessential, so please feel free to cancel these if we're ever congested

@h-vetinari
Copy link
Member Author

h-vetinari commented Mar 18, 2024

Scipy 1.12.0

TL;DR: Cautiously improving, but OpenBLAS-related problems remain (new ones on windows)

From 45 failures out of 113 runs for 1.11.4, we're now at 35 failures out of 113 CI runs (not counting the failure of test_multiple_ellipsis_slicing absolutely everywhere)

Notable

Good News

Bad News

  • Complete failure of test_multiple_ellipsis_slicing on all platforms
  • Many new failures on win+openblas
  • Apparently emulation-related failures on aarch remain

Restrictions

  • due to test_multiple_ellipsis_slicing failing everywhere, these 20 tests failures were discounted from the failure matrix
  • test on aarch64/ppc64le resp. for PyPy only run tests with label='fast', not the full test suite
  • the following test skips:
# on the slowest agents, these tests take more than 20min in emulation
{% set tests_to_skip = tests_to_skip + " or test_mixed_threads_processes" %}                      # [aarch64 or ppc64le]
{% set tests_to_skip = tests_to_skip + " or (test_lsq_linear and test_large_rank_deficient)" %}   # [aarch64 or ppc64le]
{% set tests_to_skip = tests_to_skip + " or (test_iterative and test_precond_inverse[case1])" %}  # [aarch64 or ppc64le]
{% set tests_to_skip = tests_to_skip + " or (test_multiprocess and fft)" %}                       # [aarch64 or ppc64le]
{% set tests_to_skip = tests_to_skip + " or (test_optimize and TestBrute and test_workers)" %}    # [aarch64 or ppc64le]
{% set tests_to_skip = tests_to_skip + " or (TestLevyStable and test_location_scale)" %}          # [aarch64 or ppc64le]
{% set tests_to_skip = tests_to_skip + " or (TestShgoArguments and test_19_parallelization)" %}   # [aarch64 or ppc64le]
{% set tests_to_skip = tests_to_skip + " or (TestDifferentialEvolutionSolver and (test_immediate_updating or test_parallel))" %}    # [aarch64 or ppc64le]
# tests that run into timeouts (set in scipy test suite) in emulation
{% set tests_to_skip = tests_to_skip + " or (test_propack and test_examples)" %}                  # [aarch64 or ppc64le]
# occasionally runs out of memory on windows + pypy
{% set tests_to_skip = tests_to_skip + " or test_bootstrap_against_" %}                           # [(python_impl == "pypy") and win]
{% set tests_to_skip = tests_to_skip + " or test_more_converged" %}                               # [(python_impl == "pypy") and win]
# fails on windows + pypy due to some file access race
{% set tests_to_skip = tests_to_skip + " or (test_read_over64bit and _fast_matrix_market)" %}     # [(python_impl == "pypy") and win]
# very slow tests for pypy in emulation
[several]

Details

lib for 1.11.4 now updated
version
updated
build
scipy 1.11.4 1.12.0 X
numpy 1.26.3 1.26.4 X
libblas 3.9.0-20 3.9.0-21 X
blis 0.9.0-1 0.9.0-1
openblas 0.3.25-0 0.3.26-0 X
mkl 2023.2.0-50496 (linux)
2023.2.0-50500 (osx)
2023.2.0-50497 (win)
2024.0.0-49657 (linux)
2023.2.0-50500 (osx)
2024.0.0-49657 (win)
X
netlib 3.9.0-5 3.9.0-5
pypy 7.3.13-1 7.3.15-1 X
pythran 0.15.0-0 0.15.0-1 X
qemu-user-static 8.1.3-1 8.1.3-1

Excludes scipy/scipy#15533 now, as it's too much of a hassle to track in this matrix; see section below.

variant 1.11.4 now
linux + x64 + blis - new failure: test_x0_working[tfqmr]
linux + aarch64 + openblas 60 failures, mostly QR-related;
apparently due to emulation
remain
linux + {aarch64,ppc64le} 6 failures in test_distribution_outside_support gone 🥳
osx + x64 + accelerate 1 flaky test failure
(minor tolerance violation)
remains (non-flaky)
osx + x64 + mkl + PyPy 1-2 test failures remain
win + openblas 1 failure 9-12 failures

variant accelerate blis mkl
w/ avx512
mkl
w/o avx512
netlib openblas
w/ avx512
openblas
w/o avx512
sum**
linux / x64 ✔️ ✔️ ✔️ ✔️ 10F
linux /
aarch64
✔️ 4F
linux /
ppc64le
✔️ ✔️ -
osx / arm -
osx / x64 ✔️ ✔️/
❌(PyPy)
✔️ ✔️ 6F
win / x64 ✔️ ✔️ ✔️ 15F
sum** 5F 5F - 11F - 5F 9F 35F

** sum of Segfaults (S), Failures (F), resp. Timeouts (T); out of a total of 113 CI combinations being tested

Build logs:
Azure

The curious case of test_x0_equals_Mb[nonsymposdef-bicgstab]

For main discussion see scipy/scipy#15533.

1.11.0 1.11.4 1.12.0
linux + x64 + blis + avx2 ✔️ ✔️ ✔️
linux + x64 + blis + avx512 ✔️ ✔️ ✔️
linux + x64 + mkl + avx2 ✔️ ✔️
linux + x64 + mkl + avx512 ✔️
linux + x64 + netlib + avx2 ✔️ ✔️ ✔️
linux + x64 + netlib + avx512 ✔️ ✔️ ✔️
linux + x64 + openblas + avx2 ✔️ ✔️ ✔️
linux + x64 + openblas + avx512 ✔️ ✔️
linux + aarch64 + netlib ✔️ ✔️ ✔️
linux + aarch64 + openblas ✔️ ✔️
osx + x64 + accelerate ✔️ ✔️ ✔️/❌
win + x64 + blis + avx2 ✔️ ✔️
win + x64 + blis + avx512 ✔️ ✔️
win + x64 + mkl + avx2 ✔️ ✔️
win + x64 + mkl + avx512 ✔️ ✔️
win + x64 + openblas + avx2 ✔️ ✔️ ✔️
win + x64 + openblas + avx512 ✔️ ✔️ ✔️

everywhere: 20 failures for test_multiple_ellipsis_slicing
FAILED sparse/tests/test_base.py::Test64Bit::test_no_64[TestBSR-test_multiple_ellipsis_slicing] - Failed: NotImplementedError
FAILED sparse/tests/test_base.py::Test64Bit::test_no_64[TestCOO-test_multiple_ellipsis_slicing] - Failed: TypeError: 'coo_matrix' object is not subscriptable
FAILED sparse/tests/test_base.py::Test64Bit::test_no_64[TestDIA-test_multiple_ellipsis_slicing] - Failed: TypeError: 'dia_matrix' object is not subscriptable
FAILED sparse/tests/test_base.py::Test64Bit::test_resiliency_all_32[TestBSR-test_multiple_ellipsis_slicing] - Failed: NotImplementedError
FAILED sparse/tests/test_base.py::Test64Bit::test_resiliency_all_32[TestCOO-test_multiple_ellipsis_slicing] - Failed: TypeError: 'coo_matrix' object is not subscriptable
FAILED sparse/tests/test_base.py::Test64Bit::test_resiliency_all_32[TestDIA-test_multiple_ellipsis_slicing] - Failed: TypeError: 'dia_matrix' object is not subscriptable
FAILED sparse/tests/test_base.py::Test64Bit::test_resiliency_all_64[TestBSR-test_multiple_ellipsis_slicing] - Failed: NotImplementedError
FAILED sparse/tests/test_base.py::Test64Bit::test_resiliency_all_64[TestCOO-test_multiple_ellipsis_slicing] - Failed: TypeError: 'coo_matrix' object is not subscriptable
FAILED sparse/tests/test_base.py::Test64Bit::test_resiliency_all_64[TestDIA-test_multiple_ellipsis_slicing] - Failed: TypeError: 'dia_matrix' object is not subscriptable
FAILED sparse/tests/test_base.py::Test64Bit::test_resiliency_limit_10[TestBSR-test_multiple_ellipsis_slicing] - Failed: NotImplementedError
FAILED sparse/tests/test_base.py::Test64Bit::test_resiliency_limit_10[TestCOO-test_multiple_ellipsis_slicing] - Failed: TypeError: 'coo_matrix' object is not subscriptable
FAILED sparse/tests/test_base.py::Test64Bit::test_resiliency_limit_10[TestDIA-test_multiple_ellipsis_slicing] - Failed: TypeError: 'dia_matrix' object is not subscriptable
FAILED sparse/tests/test_base.py::Test64Bit::test_resiliency_random[TestBSR-test_multiple_ellipsis_slicing] - Failed: NotImplementedError
FAILED sparse/tests/test_base.py::Test64Bit::test_resiliency_random[TestCOO-test_multiple_ellipsis_slicing] - Failed: TypeError: 'coo_matrix' object is not subscriptable
FAILED sparse/tests/test_base.py::Test64Bit::test_resiliency_random[TestDIA-test_multiple_ellipsis_slicing] - Failed: TypeError: 'dia_matrix' object is not subscriptable
FAILED sparse/tests/test_base.py::TestBSR::test_multiple_ellipsis_slicing - Failed: NotImplementedError
FAILED sparse/tests/test_base.py::TestBSRNonCanonical::test_multiple_ellipsis_slicing - Failed: NotImplementedError
FAILED sparse/tests/test_base.py::TestCOO::test_multiple_ellipsis_slicing - Failed: TypeError: 'coo_matrix' object is not subscriptable
FAILED sparse/tests/test_base.py::TestCOONonCanonical::test_multiple_ellipsis_slicing - TypeError: 'coo_matrix' object is not subscriptable
FAILED sparse/tests/test_base.py::TestDIA::test_multiple_ellipsis_slicing - Failed: TypeError: 'dia_matrix' object is not subscriptable
linux + x64 + blis: 1 failure
____________________________ test_x0_working[tfqmr] ____________________________
[gw1] linux -- Python 3.10.13 $PREFIX/bin/python
$PREFIX/lib/python3.10/site-packages/scipy/sparse/linalg/_isolve/tests/test_iterative.py:507: in test_x0_working
    assert norm(A @ x - b) <= 2e-6*norm(b)
E   assert 3.5355292454346426e-06 <= (2e-06 * 1.240298651028214)
E    +  where 3.5355292454346426e-06 = norm(((array([[3.68514493, 2.22433683, 2.80424149, 2.06524296, 2.82772901,\n        1.70134349, 2.98806253, 2.88379072, 1.9578..., 2.29515724, 2.77591422, 1.55001596, 1.93969785,\n        1.88091968, 2.24894423, 2.49791763, 1.66944017, 2.12310297]]) @ array([ -1.22142941, -23.52880604,  -4.72398545, -21.36850239,\n       -12.68971238,  -0.96740459,  32.8587725 , -11.40286367,\n        10.993623  ,  30.93083318])) - array([0.55127821, 0.22828434, 0.09135873, 0.07249963, 0.11693987,\n       0.74246847, 0.72216603, 0.1607452 , 0.15471589, 0.18022921])))
E    +  and   1.240298651028214 = norm(array([0.55127821, 0.22828434, 0.09135873, 0.07249963, 0.11693987,\n       0.74246847, 0.72216603, 0.1607452 , 0.15471589, 0.18022921]))
        A          = array([[3.68514493, 2.22433683, 2.80424149, 2.06524296, 2.82772901,
        1.70134349, 2.98806253, 2.88379072, 1.9578..., 2.29515724, 2.77591422, 1.55001596, 1.93969785,
        1.88091968, 2.24894423, 2.49791763, 1.66944017, 2.12310297]])
        b          = array([0.55127821, 0.22828434, 0.09135873, 0.07249963, 0.11693987,
       0.74246847, 0.72216603, 0.1607452 , 0.15471589, 0.18022921])
        info       = 0
        kw         = {'atol': 0, 'rtol': 1e-06}
        n          = 10
        rng        = Generator(PCG64) at 0x7F5F881FF680
        solver     = <function tfqmr at 0x7f5f8ef58ee0>
        x          = array([ -1.22142941, -23.52880604,  -4.72398545, -21.36850239,
       -12.68971238,  -0.96740459,  32.8587725 , -11.40286367,
        10.993623  ,  30.93083318])
        x0         = array([0.63685093, 0.46836296, 0.0677924 , 0.52832101, 0.49467215,
       0.68333247, 0.3392967 , 0.57867322, 0.25729156, 0.60952728])
linux + x64 + mkl + non-avx512 / linux + aarch64 + openblas / osx + x64 + accelerate: 1 failure
___________________ test_x0_equals_Mb[nonsymposdef-bicgstab] ___________________
[gw0] linux -- Python 3.9.18 $PREFIX/bin/python
$PREFIX/lib/python3.9/site-packages/scipy/sparse/linalg/_isolve/tests/test_iterative.py:520: in test_x0_equals_Mb
    assert info == 0
E   assert -11 == 0
        A          = <10x10 sparse matrix of type '<class 'numpy.float64'>'
	with 19 stored elements in Compressed Sparse Row format>
        b          = array([0., 1., 2., 3., 4., 5., 6., 7., 8., 9.])
        case       = <nonsymposdef-bicgstab>
        info       = -11
        rtol       = 1e-08
        x          = array([0.        , 0.52361589, 1.32356787, 2.15281624, 3.        ,
       4.        , 5.        , 6.        , 7.        , 8.        ])
        x0         = 'Mb'

on aarch, we get assert -10 == 0 instead of assert -11 == 0...

linux + aarch64: 60 failures
FAILED linalg/tests/test_basic.py::TestLstsq::test_random_overdet - AssertionError: 
Not equal to tolerance rtol=2.98023e-06, atol=2.98023e-06
driver: gelsd
Mismatched elements: 45 / 45 (100%)
Max absolute difference: 23.948622
Max relative difference: 1.0819286
 x: array([[-2.175595e-02,  1.430921e-01,  1.740819e-02],
       [ 2.515154e-02,  2.834489e-02, -6.470084e-03],
       [-5.744661e-05,  1.434425e-02,  4.162818e-02],...
 y: array([[  4.199296,   5.158111,   2.723422],
       [ 11.47436 ,  11.579989,   5.939486],
       [  0.678561,   0.932052,   0.4389  ],...
FAILED linalg/tests/test_decomp_update.py::TestQRdelete_f::test_tall_1_col - AssertionError: 
Not equal to tolerance rtol=0.0001, atol=1.19209e-06

Mismatched elements: 144 / 144 (100%)
Max absolute difference: 1.35266802
Max relative difference: 1.35266802
 x: array([[ 0.51534 , -0.066137, -0.282195, -0.078835,  0.126846,  0.063667,
         0.254653,  0.145272,  0.297032, -0.312945,  0.047386, -0.375106],
       [-0.066137,  0.058695,  0.107405, -0.020373, -0.37564 , -0.306869,...
 y: array([[1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0.],...
FAILED linalg/tests/test_decomp_update.py::TestQRdelete_f::test_tall_p_col - AssertionError: 
Not equal to tolerance rtol=0.0001, atol=1.19209e-06

Mismatched elements: 144 / 144 (100%)
Max absolute difference: 1.38513473
Max relative difference: 1.38513473
 x: array([[ 0.194025,  0.271456,  0.193257, -0.103866,  0.639289,  0.325098,
        -0.308913,  0.225063,  0.009908,  0.531324,  0.418844,  0.486349],
       [ 0.271456, -0.024757,  0.531958, -0.127783,  0.087164,  0.124488,...
 y: array([[1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0.],...
FAILED linalg/tests/test_decomp_update.py::TestQRdelete_f::test_delete_last_p_col - AssertionError: 
Not equal to tolerance rtol=0.0001, atol=1.19209e-06

Mismatched elements: 144 / 144 (100%)
Max absolute difference: 1.39604267
Max relative difference: 1.39604267
 x: array([[ 7.312894e-01,  2.936634e-02, -2.486336e-01, -3.261323e-01,
         4.044664e-03, -1.884397e-02,  4.260744e-01,  4.652548e-01,
         4.959358e-02,  2.202561e-04, -5.590688e-01, -1.013507e-04],...
 y: array([[1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0.],...
FAILED linalg/tests/test_decomp_update.py::TestQRdelete_f::test_non_unit_strides_1_col - AssertionError: 
Not equal to tolerance rtol=0.0001, atol=1.19209e-06

Mismatched elements: 144 / 144 (100%)
Max absolute difference: 1.35266802
Max relative difference: 1.35266802
 x: array([[ 0.51534 , -0.066137, -0.282195, -0.078835,  0.126846,  0.063667,
         0.254653,  0.145272,  0.297032, -0.312945,  0.047386, -0.375106],
       [-0.066137,  0.058695,  0.107405, -0.020373, -0.37564 , -0.306869,...
 y: array([[1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0.],...
FAILED linalg/tests/test_decomp_update.py::TestQRdelete_f::test_non_unit_strides_p_col - AssertionError: 
Not equal to tolerance rtol=0.0001, atol=1.19209e-06

Mismatched elements: 144 / 144 (100%)
Max absolute difference: 1.37619865
Max relative difference: 1.37619865
 x: array([[ 1.469219e-01,  5.787525e-01,  5.345633e-02, -4.102918e-01,
         5.512089e-01, -6.510306e-02, -3.209547e-01, -2.358620e-01,
         2.342797e-01,  2.828279e-01,  3.863396e-01,  1.333238e-01],...
 y: array([[1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0.],...
FAILED linalg/tests/test_decomp_update.py::TestQRdelete_f::test_neg_strides_1_col - AssertionError: 
Not equal to tolerance rtol=0.0001, atol=1.19209e-06

Mismatched elements: 144 / 144 (100%)
Max absolute difference: 1.35266802
Max relative difference: 1.35266802
 x: array([[ 0.51534 , -0.066137, -0.282195, -0.078835,  0.126846,  0.063667,
         0.254653,  0.145272,  0.297032, -0.312945,  0.047386, -0.375106],
       [-0.066137,  0.058695,  0.107405, -0.020373, -0.37564 , -0.306869,...
 y: array([[1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0.],...
FAILED linalg/tests/test_decomp_update.py::TestQRdelete_f::test_neg_strides_p_col - AssertionError: 
Not equal to tolerance rtol=0.0001, atol=1.19209e-06

Mismatched elements: 144 / 144 (100%)
Max absolute difference: 1.37619865
Max relative difference: 1.37619865
 x: array([[ 1.469219e-01,  5.787525e-01,  5.345633e-02, -4.102918e-01,
         5.512089e-01, -6.510306e-02, -3.209547e-01, -2.358620e-01,
         2.342797e-01,  2.828279e-01,  3.863396e-01,  1.333238e-01],...
 y: array([[1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0.],...
FAILED linalg/tests/test_decomp_update.py::TestQRdelete_f::test_non_itemize_strides_1_col - AssertionError: 
Not equal to tolerance rtol=0.0001, atol=1.19209e-06

Mismatched elements: 144 / 144 (100%)
Max absolute difference: 1.35266802
Max relative difference: 1.35266802
 x: array([[ 0.51534 , -0.066137, -0.282195, -0.078835,  0.126846,  0.063667,
         0.254653,  0.145272,  0.297032, -0.312945,  0.047386, -0.375106],
       [-0.066137,  0.058695,  0.107405, -0.020373, -0.37564 , -0.306869,...
 y: array([[1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0.],...
FAILED linalg/tests/test_decomp_update.py::TestQRdelete_f::test_non_itemize_strides_p_col - AssertionError: 
Not equal to tolerance rtol=0.0001, atol=1.19209e-06

Mismatched elements: 144 / 144 (100%)
Max absolute difference: 1.37619865
Max relative difference: 1.37619865
 x: array([[ 1.469219e-01,  5.787525e-01,  5.345633e-02, -4.102918e-01,
         5.512089e-01, -6.510306e-02, -3.209547e-01, -2.358620e-01,
         2.342797e-01,  2.828279e-01,  3.863396e-01,  1.333238e-01],...
 y: array([[1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0.],...
FAILED linalg/tests/test_decomp_update.py::TestQRdelete_f::test_non_native_byte_order_1_col - AssertionError: 
Not equal to tolerance rtol=0.0001, atol=1.19209e-06

Mismatched elements: 144 / 144 (100%)
Max absolute difference: 1.35266802
Max relative difference: 1.35266802
 x: array([[ 0.51534 , -0.066137, -0.282195, -0.078835,  0.126846,  0.063667,
         0.254653,  0.145272,  0.297032, -0.312945,  0.047386, -0.375106],
       [-0.066137,  0.058695,  0.107405, -0.020373, -0.37564 , -0.306869,...
 y: array([[1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0.],...
FAILED linalg/tests/test_decomp_update.py::TestQRdelete_f::test_non_native_byte_order_p_col - AssertionError: 
Not equal to tolerance rtol=0.0001, atol=1.19209e-06

Mismatched elements: 144 / 144 (100%)
Max absolute difference: 1.37619865
Max relative difference: 1.37619865
 x: array([[ 1.469219e-01,  5.787525e-01,  5.345633e-02, -4.102918e-01,
         5.512089e-01, -6.510306e-02, -3.209547e-01, -2.358620e-01,
         2.342797e-01,  2.828279e-01,  3.863396e-01,  1.333238e-01],...
 y: array([[1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0.],...
FAILED linalg/tests/test_decomp_update.py::TestQRinsert_f::test_sqr_1_row - AssertionError: 
Not equal to tolerance rtol=0.0001, atol=1.19209e-06

Mismatched elements: 81 / 81 (100%)
Max absolute difference: 1.47812065
Max relative difference: 1.47812065
 x: array([[ 0.427075,  0.052891,  0.034453,  0.178182,  0.20928 , -0.183314,
        -0.029952,  0.108337,  0.05796 ],
       [ 0.052891,  0.173273,  0.570958, -0.143117,  0.093308,  0.188859,...
 y: array([[1., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 1., 0., 0., 0., 0., 0., 0., 0.],
       [0., 0., 1., 0., 0., 0., 0., 0., 0.],...
FAILED linalg/tests/test_decomp_update.py::TestQRinsert_f::test_sqr_p_row - AssertionError: 
Not equal to tolerance rtol=0.0001, atol=1.19209e-06

Mismatched elements: 121 / 121 (100%)
Max absolute difference: 1.49504468
Max relative difference: 1.49504468
 x: array([[ 0.025394,  0.222058,  0.609238,  0.497672,  0.354511,  0.041871,
         0.731882, -0.370673, -0.38842 , -0.11726 , -0.131466],
       [ 0.222058,  0.635692, -0.111061,  0.158848,  0.168521, -0.129045,...
 y: array([[1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 0., 1., 0., 0., 0., 0., 0., 0., 0., 0.],...
FAILED linalg/tests/test_decomp_update.py::TestQRinsert_f::test_tall_1_row - AssertionError: 
Not equal to tolerance rtol=0.0001, atol=1.19209e-06

Mismatched elements: 169 / 169 (100%)
Max absolute difference: 1.47401035
Max relative difference: 1.47401035
 x: array([[ 0.522431, -0.118259, -0.003304,  0.450749, -0.030897,  0.1499  ,
         0.07167 , -0.145986, -0.025632, -0.278439, -0.021617, -0.100983,
        -0.252881],...
 y: array([[1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],...
FAILED linalg/tests/test_decomp_update.py::TestQRinsert_f::test_tall_p_row - AssertionError: 
Not equal to tolerance rtol=0.0001, atol=1.19209e-06

Mismatched elements: 225 / 225 (100%)
Max absolute difference: 1.21126013
Max relative difference: 1.21126013
 x: array([[ 0.008006,  0.003634,  0.082993, -0.105183,  0.469302, -0.159896,
        -0.186092,  0.237852,  0.166177, -0.004724,  0.300496, -0.172572,
         0.054354,  0.01367 ,  0.251432],...
 y: array([[1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],...
FAILED linalg/tests/test_decomp_update.py::TestQRinsert_f::test_tall_1_col - AssertionError: 
Not equal to tolerance rtol=0.0001, atol=1.19209e-06

Mismatched elements: 144 / 144 (100%)
Max absolute difference: 1.45033643
Max relative difference: 1.45033643
 x: array([[ 0.29902 ,  0.501335,  0.272783,  0.074555,  0.132249, -0.02093 ,
         0.245842, -0.023263,  0.475552,  0.064034, -0.186375,  0.20676 ],
       [ 0.501335,  0.219159, -0.362003, -0.375209, -0.100792, -0.299124,...
 y: array([[1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0.],...
FAILED linalg/tests/test_decomp_update.py::TestQRinsert_f::test_tall_p_col_tall - AssertionError: 
Not equal to tolerance rtol=0.0001, atol=1.19209e-06

Mismatched elements: 144 / 144 (100%)
Max absolute difference: 1.52949911
Max relative difference: 1.52949911
 x: array([[ 0.396285, -0.118527,  0.404352,  0.024046,  0.185335,  0.491734,
        -0.084112,  0.179654, -0.282193,  0.263326, -0.229785, -0.033931],
       [-0.118527, -0.145312,  0.166583,  0.136687,  0.248487,  0.227176,...
 y: array([[1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0.],...
FAILED linalg/tests/test_decomp_update.py::TestQRinsert_f::test_tall_p_col_sqr - AssertionError: 
Not equal to tolerance rtol=0.0001, atol=1.19209e-06

Mismatched elements: 144 / 144 (100%)
Max absolute difference: 1.29536363
Max relative difference: 1.29536363
 x: array([[ 1.839437e-01,  3.666864e-03,  5.269710e-01, -9.558372e-02,
         4.485931e-01, -1.068802e-01, -3.599494e-01,  2.523912e-01,
         5.202088e-01,  7.875285e-02, -2.388350e-01,  1.856074e-01],...
 y: array([[1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0.],...
FAILED linalg/tests/test_decomp_update.py::TestQRinsert_f::test_tall_p_col_fat - AssertionError: 
Not equal to tolerance rtol=0.0001, atol=1.19209e-06

Mismatched elements: 144 / 144 (100%)
Max absolute difference: 1.22226353
Max relative difference: 1.22226353
 x: array([[ 0.30203 ,  0.289442,  0.491229,  0.232481,  0.069349, -0.017829,
         0.0731  , -0.101897, -0.061624,  0.032908, -0.294819, -0.209391],
       [ 0.289442, -0.027515, -0.225598, -0.00597 ,  0.261011,  0.194242,...
 y: array([[1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0.],...
FAILED linalg/tests/test_decomp_update.py::TestQRinsert_f::test_fat_p_row_fat - AssertionError: 
Not equal to tolerance rtol=0.0001, atol=1.19209e-06

Mismatched elements: 100 / 100 (100%)
Max absolute difference: 1.52807027
Max relative difference: 1.52807027
 x: array([[ 0.476516,  0.678434,  0.487398,  0.170842, -0.530036, -0.049983,
        -0.051561, -0.034272,  0.340691, -0.532899],
       [ 0.678434, -0.52807 , -0.086754,  0.512772,  0.126919,  0.114655,...
 y: array([[1., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 1., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 0., 1., 0., 0., 0., 0., 0., 0., 0.],...
FAILED linalg/tests/test_decomp_update.py::TestQRinsert_f::test_fat_p_row_sqr - AssertionError: 
Not equal to tolerance rtol=0.0001, atol=1.19209e-06

Mismatched elements: 144 / 144 (100%)
Max absolute difference: 1.33379635
Max relative difference: 1.33379635
 x: array([[ 0.407052,  0.457873, -0.2282  ,  0.20684 ,  0.335016, -0.217718,
         0.024833, -0.165538,  0.372844,  0.298751, -0.199244, -0.277085],
       [ 0.457873, -0.333796,  0.153424,  0.595791, -0.424009,  0.076896,...
 y: array([[1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0.],...
FAILED linalg/tests/test_decomp_update.py::TestQRinsert_f::test_fat_p_row_tall - AssertionError: 
Not equal to tolerance rtol=0.0001, atol=1.19209e-06

Mismatched elements: 196 / 196 (100%)
Max absolute difference: 1.45184031
Max relative difference: 1.45184031
 x: array([[ 1.306703e-01,  2.308598e-01,  1.503783e-02,  4.989481e-01,
         2.612073e-01, -6.566251e-02, -1.365806e-02, -4.439392e-01,
        -9.274840e-02, -3.816905e-02,  2.477478e-01,  1.054653e-01,...
 y: array([[1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],...
FAILED linalg/tests/test_decomp_update.py::TestQRinsert_f::test_economic_p_col_eco - AssertionError: 
Not equal to tolerance rtol=0.0001, atol=1.19209e-06

Mismatched elements: 100 / 100 (100%)
Max absolute difference: 1.37845999
Max relative difference: 1.37845999
 x: array([[ 0.488817,  0.293726,  0.560871, -0.452365,  0.316418,  0.060158,
         0.176355,  0.412072, -0.13077 ,  0.404673],
       [ 0.293726,  0.266032, -0.246029,  0.125679, -0.167877,  0.233249,...
 y: array([[1., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 1., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 0., 1., 0., 0., 0., 0., 0., 0., 0.],...
FAILED linalg/tests/test_decomp_update.py::TestQRinsert_f::test_economic_p_col_sqr - AssertionError: 
Not equal to tolerance rtol=0.0001, atol=1.19209e-06

Mismatched elements: 144 / 144 (100%)
Max absolute difference: 1.60243899
Max relative difference: 1.60243899
 x: array([[-3.211651e-01,  3.666854e-03,  5.269712e-01, -1.675753e-01,
         5.411102e-01, -1.068804e-01, -3.599494e-01,  1.086038e-02,
         4.765480e-01,  7.875297e-02, -2.388351e-01,  4.631867e-01],...
 y: array([[1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0.],...
FAILED linalg/tests/test_decomp_update.py::TestQRinsert_f::test_economic_p_col_fat - AssertionError: 
Not equal to tolerance rtol=0.0001, atol=1.19209e-06

Mismatched elements: 144 / 144 (100%)
Max absolute difference: 1.22226353
Max relative difference: 1.22226353
 x: array([[ 0.038019,  0.289442,  0.491229,  0.232482,  0.065881, -0.01783 ,
         0.073099, -0.101897,  0.340713,  0.032909, -0.294819, -0.209391],
       [ 0.289442, -0.027515, -0.225598, -0.00597 ,  0.170632,  0.194242,...
 y: array([[1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0.],...
FAILED linalg/tests/test_decomp_update.py::TestQRinsert_f::test_Mx1_1_row - AssertionError: 
Not equal to tolerance rtol=0.0001, atol=1.19209e-06

Mismatched elements: 81 / 81 (100%)
Max absolute difference: 1.35482377
Max relative difference: 1.35482377
 x: array([[ 0.204203,  0.081063,  0.547405, -0.497832,  0.44612 , -0.364956,
         0.282041,  0.048404, -0.144208],
       [ 0.081063,  0.102958, -0.048356,  0.717492,  0.188318, -0.23341 ,...
 y: array([[1., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 1., 0., 0., 0., 0., 0., 0., 0.],
       [0., 0., 1., 0., 0., 0., 0., 0., 0.],...
FAILED linalg/tests/test_decomp_update.py::TestQRinsert_f::test_Mx1_p_row - AssertionError: 
Not equal to tolerance rtol=0.0001, atol=1.19209e-06

Mismatched elements: 121 / 121 (100%)
Max absolute difference: 1.33370879
Max relative difference: 1.33370879
 x: array([[ 0.421005,  0.417547, -0.32667 , -0.29249 ,  0.282903,  0.253645,
        -0.110355, -0.220882, -0.263948, -0.180241,  0.751357],
       [ 0.417547, -0.047571, -0.367514, -0.214091, -0.303108, -0.364512,...
 y: array([[1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 0., 1., 0., 0., 0., 0., 0., 0., 0., 0.],...
FAILED linalg/tests/test_decomp_update.py::TestQRinsert_f::test_non_unit_strides_1_row - AssertionError: 
Not equal to tolerance rtol=0.0001, atol=1.19209e-06

Mismatched elements: 81 / 81 (100%)
Max absolute difference: 1.47812065
Max relative difference: 1.47812065
 x: array([[ 0.427075,  0.052891,  0.034453,  0.178182,  0.20928 , -0.183314,
        -0.029952,  0.108337,  0.05796 ],
       [ 0.052891,  0.173273,  0.570958, -0.143117,  0.093308,  0.188859,...
 y: array([[1., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 1., 0., 0., 0., 0., 0., 0., 0.],
       [0., 0., 1., 0., 0., 0., 0., 0., 0.],...
FAILED linalg/tests/test_decomp_update.py::TestQRinsert_f::test_non_unit_strides_p_row - AssertionError: 
Not equal to tolerance rtol=0.0001, atol=1.19209e-06

Mismatched elements: 121 / 121 (100%)
Max absolute difference: 1.49504468
Max relative difference: 1.49504468
 x: array([[ 0.025394,  0.222058,  0.609238,  0.497672,  0.354511,  0.041871,
         0.731882, -0.370673, -0.38842 , -0.11726 , -0.131466],
       [ 0.222058,  0.635692, -0.111061,  0.158848,  0.168521, -0.129045,...
 y: array([[1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 0., 1., 0., 0., 0., 0., 0., 0., 0., 0.],...
FAILED linalg/tests/test_decomp_update.py::TestQRinsert_f::test_non_unit_strides_1_col - AssertionError: 
Not equal to tolerance rtol=0.0001, atol=1.19209e-06

Mismatched elements: 144 / 144 (100%)
Max absolute difference: 1.45033643
Max relative difference: 1.45033643
 x: array([[ 0.29902 ,  0.501335,  0.272783,  0.074555,  0.132249, -0.02093 ,
         0.245842, -0.023263,  0.475552,  0.064034, -0.186375,  0.20676 ],
       [ 0.501335,  0.219159, -0.362003, -0.375209, -0.100792, -0.299124,...
 y: array([[1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0.],...
FAILED linalg/tests/test_decomp_update.py::TestQRinsert_f::test_non_unit_strides_p_col - AssertionError: 
Not equal to tolerance rtol=0.0001, atol=1.19209e-06

Mismatched elements: 144 / 144 (100%)
Max absolute difference: 1.52949911
Max relative difference: 1.52949911
 x: array([[ 0.396285, -0.118527,  0.404352,  0.024046,  0.185335,  0.491734,
        -0.084112,  0.179654, -0.282193,  0.263326, -0.229785, -0.033931],
       [-0.118527, -0.145312,  0.166583,  0.136687,  0.248487,  0.227176,...
 y: array([[1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0.],...
FAILED linalg/tests/test_decomp_update.py::TestQRinsert_f::test_neg_strides_1_row - AssertionError: 
Not equal to tolerance rtol=0.0001, atol=1.19209e-06

Mismatched elements: 81 / 81 (100%)
Max absolute difference: 1.47812065
Max relative difference: 1.47812065
 x: array([[ 0.427075,  0.052891,  0.034453,  0.178182,  0.20928 , -0.183314,
        -0.029952,  0.108337,  0.05796 ],
       [ 0.052891,  0.173273,  0.570958, -0.143117,  0.093308,  0.188859,...
 y: array([[1., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 1., 0., 0., 0., 0., 0., 0., 0.],
       [0., 0., 1., 0., 0., 0., 0., 0., 0.],...
FAILED linalg/tests/test_decomp_update.py::TestQRinsert_f::test_neg_strides_p_row - AssertionError: 
Not equal to tolerance rtol=0.0001, atol=1.19209e-06

Mismatched elements: 121 / 121 (100%)
Max absolute difference: 1.49504468
Max relative difference: 1.49504468
 x: array([[ 0.025394,  0.222058,  0.609238,  0.497672,  0.354511,  0.041871,
         0.731882, -0.370673, -0.38842 , -0.11726 , -0.131466],
       [ 0.222058,  0.635692, -0.111061,  0.158848,  0.168521, -0.129045,...
 y: array([[1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 0., 1., 0., 0., 0., 0., 0., 0., 0., 0.],...
FAILED linalg/tests/test_decomp_update.py::TestQRinsert_f::test_neg_strides_1_col - AssertionError: 
Not equal to tolerance rtol=0.0001, atol=1.19209e-06

Mismatched elements: 144 / 144 (100%)
Max absolute difference: 1.45033643
Max relative difference: 1.45033643
 x: array([[ 0.29902 ,  0.501335,  0.272783,  0.074555,  0.132249, -0.02093 ,
         0.245842, -0.023263,  0.475552,  0.064034, -0.186375,  0.20676 ],
       [ 0.501335,  0.219159, -0.362003, -0.375209, -0.100792, -0.299124,...
 y: array([[1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0.],...
FAILED linalg/tests/test_decomp_update.py::TestQRinsert_f::test_neg_strides_p_col - AssertionError: 
Not equal to tolerance rtol=0.0001, atol=1.19209e-06

Mismatched elements: 144 / 144 (100%)
Max absolute difference: 1.52949911
Max relative difference: 1.52949911
 x: array([[ 0.396285, -0.118527,  0.404352,  0.024046,  0.185335,  0.491734,
        -0.084112,  0.179654, -0.282193,  0.263326, -0.229785, -0.033931],
       [-0.118527, -0.145312,  0.166583,  0.136687,  0.248487,  0.227176,...
 y: array([[1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0.],...
FAILED linalg/tests/test_decomp_update.py::TestQRinsert_f::test_non_itemsize_strides_1_row - AssertionError: 
Not equal to tolerance rtol=0.0001, atol=1.19209e-06

Mismatched elements: 81 / 81 (100%)
Max absolute difference: 1.47812065
Max relative difference: 1.47812065
 x: array([[ 0.427075,  0.052891,  0.034453,  0.178182,  0.20928 , -0.183314,
        -0.029952,  0.108337,  0.05796 ],
       [ 0.052891,  0.173273,  0.570958, -0.143117,  0.093308,  0.188859,...
 y: array([[1., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 1., 0., 0., 0., 0., 0., 0., 0.],
       [0., 0., 1., 0., 0., 0., 0., 0., 0.],...
FAILED linalg/tests/test_decomp_update.py::TestQRinsert_f::test_non_itemsize_strides_p_row - AssertionError: 
Not equal to tolerance rtol=0.0001, atol=1.19209e-06

Mismatched elements: 121 / 121 (100%)
Max absolute difference: 1.49504468
Max relative difference: 1.49504468
 x: array([[ 0.025394,  0.222058,  0.609238,  0.497672,  0.354511,  0.041871,
         0.731882, -0.370673, -0.38842 , -0.11726 , -0.131466],
       [ 0.222058,  0.635692, -0.111061,  0.158848,  0.168521, -0.129045,...
 y: array([[1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 0., 1., 0., 0., 0., 0., 0., 0., 0., 0.],...
FAILED linalg/tests/test_decomp_update.py::TestQRinsert_f::test_non_itemsize_strides_1_col - AssertionError: 
Not equal to tolerance rtol=0.0001, atol=1.19209e-06

Mismatched elements: 144 / 144 (100%)
Max absolute difference: 1.45033643
Max relative difference: 1.45033643
 x: array([[ 0.29902 ,  0.501335,  0.272783,  0.074555,  0.132249, -0.02093 ,
         0.245842, -0.023263,  0.475552,  0.064034, -0.186375,  0.20676 ],
       [ 0.501335,  0.219159, -0.362003, -0.375209, -0.100792, -0.299124,...
 y: array([[1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0.],...
FAILED linalg/tests/test_decomp_update.py::TestQRinsert_f::test_non_itemsize_strides_p_col - AssertionError: 
Not equal to tolerance rtol=0.0001, atol=1.19209e-06

Mismatched elements: 144 / 144 (100%)
Max absolute difference: 1.52949911
Max relative difference: 1.52949911
 x: array([[ 0.396285, -0.118527,  0.404352,  0.024046,  0.185335,  0.491734,
        -0.084112,  0.179654, -0.282193,  0.263326, -0.229785, -0.033931],
       [-0.118527, -0.145312,  0.166583,  0.136687,  0.248487,  0.227176,...
 y: array([[1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0.],...
FAILED linalg/tests/test_decomp_update.py::TestQRinsert_f::test_non_native_byte_order_1_row - AssertionError: 
Not equal to tolerance rtol=0.0001, atol=1.19209e-06

Mismatched elements: 81 / 81 (100%)
Max absolute difference: 1.47812065
Max relative difference: 1.47812065
 x: array([[ 0.427075,  0.052891,  0.034453,  0.178182,  0.20928 , -0.183314,
        -0.029952,  0.108337,  0.05796 ],
       [ 0.052891,  0.173273,  0.570958, -0.143117,  0.093308,  0.188859,...
 y: array([[1., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 1., 0., 0., 0., 0., 0., 0., 0.],
       [0., 0., 1., 0., 0., 0., 0., 0., 0.],...
FAILED linalg/tests/test_decomp_update.py::TestQRinsert_f::test_non_native_byte_order_p_row - AssertionError: 
Not equal to tolerance rtol=0.0001, atol=1.19209e-06

Mismatched elements: 121 / 121 (100%)
Max absolute difference: 1.49504468
Max relative difference: 1.49504468
 x: array([[ 0.025394,  0.222058,  0.609238,  0.497672,  0.354511,  0.041871,
         0.731882, -0.370673, -0.38842 , -0.11726 , -0.131466],
       [ 0.222058,  0.635692, -0.111061,  0.158848,  0.168521, -0.129045,...
 y: array([[1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 0., 1., 0., 0., 0., 0., 0., 0., 0., 0.],...
FAILED linalg/tests/test_decomp_update.py::TestQRinsert_f::test_non_native_byte_order_1_col - AssertionError: 
Not equal to tolerance rtol=0.0001, atol=1.19209e-06

Mismatched elements: 144 / 144 (100%)
Max absolute difference: 1.45033643
Max relative difference: 1.45033643
 x: array([[ 0.29902 ,  0.501335,  0.272783,  0.074555,  0.132249, -0.02093 ,
         0.245842, -0.023263,  0.475552,  0.064034, -0.186375,  0.20676 ],
       [ 0.501335,  0.219159, -0.362003, -0.375209, -0.100792, -0.299124,...
 y: array([[1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0.],...
FAILED linalg/tests/test_decomp_update.py::TestQRinsert_f::test_non_native_byte_order_p_col - AssertionError: 
Not equal to tolerance rtol=0.0001, atol=1.19209e-06

Mismatched elements: 144 / 144 (100%)
Max absolute difference: 1.52949911
Max relative difference: 1.52949911
 x: array([[ 0.396285, -0.118527,  0.404352,  0.024046,  0.185335,  0.491734,
        -0.084112,  0.179654, -0.282193,  0.263326, -0.229785, -0.033931],
       [-0.118527, -0.145312,  0.166583,  0.136687,  0.248487,  0.227176,...
 y: array([[1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0.],...
FAILED linalg/tests/test_decomp_update.py::TestQRupdate_f::test_tall_rank_1 - AssertionError: 
Not equal to tolerance rtol=0.0001, atol=1.19209e-06

Mismatched elements: 144 / 144 (100%)
Max absolute difference: 1.56318134
Max relative difference: 1.56318134
 x: array([[-0.054046,  0.205639, -0.123517,  0.260355,  0.474265, -0.249005,
         0.177618, -0.301207,  0.618385, -0.037394,  0.023149,  0.252298],
       [ 0.205639,  0.756895, -0.286572,  0.154587,  0.321836,  0.283857,...
 y: array([[1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0.],...
FAILED linalg/tests/test_decomp_update.py::TestQRupdate_f::test_tall_rank_p - AssertionError: 
Not equal to tolerance rtol=0.0001, atol=1.19209e-06

Mismatched elements: 144 / 144 (100%)
Max absolute difference: 1.56318134
Max relative difference: 1.56318134
 x: array([[-0.054046,  0.205639, -0.123517,  0.260355,  0.474265, -0.249005,
         0.177618, -0.301207,  0.618385, -0.037394,  0.023149,  0.252298],
       [ 0.205639,  0.756895, -0.286572,  0.154587,  0.321836,  0.283857,...
 y: array([[1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0.],...
FAILED linalg/tests/test_decomp_update.py::TestQRupdate_f::test_non_unit_strides_rank_1 - AssertionError: 
Not equal to tolerance rtol=0.0001, atol=1.19209e-06

Mismatched elements: 144 / 144 (100%)
Max absolute difference: 1.56318134
Max relative difference: 1.56318134
 x: array([[-0.054046,  0.205639, -0.123517,  0.260355,  0.474265, -0.249005,
         0.177618, -0.301207,  0.618385, -0.037394,  0.023149,  0.252298],
       [ 0.205639,  0.756895, -0.286572,  0.154587,  0.321836,  0.283857,...
 y: array([[1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0.],...
FAILED linalg/tests/test_decomp_update.py::TestQRupdate_f::test_non_unit_strides_rank_p - AssertionError: 
Not equal to tolerance rtol=0.0001, atol=1.19209e-06

Mismatched elements: 144 / 144 (100%)
Max absolute difference: 1.5197227
Max relative difference: 1.5197227
 x: array([[ 0.030667,  0.051494, -0.262698, -0.204111,  0.552454,  0.260673,
        -0.072537,  0.140756,  0.215893, -0.045971,  0.289605, -0.198233],
       [ 0.051494,  0.300886,  0.159218,  0.002972, -0.091647,  0.648182,...
 y: array([[1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0.],...
FAILED linalg/tests/test_decomp_update.py::TestQRupdate_f::test_neg_strides_rank_1 - AssertionError: 
Not equal to tolerance rtol=0.0001, atol=1.19209e-06

Mismatched elements: 144 / 144 (100%)
Max absolute difference: 1.56318134
Max relative difference: 1.56318134
 x: array([[-0.054046,  0.205639, -0.123517,  0.260355,  0.474265, -0.249005,
         0.177618, -0.301207,  0.618385, -0.037394,  0.023149,  0.252298],
       [ 0.205639,  0.756895, -0.286572,  0.154587,  0.321836,  0.283857,...
 y: array([[1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0.],...
FAILED linalg/tests/test_decomp_update.py::TestQRupdate_f::test_neg_strides_rank_p - AssertionError: 
Not equal to tolerance rtol=0.0001, atol=1.19209e-06

Mismatched elements: 144 / 144 (100%)
Max absolute difference: 1.5197227
Max relative difference: 1.5197227
 x: array([[ 0.030667,  0.051494, -0.262698, -0.204111,  0.552454,  0.260673,
        -0.072537,  0.140756,  0.215893, -0.045971,  0.289605, -0.198233],
       [ 0.051494,  0.300886,  0.159218,  0.002972, -0.091647,  0.648182,...
 y: array([[1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0.],...
FAILED linalg/tests/test_decomp_update.py::TestQRupdate_f::test_non_itemsize_strides_rank_1 - AssertionError: 
Not equal to tolerance rtol=0.0001, atol=1.19209e-06

Mismatched elements: 144 / 144 (100%)
Max absolute difference: 1.56318134
Max relative difference: 1.56318134
 x: array([[-0.054046,  0.205639, -0.123517,  0.260355,  0.474265, -0.249005,
         0.177618, -0.301207,  0.618385, -0.037394,  0.023149,  0.252298],
       [ 0.205639,  0.756895, -0.286572,  0.154587,  0.321836,  0.283857,...
 y: array([[1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0.],...
FAILED linalg/tests/test_decomp_update.py::TestQRupdate_f::test_non_itemsize_strides_rank_p - AssertionError: 
Not equal to tolerance rtol=0.0001, atol=1.19209e-06

Mismatched elements: 144 / 144 (100%)
Max absolute difference: 1.5197227
Max relative difference: 1.5197227
 x: array([[ 0.030667,  0.051494, -0.262698, -0.204111,  0.552454,  0.260673,
        -0.072537,  0.140756,  0.215893, -0.045971,  0.289605, -0.198233],
       [ 0.051494,  0.300886,  0.159218,  0.002972, -0.091647,  0.648182,...
 y: array([[1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0.],...
FAILED linalg/tests/test_decomp_update.py::TestQRupdate_f::test_non_native_byte_order_rank_1 - AssertionError: 
Not equal to tolerance rtol=0.0001, atol=1.19209e-06

Mismatched elements: 144 / 144 (100%)
Max absolute difference: 1.56318134
Max relative difference: 1.56318134
 x: array([[-0.054046,  0.205639, -0.123517,  0.260355,  0.474265, -0.249005,
         0.177618, -0.301207,  0.618385, -0.037394,  0.023149,  0.252298],
       [ 0.205639,  0.756895, -0.286572,  0.154587,  0.321836,  0.283857,...
 y: array([[1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0.],...
FAILED linalg/tests/test_decomp_update.py::TestQRupdate_f::test_non_native_byte_order_rank_p - AssertionError: 
Not equal to tolerance rtol=0.0001, atol=1.19209e-06

Mismatched elements: 144 / 144 (100%)
Max absolute difference: 1.5197227
Max relative difference: 1.5197227
 x: array([[ 0.030667,  0.051494, -0.262698, -0.204111,  0.552454,  0.260673,
        -0.072537,  0.140756,  0.215893, -0.045971,  0.289605, -0.198233],
       [ 0.051494,  0.300886,  0.159218,  0.002972, -0.091647,  0.648182,...
 y: array([[1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.],
       [0., 0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0.],...
FAILED linalg/tests/test_lapack.py::test_pftri - AssertionError: 
Arrays are not almost equal to 4 decimals

Mismatched elements: 21 / 400 (5.25%)
Max absolute difference: 0.00037931
Max relative difference: 0.64988735
 x: array([[ 5.0451e-02, -1.1576e-03,  2.7290e-04, -1.5024e-03, -1.7656e-03,
        -1.3410e-03, -1.4870e-03, -7.1398e-04, -1.4734e-03, -2.5769e-03,
        -2.0850e-03, -9.8616e-04, -7.3829e-04, -1.9978e-03,  1.7069e-04,...
 y: array([[ 5.0565e-02, -1.0042e-03,  2.1366e-04, -1.5335e-03, -1.5981e-03,
        -1.4567e-03, -1.5799e-03, -5.9890e-04, -1.4266e-03, -2.5949e-03,
        -2.0850e-03, -9.8616e-04, -7.3829e-04, -1.9978e-03,  1.7069e-04,...
FAILED linalg/tests/test_lapack.py::test_sfrk_hfrk - AssertionError: 
Arrays are not almost equal to 4 decimals

Mismatched elements: 165 / 400 (41.2%)
Max absolute difference: 1.14951146
Max relative difference: 14.46566384
 x: array([[ 3.9575e+01,  1.3012e+00,  5.5721e-02,  1.6919e+00,  1.3906e+00,
         1.7789e+00,  8.5231e-01,  8.1178e-01,  1.2308e+00,  2.1547e+00,
         1.7334e+00,  6.0473e-01,  2.1888e-01,  2.0501e+00, -1.1836e-01,...
 y: array([[ 3.9575e+01,  1.3012e+00,  2.2163e-01,  1.2076e+00,  1.4051e+00,
         1.8348e+00,  1.0907e+00,  1.0859e+00,  1.3009e+00,  2.1895e+00,
         1.3301e+00,  1.5722e+00,  1.7302e-01,  1.5784e+00,  1.6231e-01,...
FAILED linalg/tests/test_lapack.py::TestBlockedQR::test_geqrt_gemqrt - AssertionError: 
Not equal to tolerance rtol=0, atol=1.19209e-05

Mismatched elements: 320 / 400 (80%)
Max absolute difference: 1.4186668
Max relative difference: 1.4186668
 x: array([[ 4.153938e-01,  3.214427e-01, -1.697152e-01, -2.782870e-01,
         2.549522e-01,  3.815206e-01, -1.836173e-01, -8.294257e-03,
         2.499608e-01,  1.465432e-02,  1.211796e-01, -2.663902e-01,...
 y: array([[1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.,
        0., 0., 0., 0.],
       [0., 1., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0., 0.,...
FAILED linalg/tests/test_lapack.py::TestBlockedQR::test_tpqrt_tpmqrt - AssertionError: 
Not equal to tolerance rtol=0, atol=1.19209e-05

Mismatched elements: 1024 / 1600 (64%)
Max absolute difference: 1.2731317
Max relative difference: 1.2731317
 x: array([[ 3.782889e-03,  1.856932e-02,  1.523624e-02, ..., -1.549972e-01,
         2.169387e-01, -3.143149e-01],
       [ 1.856932e-02,  4.894961e-02, -5.576465e-02, ...,  2.150272e-02,...
 y: array([[1., 0., 0., ..., 0., 0., 0.],
       [0., 1., 0., ..., 0., 0., 0.],
       [0., 0., 1., ..., 0., 0., 0.],...
FAILED linalg/tests/test_lapack.py::test_pstrf - AssertionError: 
Not equal to tolerance rtol=0, atol=0.000119209

Mismatched elements: 85 / 100 (85%)
Max absolute difference: 3.529682
Max relative difference: 1.4060138
 x: array([[3.487075, 2.2597  , 1.555289, 2.763015, 3.431685, 2.046993,
        2.797032, 2.700427, 3.422926, 2.103169],
       [2.2597  , 2.130606, 1.477844, 1.633565, 2.117459, 1.866201,...
 y: array([[3.487075, 2.2597  , 1.555289, 2.763015, 3.431685, 2.046993,
        2.797032, 2.700427, 0.      , 0.      ],
       [2.2597  , 2.38366 , 1.007861, 2.456765, 2.693789, 1.169568,...
FAILED linalg/tests/test_lapack.py::test_pstf2 - AssertionError: 
Not equal to tolerance rtol=0, atol=0.000119209

Mismatched elements: 85 / 100 (85%)
Max absolute difference: 3.529682
Max relative difference: 1.4060138
 x: array([[3.487075, 2.2597  , 1.555289, 2.763015, 3.431685, 2.046993,
        2.797032, 2.700427, 3.422926, 2.103169],
       [2.2597  , 2.130606, 1.477844, 1.633565, 2.117459, 1.866201,...
 y: array([[3.487075, 2.2597  , 1.555289, 2.763015, 3.431685, 2.046993,
        2.797032, 2.700427, 0.      , 0.      ],
       [2.2597  , 2.38366 , 1.007861, 2.456765, 2.693789, 1.169568,...
osx + x64 + accelerate: 1 failure
FAILED interpolate/tests/test_rbfinterp.py::TestRBFInterpolatorNeighbors20::test_pickleable - AssertionError: 
Arrays are not equal

Mismatched elements: 4 / 50 (8%)
Max absolute difference: 5.55111512e-17
Max relative difference: 9.28510161e-16
 x: array([-0.238461,  0.257024, -0.811244,  0.295313,  0.132623,  0.2038  ,
       -0.99615 ,  0.29755 , -0.019889,  0.230791, -0.516801,  0.279867,
        0.227767,  0.178071, -0.172756,  0.251327, -0.406818,  0.271919,...
 y: array([-0.238461,  0.257024, -0.811244,  0.295313,  0.132623,  0.2038  ,
       -0.99615 ,  0.29755 , -0.019889,  0.230791, -0.516801,  0.279867,
        0.227767,  0.178071, -0.172756,  0.251327, -0.406818,  0.271919,...
osx + x64 + mkl + pypy: 2 failures
FAILED linalg/tests/test_decomp_cossin.py::test_cossin[True-40-12-20-float32] - AssertionError: 
Not equal to tolerance rtol=0, atol=1.19209e-06

Mismatched elements: 166 / 1600 (10.4%)
Max absolute difference: 1.2262093
Max relative difference: 2.0001094
 x: array([[ 0.088203, -0.328941, -0.031064, ...,  0.      ,  0.      ,
         0.      ],
       [-0.233614, -0.048775, -0.223086, ...,  0.      ,  0.      ,...
 y: array([[ 0.088203, -0.328941, -0.031064, ...,  0.      ,  0.      ,
         0.      ],
       [ 0.233614,  0.048775,  0.223086, ...,  0.      ,  0.      ,...
FAILED linalg/tests/test_decomp_cossin.py::test_cossin[False-40-12-20-float32] - AssertionError: 
Not equal to tolerance rtol=0, atol=1.19209e-06

Mismatched elements: 156 / 1600 (9.75%)
Max absolute difference: 1.1218276
Max relative difference: 2.0000126
 x: array([[ 0.088203, -0.328941, -0.031064, ...,  0.      ,  0.      ,
         0.      ],
       [ 0.233614,  0.048776,  0.223085, ...,  0.      ,  0.      ,...
 y: array([[ 0.088203, -0.328941, -0.031065, ...,  0.      ,  0.      ,
         0.      ],
       [ 0.233614,  0.048776,  0.223085, ...,  0.      ,  0.      ,...
windows + openblas: 9-12 failures
FAILED _lib/tests/test_import_cycles.py::test_public_modules_importable - AssertionError: Failed to import scipy.cluster
assert 1 == 0
 +  where 1 = <bound method Popen.wait of <Popen: returncode: 1 args: ['C:\\bld\\scipy-split_1709763107552\\_test_env\...>>()
 +    where <bound method Popen.wait of <Popen: returncode: 1 args: ['C:\\bld\\scipy-split_1709763107552\\_test_env\...>> = <Popen: returncode: 1 args: ['C:\\bld\\scipy-split_1709763107552\\_test_env\...>.wait
FAILED interpolate/tests/test_interpnd.py::TestCloughTocher2DInterpolator::test_dense
FAILED linalg/tests/test_basic.py::TestLstsq::test_random_exact
FAILED linalg/tests/test_decomp.py::TestEig::test_bad_geneig - AssertionError: 
Not equal to tolerance rtol=1e-07, atol=1e-07

array([[ 1.    ,  0.    ,  0.    ,  0.    ],
       [ 0.    ,  1.    ,  0.    ,  0.    ],
       [ 0.    ,  0.    , -8.9975,  0.    ],
       [ 0.    ,  0.    ,  0.    , -8.9975]])
array([[ 0. ,  0. ,  1. ,  0. ],
       [ 0. ,  0. ,  0. ,  1. ],
       [ 1. ,  0. ,  0. , -0.1],
       [ 0. ,  1. ,  0.1,  0. ]])
Mismatched elements: 3 / 4 (75%)
Max absolute difference: 6.
Max relative difference: 2.03389831
 x: array([0.000000e+00-3.05j, 0.000000e+00+3.05j, 1.001943e-16-2.95j,
       1.001943e-16+2.95j])
 y: array([0.-3.05j, 0.-2.95j, 0.+2.95j, 0.+3.05j])
FAILED sparse/linalg/tests/test_propack.py::test_examples[False-float32]
FAILED sparse/linalg/tests/test_propack.py::test_examples[False-float64]
FAILED sparse/linalg/tests/test_propack.py::test_examples[False-complex64]
FAILED sparse/linalg/tests/test_propack.py::test_examples[True-float32]
FAILED sparse/linalg/tests/test_propack.py::test_examples[True-float64]
FAILED sparse/linalg/tests/test_propack.py::test_examples[True-complex64]
FAILED spatial/tests/test_qhull.py::TestUtilities::test_more_barycentric_transforms
FAILED spatial/tests/test_qhull.py::TestUtilities::test_degenerate_barycentric_transforms

@h-vetinari
Copy link
Member Author

While preparing the update for 1.13, I noticed that I had failed to mention/count the new failures on linux+blis correctly; updated the previous comment accordingly.

@h-vetinari
Copy link
Member Author

Closing as obsolete now that 1.14 is out (and 1.12 patch releases basically an impossibility)

@h-vetinari h-vetinari closed this Jun 25, 2024
@h-vetinari h-vetinari deleted the 1.12_blas_vars branch June 25, 2024 02:00
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants