Intel 19 test failures

[jeffhammond]

I apologize if this is a duplicate, but this is different from #160 and #120.

I am seeing systematic test failures with the haswell configuration when building BLIS with Intel 19 compilers. This issue will capture the details.

The immediate solution here is to blacklist Intel 19, at least with the haswell configuration, but I will check other configurations once I have identified all the problematic versions.

Good

2017.3.191
2017.4.196
2017.8.262
2018.0.128
2018.1.163
2018.2.199
2018.5.274

Bad

2019.0.117
2019.1.144
2019.2.159
2019.4.243
2020.0.166

Affected tests

I pruned the output to the dimension=100 case but all dimensions fail for the following tests when using the bad versions noted above.

blis_caxpy2v_nn_ccc                100     2.27   5.09e-01   FAILURE
blis_caxpy2v_nc_ccc                100     2.71   5.31e-01   FAILURE
blis_caxpy2v_cn_ccc                100     0.74   5.07e-01   FAILURE
blis_caxpy2v_cc_ccc                100     2.86   4.91e-01   FAILURE
blis_cdotxaxpyf_nnnn_ccccc         100     4     1.94   1.80e+01   FAILURE
blis_cdotxaxpyf_nnnc_ccccc         100     4     7.62   1.41e+01   FAILURE
blis_cdotxaxpyf_nncn_ccccc         100     4     5.22   1.48e+01   FAILURE
blis_cdotxaxpyf_nncc_ccccc         100     4     6.90   1.41e+01   FAILURE
blis_cdotxaxpyf_ncnn_ccccc         100     4     5.66   1.39e+01   FAILURE
blis_cdotxaxpyf_ncnc_ccccc         100     4     7.47   1.72e+01   FAILURE
blis_cdotxaxpyf_nccn_ccccc         100     4     5.95   1.72e+01   FAILURE
blis_cdotxaxpyf_nccc_ccccc         100     4     7.12   1.88e+01   FAILURE
blis_cdotxaxpyf_cnnn_ccccc         100     4     6.96   2.04e+01   FAILURE
blis_cdotxaxpyf_cnnc_ccccc         100     4     7.46   1.33e+01   FAILURE
blis_cdotxaxpyf_cncn_ccccc         100     4     6.73   1.74e+01   FAILURE
blis_cdotxaxpyf_cncc_ccccc         100     4     5.77   1.54e+01   FAILURE
blis_cdotxaxpyf_ccnn_ccccc         100     4     6.86   1.78e+01   FAILURE
blis_cdotxaxpyf_ccnc_ccccc         100     4     7.59   1.01e+01   FAILURE
blis_cdotxaxpyf_cccn_ccccc         100     4     7.02   1.76e+01   FAILURE
blis_cdotxaxpyf_cccc_ccccc         100     4     7.36   1.39e+01   FAILURE
blis_zdotxaxpyf_nnnn_ccccc         100     4     1.01   1.36e+01   FAILURE
blis_zdotxaxpyf_nnnc_ccccc         100     4     6.67   1.50e+01   FAILURE
blis_zdotxaxpyf_nncn_ccccc         100     4     2.39   1.50e+01   FAILURE
blis_zdotxaxpyf_nncc_ccccc         100     4     6.58   1.67e+01   FAILURE
blis_zdotxaxpyf_ncnn_ccccc         100     4     4.29   1.37e+01   FAILURE
blis_zdotxaxpyf_ncnc_ccccc         100     4     6.72   1.57e+01   FAILURE
blis_zdotxaxpyf_nccn_ccccc         100     4     3.94   1.65e+01   FAILURE
blis_zdotxaxpyf_nccc_ccccc         100     4     6.13   1.43e+01   FAILURE
blis_zdotxaxpyf_cnnn_ccccc         100     4     5.76   2.02e+01   FAILURE
blis_zdotxaxpyf_cnnc_ccccc         100     4     6.76   1.86e+01   FAILURE
blis_zdotxaxpyf_cncn_ccccc         100     4     6.37   1.65e+01   FAILURE
blis_zdotxaxpyf_cncc_ccccc         100     4     5.41   1.43e+01   FAILURE
blis_zdotxaxpyf_ccnn_ccccc         100     4     5.62   1.46e+01   FAILURE
blis_zdotxaxpyf_ccnc_ccccc         100     4     6.90   1.39e+01   FAILURE
blis_zdotxaxpyf_cccn_ccccc         100     4     6.34   1.51e+01   FAILURE
blis_zdotxaxpyf_cccc_ccccc         100     4     6.34   1.39e+01   FAILURE
blis_chemv_lnn_rcc                 100     5.03   2.26e-02   FAILURE
blis_chemv_lnc_rcc                 100     5.52   1.96e-02   FAILURE
blis_chemv_lcn_rcc                 100     5.39   2.08e-02   FAILURE
blis_chemv_lcc_rcc                 100     5.45   4.28e-02   FAILURE
blis_chemv_unn_rcc                 100     5.33   1.95e-02   FAILURE
blis_chemv_unc_rcc                 100     5.81   2.00e-02   FAILURE
blis_chemv_ucn_rcc                 100     5.57   2.16e-02   FAILURE
blis_chemv_ucc_rcc                 100     5.63   3.65e-02   FAILURE
blis_zhemv_lnn_rcc                 100     3.32   1.96e-02   FAILURE
blis_zhemv_lnc_rcc                 100     4.62   1.92e-02   FAILURE
blis_zhemv_lcn_rcc                 100     4.63   2.12e-02   FAILURE
blis_zhemv_lcc_rcc                 100     4.64   3.77e-02   FAILURE
blis_zhemv_unn_rcc                 100     4.62   2.00e-02   FAILURE
blis_zhemv_unc_rcc                 100     4.74   4.03e-02   FAILURE
blis_zhemv_ucn_rcc                 100     4.58   2.17e-02   FAILURE
blis_zhemv_ucc_rcc                 100     4.71   1.82e-02   FAILURE
blis_chemv_lnn_ccc                 100     5.31   1.84e-02   FAILURE
blis_chemv_lnc_ccc                 100     5.55   3.89e-02   FAILURE
blis_chemv_lcn_ccc                 100     6.00   1.97e-02   FAILURE
blis_chemv_lcc_ccc                 100     6.12   2.08e-02   FAILURE
blis_chemv_unn_ccc                 100     5.89   2.04e-02   FAILURE
blis_chemv_unc_ccc                 100     5.93   3.64e-02   FAILURE
blis_chemv_ucn_ccc                 100     6.02   2.08e-02   FAILURE
blis_chemv_ucc_ccc                 100     6.15   4.07e-02   FAILURE
blis_zhemv_lnn_ccc                 100     4.77   2.05e-02   FAILURE
blis_zhemv_lnc_ccc                 100     5.07   3.77e-02   FAILURE
blis_zhemv_lcn_ccc                 100     5.04   1.85e-02   FAILURE
blis_zhemv_lcc_ccc                 100     5.09   1.99e-02   FAILURE
blis_zhemv_unn_ccc                 100     4.95   1.97e-02   FAILURE
blis_zhemv_unc_ccc                 100     4.94   3.89e-02   FAILURE
blis_zhemv_ucn_ccc                 100     4.98   2.12e-02   FAILURE
blis_zhemv_ucc_ccc                 100     5.10   2.01e-02   FAILURE
blis_cher2_lnn_ccr                 100     7.11   3.29e-02   FAILURE
blis_cher2_lnc_ccr                 100    10.25   2.37e-02   FAILURE
blis_cher2_lcn_ccr                 100    10.18   9.89e-03   FAILURE
blis_cher2_lcc_ccr                 100    10.04   9.82e-02   FAILURE
blis_cher2_unn_ccr                 100     9.48   2.51e-02   FAILURE
blis_cher2_unc_ccr                 100     9.87   2.64e-02   FAILURE
blis_cher2_ucn_ccr                 100     9.60   2.95e-02   FAILURE
blis_cher2_ucc_ccr                 100     9.47   4.16e-02   FAILURE
blis_cher2_lnn_ccc                 100     8.95   3.41e-02   FAILURE
blis_cher2_lnc_ccc                 100     9.65   3.35e-02   FAILURE
blis_cher2_lcn_ccc                 100     9.44   1.64e-02   FAILURE
blis_cher2_lcc_ccc                 100     9.04   1.98e-02   FAILURE
blis_cher2_unn_ccc                 100     9.84   3.60e-02   FAILURE
blis_cher2_unc_ccc                 100    10.20   3.26e-02   FAILURE
blis_cher2_ucn_ccc                 100    10.13   1.74e-02   FAILURE
blis_cher2_ucc_ccc                 100    10.12   3.87e-02   FAILURE
blis_csymv_lnn_rcc                 100     5.02   4.12e-02   FAILURE
blis_csymv_lnc_rcc                 100     5.75   2.19e-02   FAILURE
blis_csymv_lcn_rcc                 100     5.12   3.70e-02   FAILURE
blis_csymv_lcc_rcc                 100     5.83   2.04e-02   FAILURE
blis_csymv_unn_rcc                 100     5.51   2.14e-02   FAILURE
blis_csymv_unc_rcc                 100     6.10   1.85e-02   FAILURE
blis_csymv_ucn_rcc                 100     6.04   2.19e-02   FAILURE
blis_csymv_ucc_rcc                 100     6.04   2.12e-02   FAILURE
blis_zsymv_lnn_rcc                 100     4.15   2.00e-02   FAILURE
blis_zsymv_lnc_rcc                 100     4.72   1.99e-02   FAILURE
blis_zsymv_lcn_rcc                 100     4.69   2.01e-02   FAILURE
blis_zsymv_lcc_rcc                 100     4.76   2.14e-02   FAILURE
blis_zsymv_unn_rcc                 100     4.82   2.03e-02   FAILURE
blis_zsymv_unc_rcc                 100     5.07   2.15e-02   FAILURE
blis_zsymv_ucn_rcc                 100     4.99   2.14e-02   FAILURE
blis_zsymv_ucc_rcc                 100     4.99   1.91e-02   FAILURE
blis_csymv_lnn_ccc                 100     5.82   1.94e-02   FAILURE
blis_csymv_lnc_ccc                 100     6.16   4.01e-02   FAILURE
blis_csymv_lcn_ccc                 100     6.03   1.98e-02   FAILURE
blis_csymv_lcc_ccc                 100     6.04   3.69e-02   FAILURE
blis_csymv_unn_ccc                 100     5.92   3.86e-02   FAILURE
blis_csymv_unc_ccc                 100     6.16   3.80e-02   FAILURE
blis_csymv_ucn_ccc                 100     6.04   2.06e-02   FAILURE
blis_csymv_ucc_ccc                 100     6.05   2.06e-02   FAILURE
blis_zsymv_lnn_ccc                 100     4.89   2.13e-02   FAILURE
blis_zsymv_lnc_ccc                 100     5.05   2.14e-02   FAILURE
blis_zsymv_lcn_ccc                 100     4.96   2.12e-02   FAILURE
blis_zsymv_lcc_ccc                 100     5.09   2.02e-02   FAILURE
blis_zsymv_unn_ccc                 100     5.00   3.87e-02   FAILURE
blis_zsymv_unc_ccc                 100     5.09   2.02e-02   FAILURE
blis_zsymv_ucn_ccc                 100     5.02   2.07e-02   FAILURE
blis_zsymv_ucc_ccc                 100     5.05   2.20e-02   FAILURE
blis_csyr2_lnn_ccr                 100     9.64   2.75e-02   FAILURE
blis_csyr2_lnc_ccr                 100    10.34   3.43e-02   FAILURE
blis_csyr2_lcn_ccr                 100    10.42   2.94e-02   FAILURE
blis_csyr2_lcc_ccr                 100    10.26   1.58e-02   FAILURE
blis_csyr2_unn_ccr                 100     9.52   2.31e-02   FAILURE
blis_csyr2_unc_ccr                 100     9.78   5.54e-02   FAILURE
blis_csyr2_ucn_ccr                 100     9.74   4.05e-02   FAILURE
blis_csyr2_ucc_ccr                 100     9.72   3.56e-02   FAILURE
blis_csyr2_lnn_ccc                 100     9.38   3.70e-02   FAILURE
blis_csyr2_lnc_ccc                 100     9.77   6.91e-02   FAILURE
blis_csyr2_lcn_ccc                 100     9.71   1.39e-02   FAILURE
blis_csyr2_lcc_ccc                 100     9.80   2.35e-02   FAILURE
blis_csyr2_unn_ccc                 100    10.13   1.69e-02   FAILURE
blis_csyr2_unc_ccc                 100    10.28   1.61e-02   FAILURE
blis_csyr2_ucn_ccc                 100    10.39   2.93e-02   FAILURE
blis_csyr2_ucc_ccc                 100    10.33   1.14e-02   FAILURE
blis_chemm1m_llnn_rrr              100   100    48.41   2.88e-03   FAILURE
blis_chemm1m_llnc_rrr              100   100    52.62   2.75e-03   FAILURE
blis_chemm1m_llnt_rrr              100   100    51.00   4.57e-03   FAILURE
blis_chemm1m_llnh_rrr              100   100    53.48   5.18e-03   FAILURE
blis_chemm1m_llcn_rrr              100   100    53.60   4.49e-03   FAILURE
blis_chemm1m_llcc_rrr              100   100    50.28   2.57e-03   FAILURE
blis_chemm1m_llct_rrr              100   100    53.92   2.60e-03   FAILURE
blis_chemm1m_llch_rrr              100   100    53.75   2.58e-03   FAILURE
blis_chemm1m_lunn_rrr              100   100    50.82   4.84e-03   FAILURE
blis_chemm1m_lunc_rrr              100   100    53.27   2.72e-03   FAILURE
blis_chemm1m_lunt_rrr              100   100    54.01   2.26e-03   FAILURE
blis_chemm1m_lunh_rrr              100   100    53.49   2.29e-03   FAILURE
blis_chemm1m_lucn_rrr              100   100    53.55   4.73e-03   FAILURE
blis_chemm1m_lucc_rrr              100   100    53.42   2.49e-03   FAILURE
blis_chemm1m_luct_rrr              100   100    53.89   2.74e-03   FAILURE
blis_chemm1m_luch_rrr              100   100    53.66   2.79e-03   FAILURE
blis_chemm1m_rlnn_rrr              100   100    52.83   5.12e-03   FAILURE
blis_chemm1m_rlnc_rrr              100   100    53.53   2.40e-03   FAILURE
blis_chemm1m_rlnt_rrr              100   100    53.13   2.59e-03   FAILURE
blis_chemm1m_rlnh_rrr              100   100    53.47   2.71e-03   FAILURE
blis_chemm1m_rlcn_rrr              100   100    53.51   2.51e-03   FAILURE
blis_chemm1m_rlcc_rrr              100   100    53.90   2.57e-03   FAILURE
blis_chemm1m_rlct_rrr              100   100    51.17   2.91e-03   FAILURE
blis_chemm1m_rlch_rrr              100   100    53.47   2.49e-03   FAILURE
blis_chemm1m_runn_rrr              100   100    53.08   2.87e-03   FAILURE
blis_chemm1m_runc_rrr              100   100    53.74   3.01e-03   FAILURE
blis_chemm1m_runt_rrr              100   100    50.51   2.32e-03   FAILURE
blis_chemm1m_runh_rrr              100   100    53.25   2.36e-03   FAILURE
blis_chemm1m_rucn_rrr              100   100    53.14   4.73e-03   FAILURE
blis_chemm1m_rucc_rrr              100   100    53.82   4.92e-03   FAILURE
blis_chemm1m_ruct_rrr              100   100    51.80   2.77e-03   FAILURE
blis_chemm1m_ruch_rrr              100   100    53.44   4.48e-03   FAILURE
blis_chemm_llnn_rrr                100   100    62.89   2.59e-03   FAILURE
blis_chemm_llnc_rrr                100   100    62.73   2.67e-03   FAILURE
blis_chemm_llnt_rrr                100   100    63.84   2.73e-03   FAILURE
blis_chemm_llnh_rrr                100   100    63.63   4.61e-03   FAILURE
blis_chemm_llcn_rrr                100   100    61.49   2.67e-03   FAILURE
blis_chemm_llcc_rrr                100   100    63.32   3.05e-03   FAILURE
blis_chemm_llct_rrr                100   100    64.18   2.63e-03   FAILURE
blis_chemm_llch_rrr                100   100    63.82   2.71e-03   FAILURE
blis_chemm_lunn_rrr                100   100    63.44   5.17e-03   FAILURE
blis_chemm_lunc_rrr                100   100    60.53   2.77e-03   FAILURE
blis_chemm_lunt_rrr                100   100    63.82   4.99e-03   FAILURE
blis_chemm_lunh_rrr                100   100    63.75   2.52e-03   FAILURE
blis_chemm_lucn_rrr                100   100    63.94   4.20e-03   FAILURE
blis_chemm_lucc_rrr                100   100    63.59   2.82e-03   FAILURE
blis_chemm_luct_rrr                100   100    64.33   2.70e-03   FAILURE
blis_chemm_luch_rrr                100   100    64.15   5.26e-03   FAILURE
blis_chemm_rlnn_rrr                100   100    61.25   2.49e-03   FAILURE
blis_chemm_rlnc_rrr                100   100    65.32   2.65e-03   FAILURE
blis_chemm_rlnt_rrr                100   100    65.22   2.81e-03   FAILURE
blis_chemm_rlnh_rrr                100   100    62.22   2.70e-03   FAILURE
blis_chemm_rlcn_rrr                100   100    65.33   3.11e-03   FAILURE
blis_chemm_rlcc_rrr                100   100    65.17   5.08e-03   FAILURE
blis_chemm_rlct_rrr                100   100    65.05   5.05e-03   FAILURE
blis_chemm_rlch_rrr                100   100    62.43   2.78e-03   FAILURE
blis_chemm_runn_rrr                100   100    65.52   5.31e-03   FAILURE
blis_chemm_runc_rrr                100   100    65.56   2.43e-03   FAILURE
blis_chemm_runt_rrr                100   100    65.34   2.78e-03   FAILURE
blis_chemm_runh_rrr                100   100    64.78   2.73e-03   FAILURE
blis_chemm_rucn_rrr                100   100    65.55   2.82e-03   FAILURE
blis_chemm_rucc_rrr                100   100    65.63   4.78e-03   FAILURE
blis_chemm_ruct_rrr                100   100    65.42   2.55e-03   FAILURE
blis_chemm_ruch_rrr                100   100    64.78   2.80e-03   FAILURE
blis_zhemm1m_llnn_rrr              100   100    28.91   3.06e-03   FAILURE
blis_zhemm1m_llnc_rrr              100   100    30.37   2.88e-03   FAILURE
blis_zhemm1m_llnt_rrr              100   100    30.53   5.38e-03   FAILURE
blis_zhemm1m_llnh_rrr              100   100    30.58   2.55e-03   FAILURE
blis_zhemm1m_llcn_rrr              100   100    29.98   2.65e-03   FAILURE
blis_zhemm1m_llcc_rrr              100   100    29.42   2.36e-03   FAILURE
blis_zhemm1m_llct_rrr              100   100    30.63   2.58e-03   FAILURE
blis_zhemm1m_llch_rrr              100   100    30.65   5.07e-03   FAILURE
blis_zhemm1m_lunn_rrr              100   100    30.31   2.53e-03   FAILURE
blis_zhemm1m_lunc_rrr              100   100    30.14   2.51e-03   FAILURE
blis_zhemm1m_lunt_rrr              100   100    29.98   2.66e-03   FAILURE
blis_zhemm1m_lunh_rrr              100   100    30.65   4.74e-03   FAILURE
blis_zhemm1m_lucn_rrr              100   100    30.39   4.71e-03   FAILURE
blis_zhemm1m_lucc_rrr              100   100    30.34   3.06e-03   FAILURE
blis_zhemm1m_luct_rrr              100   100    30.63   2.87e-03   FAILURE
blis_zhemm1m_luch_rrr              100   100    30.14   5.04e-03   FAILURE
blis_zhemm1m_rlnn_rrr              100   100    29.53   2.81e-03   FAILURE
blis_zhemm1m_rlnc_rrr              100   100    30.58   2.31e-03   FAILURE
blis_zhemm1m_rlnt_rrr              100   100    30.52   2.57e-03   FAILURE
blis_zhemm1m_rlnh_rrr              100   100    30.73   2.39e-03   FAILURE
blis_zhemm1m_rlcn_rrr              100   100    30.46   2.57e-03   FAILURE
blis_zhemm1m_rlcc_rrr              100   100    30.44   2.13e-03   FAILURE
blis_zhemm1m_rlct_rrr              100   100    30.41   4.77e-03   FAILURE
blis_zhemm1m_rlch_rrr              100   100    30.75   4.81e-03   FAILURE
blis_zhemm1m_runn_rrr              100   100    30.77   2.76e-03   FAILURE
blis_zhemm1m_runc_rrr              100   100    30.90   2.51e-03   FAILURE
blis_zhemm1m_runt_rrr              100   100    30.48   2.64e-03   FAILURE
blis_zhemm1m_runh_rrr              100   100    30.86   5.00e-03   FAILURE
blis_zhemm1m_rucn_rrr              100   100    30.57   2.45e-03   FAILURE
blis_zhemm1m_rucc_rrr              100   100    30.95   2.77e-03   FAILURE
blis_zhemm1m_ruct_rrr              100   100    29.86   2.71e-03   FAILURE
blis_zhemm1m_ruch_rrr              100   100    30.10   2.74e-03   FAILURE
blis_zhemm_llnn_rrr                100   100    35.37   2.77e-03   FAILURE
blis_zhemm_llnc_rrr                100   100    35.76   2.47e-03   FAILURE
blis_zhemm_llnt_rrr                100   100    35.90   2.33e-03   FAILURE
blis_zhemm_llnh_rrr                100   100    35.94   2.73e-03   FAILURE
blis_zhemm_llcn_rrr                100   100    35.81   2.85e-03   FAILURE
blis_zhemm_llcc_rrr                100   100    35.16   3.29e-03   FAILURE
blis_zhemm_llct_rrr                100   100    36.01   2.61e-03   FAILURE
blis_zhemm_llch_rrr                100   100    35.93   4.87e-03   FAILURE
blis_zhemm_lunn_rrr                100   100    35.79   2.59e-03   FAILURE
blis_zhemm_lunc_rrr                100   100    35.07   2.68e-03   FAILURE
blis_zhemm_lunt_rrr                100   100    35.92   5.14e-03   FAILURE
blis_zhemm_lunh_rrr                100   100    35.15   4.87e-03   FAILURE
blis_zhemm_lucn_rrr                100   100    36.00   2.72e-03   FAILURE
blis_zhemm_lucc_rrr                100   100    35.84   5.06e-03   FAILURE
blis_zhemm_luct_rrr                100   100    36.10   5.65e-03   FAILURE
blis_zhemm_luch_rrr                100   100    35.84   2.62e-03   FAILURE
blis_zhemm_rlnn_rrr                100   100    35.34   2.50e-03   FAILURE
blis_zhemm_rlnc_rrr                100   100    36.14   2.79e-03   FAILURE
blis_zhemm_rlnt_rrr                100   100    35.98   2.59e-03   FAILURE
blis_zhemm_rlnh_rrr                100   100    35.98   2.50e-03   FAILURE
blis_zhemm_rlcn_rrr                100   100    36.10   5.40e-03   FAILURE
blis_zhemm_rlcc_rrr                100   100    36.07   4.94e-03   FAILURE
blis_zhemm_rlct_rrr                100   100    36.12   2.64e-03   FAILURE
blis_zhemm_rlch_rrr                100   100    35.37   5.14e-03   FAILURE
blis_zhemm_runn_rrr                100   100    36.03   2.57e-03   FAILURE
blis_zhemm_runc_rrr                100   100    36.12   2.65e-03   FAILURE
blis_zhemm_runt_rrr                100   100    35.99   2.17e-03   FAILURE
blis_zhemm_runh_rrr                100   100    35.98   2.58e-03   FAILURE
blis_zhemm_rucn_rrr                100   100    36.00   2.75e-03   FAILURE
blis_zhemm_rucc_rrr                100   100    35.36   2.60e-03   FAILURE
blis_zhemm_ruct_rrr                100   100    35.96   2.64e-03   FAILURE
blis_zhemm_ruch_rrr                100   100    35.78   2.73e-03   FAILURE
blis_chemm1m_llnn_ccc              100   100    51.98   2.65e-03   FAILURE
blis_chemm1m_llnc_ccc              100   100    52.46   4.68e-03   FAILURE
blis_chemm1m_llnt_ccc              100   100    53.14   2.92e-03   FAILURE
blis_chemm1m_llnh_ccc              100   100    53.39   2.76e-03   FAILURE
blis_chemm1m_llcn_ccc              100   100    53.04   4.99e-03   FAILURE
blis_chemm1m_llcc_ccc              100   100    53.49   2.71e-03   FAILURE
blis_chemm1m_llct_ccc              100   100    52.87   2.14e-03   FAILURE
blis_chemm1m_llch_ccc              100   100    53.53   2.59e-03   FAILURE
blis_chemm1m_lunn_ccc              100   100    52.94   4.57e-03   FAILURE
blis_chemm1m_lunc_ccc              100   100    53.58   2.59e-03   FAILURE
blis_chemm1m_lunt_ccc              100   100    51.88   2.36e-03   FAILURE
blis_chemm1m_lunh_ccc              100   100    53.16   2.88e-03   FAILURE
blis_chemm1m_lucn_ccc              100   100    53.39   2.97e-03   FAILURE
blis_chemm1m_lucc_ccc              100   100    52.00   2.57e-03   FAILURE
blis_chemm1m_luct_ccc              100   100    53.20   4.81e-03   FAILURE
blis_chemm1m_luch_ccc              100   100    53.50   2.66e-03   FAILURE
blis_chemm1m_rlnn_ccc              100   100    50.50   5.03e-03   FAILURE
blis_chemm1m_rlnc_ccc              100   100    53.35   4.60e-03   FAILURE
blis_chemm1m_rlnt_ccc              100   100    53.95   2.58e-03   FAILURE
blis_chemm1m_rlnh_ccc              100   100    53.64   2.48e-03   FAILURE
blis_chemm1m_rlcn_ccc              100   100    51.01   4.27e-03   FAILURE
blis_chemm1m_rlcc_ccc              100   100    52.99   2.78e-03   FAILURE
blis_chemm1m_rlct_ccc              100   100    53.85   2.78e-03   FAILURE
blis_chemm1m_rlch_ccc              100   100    53.81   2.84e-03   FAILURE
blis_chemm1m_runn_ccc              100   100    53.47   5.47e-03   FAILURE
blis_chemm1m_runc_ccc              100   100    52.87   4.60e-03   FAILURE
blis_chemm1m_runt_ccc              100   100    53.80   2.38e-03   FAILURE
blis_chemm1m_runh_ccc              100   100    53.73   5.12e-03   FAILURE
blis_chemm1m_rucn_ccc              100   100    53.40   2.92e-03   FAILURE
blis_chemm1m_rucc_ccc              100   100    53.35   2.46e-03   FAILURE
blis_chemm1m_ruct_ccc              100   100    54.05   2.42e-03   FAILURE
blis_chemm1m_ruch_ccc              100   100    53.83   2.72e-03   FAILURE
blis_chemm_llnn_ccc                100   100    64.31   2.78e-03   FAILURE
blis_chemm_llnc_ccc                100   100    65.38   2.34e-03   FAILURE
blis_chemm_llnt_ccc                100   100    65.32   2.65e-03   FAILURE
blis_chemm_llnh_ccc                100   100    64.63   2.64e-03   FAILURE
blis_chemm_llcn_ccc                100   100    60.76   5.12e-03   FAILURE
blis_chemm_llcc_ccc                100   100    65.24   2.46e-03   FAILURE
blis_chemm_llct_ccc                100   100    65.18   4.38e-03   FAILURE
blis_chemm_llch_ccc                100   100    64.31   2.56e-03   FAILURE
blis_chemm_lunn_ccc                100   100    65.13   4.67e-03   FAILURE
blis_chemm_lunc_ccc                100   100    65.42   2.36e-03   FAILURE
blis_chemm_lunt_ccc                100   100    65.18   5.60e-03   FAILURE
blis_chemm_lunh_ccc                100   100    64.36   2.51e-03   FAILURE
blis_chemm_lucn_ccc                100   100    64.93   2.56e-03   FAILURE
blis_chemm_lucc_ccc                100   100    65.13   2.65e-03   FAILURE
blis_chemm_luct_ccc                100   100    64.97   4.84e-03   FAILURE
blis_chemm_luch_ccc                100   100    64.13   2.78e-03   FAILURE
blis_chemm_rlnn_ccc                100   100    63.51   2.51e-03   FAILURE
blis_chemm_rlnc_ccc                100   100    63.25   5.12e-03   FAILURE
blis_chemm_rlnt_ccc                100   100    64.15   3.11e-03   FAILURE
blis_chemm_rlnh_ccc                100   100    63.70   2.60e-03   FAILURE
blis_chemm_rlcn_ccc                100   100    64.04   2.85e-03   FAILURE
blis_chemm_rlcc_ccc                100   100    63.50   2.69e-03   FAILURE
blis_chemm_rlct_ccc                100   100    64.52   5.40e-03   FAILURE
blis_chemm_rlch_ccc                100   100    63.99   4.91e-03   FAILURE
blis_chemm_runn_ccc                100   100    63.62   2.50e-03   FAILURE
blis_chemm_runc_ccc                100   100    60.99   2.37e-03   FAILURE
blis_chemm_runt_ccc                100   100    63.98   2.57e-03   FAILURE
blis_chemm_runh_ccc                100   100    63.79   2.93e-03   FAILURE
blis_chemm_rucn_ccc                100   100    61.61   2.76e-03   FAILURE
blis_chemm_rucc_ccc                100   100    63.54   4.89e-03   FAILURE
blis_chemm_ruct_ccc                100   100    64.32   2.77e-03   FAILURE
blis_chemm_ruch_ccc                100   100    64.12   5.03e-03   FAILURE
blis_zhemm1m_llnn_ccc              100   100    30.32   4.88e-03   FAILURE
blis_zhemm1m_llnc_ccc              100   100    30.48   2.92e-03   FAILURE
blis_zhemm1m_llnt_ccc              100   100    30.24   5.35e-03   FAILURE
blis_zhemm1m_llnh_ccc              100   100    30.74   2.85e-03   FAILURE
blis_zhemm1m_llcn_ccc              100   100    30.46   5.06e-03   FAILURE
blis_zhemm1m_llcc_ccc              100   100    30.98   2.73e-03   FAILURE
blis_zhemm1m_llct_ccc              100   100    29.74   2.32e-03   FAILURE
blis_zhemm1m_llch_ccc              100   100    30.72   2.85e-03   FAILURE
blis_zhemm1m_lunn_ccc              100   100    30.77   5.22e-03   FAILURE
blis_zhemm1m_lunc_ccc              100   100    31.02   2.45e-03   FAILURE
blis_zhemm1m_lunt_ccc              100   100    30.40   5.38e-03   FAILURE
blis_zhemm1m_lunh_ccc              100   100    30.70   2.46e-03   FAILURE
blis_zhemm1m_lucn_ccc              100   100    30.48   2.72e-03   FAILURE
blis_zhemm1m_lucc_ccc              100   100    30.99   2.55e-03   FAILURE
blis_zhemm1m_luct_ccc              100   100    30.43   3.00e-03   FAILURE
blis_zhemm1m_luch_ccc              100   100    30.76   2.50e-03   FAILURE
blis_zhemm1m_rlnn_ccc              100   100    30.30   2.65e-03   FAILURE
blis_zhemm1m_rlnc_ccc              100   100    30.28   5.33e-03   FAILURE
blis_zhemm1m_rlnt_ccc              100   100    30.41   2.72e-03   FAILURE
blis_zhemm1m_rlnh_ccc              100   100    30.47   2.93e-03   FAILURE
blis_zhemm1m_rlcn_ccc              100   100    29.86   2.70e-03   FAILURE
blis_zhemm1m_rlcc_ccc              100   100    30.00   5.19e-03   FAILURE
blis_zhemm1m_rlct_ccc              100   100    30.65   2.35e-03   FAILURE
blis_zhemm1m_rlch_ccc              100   100    30.63   4.62e-03   FAILURE
blis_zhemm1m_runn_ccc              100   100    30.02   5.83e-03   FAILURE
blis_zhemm1m_runc_ccc              100   100    29.99   4.79e-03   FAILURE
blis_zhemm1m_runt_ccc              100   100    30.59   2.79e-03   FAILURE
blis_zhemm1m_runh_ccc              100   100    30.54   5.76e-03   FAILURE
blis_zhemm1m_rucn_ccc              100   100    30.46   4.82e-03   FAILURE
blis_zhemm1m_rucc_ccc              100   100    30.41   2.81e-03   FAILURE
blis_zhemm1m_ruct_ccc              100   100    30.65   2.92e-03   FAILURE
blis_zhemm1m_ruch_ccc              100   100    30.73   4.57e-03   FAILURE
blis_zhemm_llnn_ccc                100   100    35.81   5.34e-03   FAILURE
blis_zhemm_llnc_ccc                100   100    36.09   4.46e-03   FAILURE
blis_zhemm_llnt_ccc                100   100    35.86   4.80e-03   FAILURE
blis_zhemm_llnh_ccc                100   100    35.28   2.63e-03   FAILURE
blis_zhemm_llcn_ccc                100   100    36.08   2.51e-03   FAILURE
blis_zhemm_llcc_ccc                100   100    36.04   2.51e-03   FAILURE
blis_zhemm_llct_ccc                100   100    35.90   2.81e-03   FAILURE
blis_zhemm_llch_ccc                100   100    35.18   2.56e-03   FAILURE
blis_zhemm_lunn_ccc                100   100    36.12   2.46e-03   FAILURE
blis_zhemm_lunc_ccc                100   100    36.09   2.55e-03   FAILURE
blis_zhemm_lunt_ccc                100   100    36.06   4.96e-03   FAILURE
blis_zhemm_lunh_ccc                100   100    36.00   2.50e-03   FAILURE
blis_zhemm_lucn_ccc                100   100    36.08   2.65e-03   FAILURE
blis_zhemm_lucc_ccc                100   100    36.09   2.40e-03   FAILURE
blis_zhemm_luct_ccc                100   100    35.96   2.74e-03   FAILURE
blis_zhemm_luch_ccc                100   100    35.90   2.54e-03   FAILURE
blis_zhemm_rlnn_ccc                100   100    35.68   2.78e-03   FAILURE
blis_zhemm_rlnc_ccc                100   100    35.82   2.65e-03   FAILURE
blis_zhemm_rlnt_ccc                100   100    35.99   4.94e-03   FAILURE
blis_zhemm_rlnh_ccc                100   100    35.82   2.54e-03   FAILURE
blis_zhemm_rlcn_ccc                100   100    35.10   3.21e-03   FAILURE
blis_zhemm_rlcc_ccc                100   100    34.96   2.36e-03   FAILURE
blis_zhemm_rlct_ccc                100   100    35.58   2.65e-03   FAILURE
blis_zhemm_rlch_ccc                100   100    35.88   2.69e-03   FAILURE
blis_zhemm_runn_ccc                100   100    36.05   5.09e-03   FAILURE
blis_zhemm_runc_ccc                100   100    35.71   5.60e-03   FAILURE
blis_zhemm_runt_ccc                100   100    35.94   2.86e-03   FAILURE
blis_zhemm_runh_ccc                100   100    35.26   2.78e-03   FAILURE
blis_zhemm_rucn_ccc                100   100    36.05   2.31e-03   FAILURE
blis_zhemm_rucc_ccc                100   100    35.72   2.51e-03   FAILURE
blis_zhemm_ruct_ccc                100   100    32.81   2.64e-03   FAILURE
blis_zhemm_ruch_ccc                100   100    32.21   2.36e-03   FAILURE
blis_cherk1m_ln_rr                 100   100    40.07   2.17e-03   FAILURE
blis_cherk1m_lc_rr                 100   100    43.66   3.86e-03   FAILURE
blis_cherk1m_lt_rr                 100   100    43.06   4.33e-03   FAILURE
blis_cherk1m_lh_rr                 100   100    43.50   2.05e-03   FAILURE
blis_cherk1m_un_rr                 100   100    41.00   1.88e-03   FAILURE
blis_cherk1m_uc_rr                 100   100    43.02   2.22e-03   FAILURE
blis_cherk1m_ut_rr                 100   100    42.35   2.13e-03   FAILURE
blis_cherk1m_uh_rr                 100   100    43.00   4.27e-03   FAILURE
blis_cherk_ln_rr                   100   100    48.31   2.17e-03   FAILURE
blis_cherk_lc_rr                   100   100    50.80   4.36e-03   FAILURE
blis_cherk_lt_rr                   100   100    50.06   2.23e-03   FAILURE
blis_cherk_lh_rr                   100   100    49.27   4.05e-03   FAILURE
blis_cherk_un_rr                   100   100    49.32   4.03e-03   FAILURE
blis_cherk_uc_rr                   100   100    49.62   2.18e-03   FAILURE
blis_cherk_ut_rr                   100   100    48.95   2.11e-03   FAILURE
blis_cherk_uh_rr                   100   100    46.79   2.05e-03   FAILURE
blis_zherk1m_ln_rr                 100   100    22.44   2.12e-03   FAILURE
blis_zherk1m_lc_rr                 100   100    24.36   2.19e-03   FAILURE
blis_zherk1m_lt_rr                 100   100    23.51   2.15e-03   FAILURE
blis_zherk1m_lh_rr                 100   100    24.06   2.05e-03   FAILURE
blis_zherk1m_un_rr                 100   100    24.37   1.99e-03   FAILURE
blis_zherk1m_uc_rr                 100   100    24.77   3.69e-03   FAILURE
blis_zherk1m_ut_rr                 100   100    24.81   4.01e-03   FAILURE
blis_zherk1m_uh_rr                 100   100    24.58   4.26e-03   FAILURE
blis_zherk_ln_rr                   100   100    28.84   2.22e-03   FAILURE
blis_zherk_lc_rr                   100   100    29.18   2.33e-03   FAILURE
blis_zherk_lt_rr                   100   100    28.62   3.92e-03   FAILURE
blis_zherk_lh_rr                   100   100    28.82   2.41e-03   FAILURE
blis_zherk_un_rr                   100   100    29.51   2.31e-03   FAILURE
blis_zherk_uc_rr                   100   100    29.83   2.38e-03   FAILURE
blis_zherk_ut_rr                   100   100    28.45   2.21e-03   FAILURE
blis_zherk_uh_rr                   100   100    29.50   4.53e-03   FAILURE
blis_cherk1m_ln_cc                 100   100    41.64   2.10e-03   FAILURE
blis_cherk1m_lc_cc                 100   100    42.58   2.10e-03   FAILURE
blis_cherk1m_lt_cc                 100   100    43.26   4.75e-03   FAILURE
blis_cherk1m_lh_cc                 100   100    42.42   2.30e-03   FAILURE
blis_cherk1m_un_cc                 100   100    43.03   4.39e-03   FAILURE
blis_cherk1m_uc_cc                 100   100    42.61   2.27e-03   FAILURE
blis_cherk1m_ut_cc                 100   100    43.81   2.29e-03   FAILURE
blis_cherk1m_uh_cc                 100   100    43.34   2.23e-03   FAILURE
blis_cherk_ln_cc                   100   100    48.10   2.13e-03   FAILURE
blis_cherk_lc_cc                   100   100    48.84   2.16e-03   FAILURE
blis_cherk_lt_cc                   100   100    49.45   4.07e-03   FAILURE
blis_cherk_lh_cc                   100   100    49.35   2.18e-03   FAILURE
blis_cherk_un_cc                   100   100    49.32   2.34e-03   FAILURE
blis_cherk_uc_cc                   100   100    49.94   2.48e-03   FAILURE
blis_cherk_ut_cc                   100   100    50.69   4.52e-03   FAILURE
blis_cherk_uh_cc                   100   100    51.00   1.95e-03   FAILURE
blis_zherk1m_ln_cc                 100   100    24.64   2.47e-03   FAILURE
blis_zherk1m_lc_cc                 100   100    24.77   2.34e-03   FAILURE
blis_zherk1m_lt_cc                 100   100    25.59   2.74e-03   FAILURE
blis_zherk1m_lh_cc                 100   100    25.14   2.11e-03   FAILURE
blis_zherk1m_un_cc                 100   100    23.99   4.95e-03   FAILURE
blis_zherk1m_uc_cc                 100   100    22.98   4.11e-03   FAILURE
blis_zherk1m_ut_cc                 100   100    24.50   2.36e-03   FAILURE
blis_zherk1m_uh_cc                 100   100    23.93   2.13e-03   FAILURE
blis_zherk_ln_cc                   100   100    29.40   2.33e-03   FAILURE
blis_zherk_lc_cc                   100   100    29.33   4.35e-03   FAILURE
blis_zherk_lt_cc                   100   100    29.90   1.98e-03   FAILURE
blis_zherk_lh_cc                   100   100    29.80   2.21e-03   FAILURE
blis_zherk_un_cc                   100   100    28.82   4.35e-03   FAILURE
blis_zherk_uc_cc                   100   100    28.67   2.25e-03   FAILURE
blis_zherk_ut_cc                   100   100    29.22   2.28e-03   FAILURE
blis_zherk_uh_cc                   100   100    29.14   2.26e-03   FAILURE
blis_cher2k1m_lnn_rrr              100   100    42.40   4.25e-03   FAILURE
blis_cher2k1m_lnc_rrr              100   100    43.15   2.36e-03   FAILURE
blis_cher2k1m_lnt_rrr              100   100    42.45   2.45e-03   FAILURE
blis_cher2k1m_lnh_rrr              100   100    42.71   2.43e-03   FAILURE
blis_cher2k1m_lcn_rrr              100   100    43.50   2.58e-03   FAILURE
blis_cher2k1m_lcc_rrr              100   100    44.03   2.37e-03   FAILURE
blis_cher2k1m_lct_rrr              100   100    42.94   4.94e-03   FAILURE
blis_cher2k1m_lch_rrr              100   100    43.32   2.31e-03   FAILURE
blis_cher2k1m_ltn_rrr              100   100    42.41   2.19e-03   FAILURE
blis_cher2k1m_ltc_rrr              100   100    42.68   2.23e-03   FAILURE
blis_cher2k1m_ltt_rrr              100   100    42.18   4.81e-03   FAILURE
blis_cher2k1m_lth_rrr              100   100    42.19   2.56e-03   FAILURE
blis_cher2k1m_lhn_rrr              100   100    42.82   2.50e-03   FAILURE
blis_cher2k1m_lhc_rrr              100   100    43.28   2.53e-03   FAILURE
blis_cher2k1m_lht_rrr              100   100    41.39   2.41e-03   FAILURE
blis_cher2k1m_lhh_rrr              100   100    41.90   2.45e-03   FAILURE
blis_cher2k1m_unn_rrr              100   100    41.92   2.62e-03   FAILURE
blis_cher2k1m_unc_rrr              100   100    42.49   5.02e-03   FAILURE
blis_cher2k1m_unt_rrr              100   100    41.68   4.35e-03   FAILURE
blis_cher2k1m_unh_rrr              100   100    41.71   2.60e-03   FAILURE
blis_cher2k1m_ucn_rrr              100   100    41.61   2.27e-03   FAILURE
blis_cher2k1m_ucc_rrr              100   100    43.04   2.56e-03   FAILURE
blis_cher2k1m_uct_rrr              100   100    42.04   2.40e-03   FAILURE
blis_cher2k1m_uch_rrr              100   100    42.61   2.32e-03   FAILURE
blis_cher2k1m_utn_rrr              100   100    41.62   2.34e-03   FAILURE
blis_cher2k1m_utc_rrr              100   100    42.07   2.22e-03   FAILURE
blis_cher2k1m_utt_rrr              100   100    41.35   2.38e-03   FAILURE
blis_cher2k1m_uth_rrr              100   100    41.62   2.60e-03   FAILURE
blis_cher2k1m_uhn_rrr              100   100    41.82   2.29e-03   FAILURE
blis_cher2k1m_uhc_rrr              100   100    42.54   2.35e-03   FAILURE
blis_cher2k1m_uht_rrr              100   100    41.51   2.32e-03   FAILURE
blis_cher2k1m_uhh_rrr              100   100    42.04   2.40e-03   FAILURE
blis_cher2k_lnn_rrr                100   100    51.38   2.27e-03   FAILURE
blis_cher2k_lnc_rrr                100   100    51.73   2.34e-03   FAILURE
blis_cher2k_lnt_rrr                100   100    51.26   2.24e-03   FAILURE
blis_cher2k_lnh_rrr                100   100    51.00   2.70e-03   FAILURE
blis_cher2k_lcn_rrr                100   100    51.88   2.35e-03   FAILURE
blis_cher2k_lcc_rrr                100   100    52.07   2.57e-03   FAILURE
blis_cher2k_lct_rrr                100   100    51.24   2.23e-03   FAILURE
blis_cher2k_lch_rrr                100   100    51.30   2.50e-03   FAILURE
blis_cher2k_ltn_rrr                100   100    51.45   2.59e-03   FAILURE
blis_cher2k_ltc_rrr                100   100    51.30   3.90e-03   FAILURE
blis_cher2k_ltt_rrr                100   100    50.80   4.09e-03   FAILURE
blis_cher2k_lth_rrr                100   100    50.76   2.21e-03   FAILURE
blis_cher2k_lhn_rrr                100   100    49.66   4.51e-03   FAILURE
blis_cher2k_lhc_rrr                100   100    51.23   4.08e-03   FAILURE
blis_cher2k_lht_rrr                100   100    50.80   2.23e-03   FAILURE
blis_cher2k_lhh_rrr                100   100    50.67   2.48e-03   FAILURE
blis_cher2k_unn_rrr                100   100    48.69   2.41e-03   FAILURE
blis_cher2k_unc_rrr                100   100    50.41   2.13e-03   FAILURE
blis_cher2k_unt_rrr                100   100    49.85   4.98e-03   FAILURE
blis_cher2k_unh_rrr                100   100    49.82   5.41e-03   FAILURE
blis_cher2k_ucn_rrr                100   100    50.47   4.76e-03   FAILURE
blis_cher2k_ucc_rrr                100   100    50.60   2.55e-03   FAILURE
blis_cher2k_uct_rrr                100   100    49.91   2.54e-03   FAILURE
blis_cher2k_uch_rrr                100   100    48.43   2.79e-03   FAILURE
blis_cher2k_utn_rrr                100   100    50.00   2.67e-03   FAILURE
blis_cher2k_utc_rrr                100   100    48.49   2.33e-03   FAILURE
blis_cher2k_utt_rrr                100   100    49.60   4.81e-03   FAILURE
blis_cher2k_uth_rrr                100   100    49.40   2.35e-03   FAILURE
blis_cher2k_uhn_rrr                100   100    49.82   2.20e-03   FAILURE
blis_cher2k_uhc_rrr                100   100    49.78   2.30e-03   FAILURE
blis_cher2k_uht_rrr                100   100    49.40   2.36e-03   FAILURE
blis_cher2k_uhh_rrr                100   100    47.85   2.56e-03   FAILURE
blis_zher2k1m_lnn_rrr              100   100    24.40   2.53e-03   FAILURE
blis_zher2k1m_lnc_rrr              100   100    24.70   2.52e-03   FAILURE
blis_zher2k1m_lnt_rrr              100   100    24.11   4.77e-03   FAILURE
blis_zher2k1m_lnh_rrr              100   100    24.39   4.70e-03   FAILURE
blis_zher2k1m_lcn_rrr              100   100    24.79   4.88e-03   FAILURE
blis_zher2k1m_lcc_rrr              100   100    24.99   4.16e-03   FAILURE
blis_zher2k1m_lct_rrr              100   100    24.14   5.02e-03   FAILURE
blis_zher2k1m_lch_rrr              100   100    24.22   2.37e-03   FAILURE
blis_zher2k1m_ltn_rrr              100   100    24.19   4.96e-03   FAILURE
blis_zher2k1m_ltc_rrr              100   100    24.27   2.48e-03   FAILURE
blis_zher2k1m_ltt_rrr              100   100    23.30   5.13e-03   FAILURE
blis_zher2k1m_lth_rrr              100   100    23.86   2.50e-03   FAILURE
blis_zher2k1m_lhn_rrr              100   100    24.05   2.36e-03   FAILURE
blis_zher2k1m_lhc_rrr              100   100    24.55   4.58e-03   FAILURE
blis_zher2k1m_lht_rrr              100   100    24.00   2.64e-03   FAILURE
blis_zher2k1m_lhh_rrr              100   100    24.40   2.45e-03   FAILURE
blis_zher2k1m_unn_rrr              100   100    25.54   4.71e-03   FAILURE
blis_zher2k1m_unc_rrr              100   100    25.34   4.67e-03   FAILURE
blis_zher2k1m_unt_rrr              100   100    24.97   2.33e-03   FAILURE
blis_zher2k1m_unh_rrr              100   100    25.46   2.49e-03   FAILURE
blis_zher2k1m_ucn_rrr              100   100    25.83   2.62e-03   FAILURE
blis_zher2k1m_ucc_rrr              100   100    25.86   2.33e-03   FAILURE
blis_zher2k1m_uct_rrr              100   100    25.50   2.84e-03   FAILURE
blis_zher2k1m_uch_rrr              100   100    25.01   4.73e-03   FAILURE
blis_zher2k1m_utn_rrr              100   100    25.24   4.87e-03   FAILURE
blis_zher2k1m_utc_rrr              100   100    24.99   2.34e-03   FAILURE
blis_zher2k1m_utt_rrr              100   100    24.80   2.63e-03   FAILURE
blis_zher2k1m_uth_rrr              100   100    24.86   2.71e-03   FAILURE
blis_zher2k1m_uhn_rrr              100   100    24.96   2.60e-03   FAILURE
blis_zher2k1m_uhc_rrr              100   100    25.56   2.47e-03   FAILURE
blis_zher2k1m_uht_rrr              100   100    24.79   4.35e-03   FAILURE
blis_zher2k1m_uhh_rrr              100   100    25.19   3.82e-03   FAILURE
blis_zher2k_lnn_rrr                100   100    29.31   2.10e-03   FAILURE
blis_zher2k_lnc_rrr                100   100    29.07   2.42e-03   FAILURE
blis_zher2k_lnt_rrr                100   100    29.20   2.33e-03   FAILURE
blis_zher2k_lnh_rrr                100   100    29.26   2.39e-03   FAILURE
blis_zher2k_lcn_rrr                100   100    29.57   4.76e-03   FAILURE
blis_zher2k_lcc_rrr                100   100    29.64   2.45e-03   FAILURE
blis_zher2k_lct_rrr                100   100    28.99   2.36e-03   FAILURE
blis_zher2k_lch_rrr                100   100    29.44   4.65e-03   FAILURE
blis_zher2k_ltn_rrr                100   100    29.31   2.45e-03   FAILURE
blis_zher2k_ltc_rrr                100   100    29.01   2.47e-03   FAILURE
blis_zher2k_ltt_rrr                100   100    29.14   5.12e-03   FAILURE
blis_zher2k_lth_rrr                100   100    29.08   4.53e-03   FAILURE
blis_zher2k_lhn_rrr                100   100    28.93   2.42e-03   FAILURE
blis_zher2k_lhc_rrr                100   100    29.52   2.34e-03   FAILURE
blis_zher2k_lht_rrr                100   100    29.16   2.34e-03   FAILURE
blis_zher2k_lhh_rrr                100   100    28.96   2.17e-03   FAILURE
blis_zher2k_unn_rrr                100   100    30.17   3.98e-03   FAILURE
blis_zher2k_unc_rrr                100   100    30.27   2.24e-03   FAILURE
blis_zher2k_unt_rrr                100   100    29.50   4.88e-03   FAILURE
blis_zher2k_unh_rrr                100   100    29.61   2.48e-03   FAILURE
blis_zher2k_ucn_rrr                100   100    29.79   2.30e-03   FAILURE
blis_zher2k_ucc_rrr                100   100    30.38   4.66e-03   FAILURE
blis_zher2k_uct_rrr                100   100    30.17   2.29e-03   FAILURE
blis_zher2k_uch_rrr                100   100    30.22   4.74e-03   FAILURE
blis_zher2k_utn_rrr                100   100    29.95   4.45e-03   FAILURE
blis_zher2k_utc_rrr                100   100    30.02   2.41e-03   FAILURE
blis_zher2k_utt_rrr                100   100    28.72   2.53e-03   FAILURE
blis_zher2k_uth_rrr                100   100    29.84   2.20e-03   FAILURE
blis_zher2k_uhn_rrr                100   100    30.04   2.26e-03   FAILURE
blis_zher2k_uhc_rrr                100   100    30.21   4.81e-03   FAILURE
blis_zher2k_uht_rrr                100   100    29.87   2.46e-03   FAILURE
blis_zher2k_uhh_rrr                100   100    29.99   2.49e-03   FAILURE
blis_cher2k1m_lnn_ccc              100   100    41.16   2.57e-03   FAILURE
blis_cher2k1m_lnc_ccc              100   100    41.05   2.34e-03   FAILURE
blis_cher2k1m_lnt_ccc              100   100    41.20   2.24e-03   FAILURE
blis_cher2k1m_lnh_ccc              100   100    41.95   2.45e-03   FAILURE
blis_cher2k1m_lcn_ccc              100   100    41.68   2.52e-03   FAILURE
blis_cher2k1m_lcc_ccc              100   100    41.13   2.27e-03   FAILURE
blis_cher2k1m_lct_ccc              100   100    41.08   4.84e-03   FAILURE
blis_cher2k1m_lch_ccc              100   100    40.73   5.11e-03   FAILURE
blis_cher2k1m_ltn_ccc              100   100    41.31   2.54e-03   FAILURE
blis_cher2k1m_ltc_ccc              100   100    42.10   4.63e-03   FAILURE
blis_cher2k1m_ltt_ccc              100   100    42.94   2.44e-03   FAILURE
blis_cher2k1m_lth_ccc              100   100    40.83   2.33e-03   FAILURE
blis_cher2k1m_lhn_ccc              100   100    41.99   2.60e-03   FAILURE
blis_cher2k1m_lhc_ccc              100   100    41.60   2.27e-03   FAILURE
blis_cher2k1m_lht_ccc              100   100    42.45   2.34e-03   FAILURE
blis_cher2k1m_lhh_ccc              100   100    42.17   2.51e-03   FAILURE
blis_cher2k1m_unn_ccc              100   100    42.42   2.42e-03   FAILURE
blis_cher2k1m_unc_ccc              100   100    41.98   4.63e-03   FAILURE
blis_cher2k1m_unt_ccc              100   100    43.36   2.17e-03   FAILURE
blis_cher2k1m_unh_ccc              100   100    42.64   2.23e-03   FAILURE
blis_cher2k1m_ucn_ccc              100   100    42.32   2.58e-03   FAILURE
blis_cher2k1m_ucc_ccc              100   100    41.84   2.51e-03   FAILURE
blis_cher2k1m_uct_ccc              100   100    42.65   2.46e-03   FAILURE
blis_cher2k1m_uch_ccc              100   100    42.40   2.53e-03   FAILURE
blis_cher2k1m_utn_ccc              100   100    43.22   2.45e-03   FAILURE
blis_cher2k1m_utc_ccc              100   100    42.93   2.25e-03   FAILURE
blis_cher2k1m_utt_ccc              100   100    43.82   2.60e-03   FAILURE
blis_cher2k1m_uth_ccc              100   100    42.17   2.52e-03   FAILURE
blis_cher2k1m_uhn_ccc              100   100    42.73   4.91e-03   FAILURE
blis_cher2k1m_uhc_ccc              100   100    42.56   2.28e-03   FAILURE
blis_cher2k1m_uht_ccc              100   100    43.41   4.50e-03   FAILURE
blis_cher2k1m_uhh_ccc              100   100    42.99   2.37e-03   FAILURE
blis_cher2k_lnn_ccc                100   100    47.14   4.22e-03   FAILURE
blis_cher2k_lnc_ccc                100   100    49.12   4.54e-03   FAILURE
blis_cher2k_lnt_ccc                100   100    49.83   2.73e-03   FAILURE
blis_cher2k_lnh_ccc                100   100    48.38   2.39e-03   FAILURE
blis_cher2k_lcn_ccc                100   100    49.36   2.60e-03   FAILURE
blis_cher2k_lcc_ccc                100   100    49.44   4.89e-03   FAILURE
blis_cher2k_lct_ccc                100   100    49.81   2.41e-03   FAILURE
blis_cher2k_lch_ccc                100   100    49.78   4.76e-03   FAILURE
blis_cher2k_ltn_ccc                100   100    49.81   2.37e-03   FAILURE
blis_cher2k_ltc_ccc                100   100    48.54   4.29e-03   FAILURE
blis_cher2k_ltt_ccc                100   100    50.53   4.30e-03   FAILURE
blis_cher2k_lth_ccc                100   100    48.78   2.29e-03   FAILURE
blis_cher2k_lhn_ccc                100   100    48.38   4.19e-03   FAILURE
blis_cher2k_lhc_ccc                100   100    50.07   4.21e-03   FAILURE
blis_cher2k_lht_ccc                100   100    50.51   2.40e-03   FAILURE
blis_cher2k_lhh_ccc                100   100    50.37   2.46e-03   FAILURE
blis_cher2k_unn_ccc                100   100    50.19   4.24e-03   FAILURE
blis_cher2k_unc_ccc                100   100    50.43   5.04e-03   FAILURE
blis_cher2k_unt_ccc                100   100    51.00   2.34e-03   FAILURE
blis_cher2k_unh_ccc                100   100    51.01   4.68e-03   FAILURE
blis_cher2k_ucn_ccc                100   100    50.63   2.46e-03   FAILURE
blis_cher2k_ucc_ccc                100   100    50.84   2.32e-03   FAILURE
blis_cher2k_uct_ccc                100   100    48.25   2.39e-03   FAILURE
blis_cher2k_uch_ccc                100   100    50.98   2.69e-03   FAILURE
blis_cher2k_utn_ccc                100   100    51.17   2.30e-03   FAILURE
blis_cher2k_utc_ccc                100   100    51.25   2.56e-03   FAILURE
blis_cher2k_utt_ccc                100   100    51.91   2.33e-03   FAILURE
blis_cher2k_uth_ccc                100   100    51.41   4.01e-03   FAILURE
blis_cher2k_uhn_ccc                100   100    51.06   2.37e-03   FAILURE
blis_cher2k_uhc_ccc                100   100    51.30   2.17e-03   FAILURE
blis_cher2k_uht_ccc                100   100    51.81   2.54e-03   FAILURE
blis_cher2k_uhh_ccc                100   100    51.66   2.23e-03   FAILURE
blis_zher2k1m_lnn_ccc              100   100    24.78   4.58e-03   FAILURE
blis_zher2k1m_lnc_ccc              100   100    25.01   4.57e-03   FAILURE
blis_zher2k1m_lnt_ccc              100   100    25.04   2.71e-03   FAILURE
blis_zher2k1m_lnh_ccc              100   100    24.77   2.34e-03   FAILURE
blis_zher2k1m_lcn_ccc              100   100    24.82   2.48e-03   FAILURE
blis_zher2k1m_lcc_ccc              100   100    24.34   2.32e-03   FAILURE
blis_zher2k1m_lct_ccc              100   100    25.49   2.30e-03   FAILURE
blis_zher2k1m_lch_ccc              100   100    24.55   2.61e-03   FAILURE
blis_zher2k1m_ltn_ccc              100   100    25.63   2.57e-03   FAILURE
blis_zher2k1m_ltc_ccc              100   100    25.37   2.52e-03   FAILURE
blis_zher2k1m_ltt_ccc              100   100    23.95   2.49e-03   FAILURE
blis_zher2k1m_lth_ccc              100   100    23.74   4.71e-03   FAILURE
blis_zher2k1m_lhn_ccc              100   100    22.77   2.72e-03   FAILURE
blis_zher2k1m_lhc_ccc              100   100    25.17   2.63e-03   FAILURE
blis_zher2k1m_lht_ccc              100   100    25.84   4.21e-03   FAILURE
blis_zher2k1m_lhh_ccc              100   100    25.63   4.27e-03   FAILURE
blis_zher2k1m_unn_ccc              100   100    24.14   2.33e-03   FAILURE
blis_zher2k1m_unc_ccc              100   100    23.51   4.74e-03   FAILURE
blis_zher2k1m_unt_ccc              100   100    24.32   2.34e-03   FAILURE
blis_zher2k1m_unh_ccc              100   100    24.03   4.83e-03   FAILURE
blis_zher2k1m_ucn_ccc              100   100    23.45   2.59e-03   FAILURE
blis_zher2k1m_ucc_ccc              100   100    23.88   2.38e-03   FAILURE
blis_zher2k1m_uct_ccc              100   100    24.04   2.48e-03   FAILURE
blis_zher2k1m_uch_ccc              100   100    23.89   2.48e-03   FAILURE
blis_zher2k1m_utn_ccc              100   100    24.20   4.51e-03   FAILURE
blis_zher2k1m_utc_ccc              100   100    23.94   2.40e-03   FAILURE
blis_zher2k1m_utt_ccc              100   100    24.99   2.49e-03   FAILURE
blis_zher2k1m_uth_ccc              100   100    24.77   2.35e-03   FAILURE
blis_zher2k1m_uhn_ccc              100   100    24.04   4.37e-03   FAILURE
blis_zher2k1m_uhc_ccc              100   100    23.81   2.51e-03   FAILURE
blis_zher2k1m_uht_ccc              100   100    24.41   2.39e-03   FAILURE
blis_zher2k1m_uhh_ccc              100   100    24.27   2.66e-03   FAILURE
blis_zher2k_lnn_ccc                100   100    29.72   2.37e-03   FAILURE
blis_zher2k_lnc_ccc                100   100    29.81   2.42e-03   FAILURE
blis_zher2k_lnt_ccc                100   100    30.16   4.55e-03   FAILURE
blis_zher2k_lnh_ccc                100   100    29.63   5.05e-03   FAILURE
blis_zher2k_lcn_ccc                100   100    29.78   2.36e-03   FAILURE
blis_zher2k_lcc_ccc                100   100    29.81   5.26e-03   FAILURE
blis_zher2k_lct_ccc                100   100    29.95   2.48e-03   FAILURE
blis_zher2k_lch_ccc                100   100    29.96   2.46e-03   FAILURE
blis_zher2k_ltn_ccc                100   100    30.15   4.14e-03   FAILURE
blis_zher2k_ltc_ccc                100   100    30.00   4.19e-03   FAILURE
blis_zher2k_ltt_ccc                100   100    30.34   5.18e-03   FAILURE
blis_zher2k_lth_ccc                100   100    29.86   2.65e-03   FAILURE
blis_zher2k_lhn_ccc                100   100    30.13   2.43e-03   FAILURE
blis_zher2k_lhc_ccc                100   100    29.95   2.51e-03   FAILURE
blis_zher2k_lht_ccc                100   100    30.27   2.62e-03   FAILURE
blis_zher2k_lhh_ccc                100   100    29.78   4.62e-03   FAILURE
blis_zher2k_unn_ccc                100   100    29.23   2.37e-03   FAILURE
blis_zher2k_unc_ccc                100   100    28.50   4.63e-03   FAILURE
blis_zher2k_unt_ccc                100   100    29.43   4.68e-03   FAILURE
blis_zher2k_unh_ccc                100   100    29.41   2.29e-03   FAILURE
blis_zher2k_ucn_ccc                100   100    29.20   2.21e-03   FAILURE
blis_zher2k_ucc_ccc                100   100    29.13   2.80e-03   FAILURE
blis_zher2k_uct_ccc                100   100    29.01   2.45e-03   FAILURE
blis_zher2k_uch_ccc                100   100    29.34   2.42e-03   FAILURE
blis_zher2k_utn_ccc                100   100    29.44   2.67e-03   FAILURE
blis_zher2k_utc_ccc                100   100    29.27   2.81e-03   FAILURE
blis_zher2k_utt_ccc                100   100    29.60   2.46e-03   FAILURE
blis_zher2k_uth_ccc                100   100    29.51   4.67e-03   FAILURE
blis_zher2k_uhn_ccc                100   100    29.08   2.34e-03   FAILURE
blis_zher2k_uhc_ccc                100   100    29.29   2.48e-03   FAILURE
blis_zher2k_uht_ccc                100   100    29.53   2.52e-03   FAILURE
blis_zher2k_uhh_ccc                100   100    29.62   4.70e-03   FAILURE
blis_csymm1m_llnn_rrr              100   100    51.57   1.61e-03   FAILURE
blis_csymm1m_llnc_rrr              100   100    52.59   1.88e-03   FAILURE
blis_csymm1m_llnt_rrr              100   100    54.10   1.95e-03   FAILURE
blis_csymm1m_llnh_rrr              100   100    52.09   1.84e-03   FAILURE
blis_csymm1m_llcn_rrr              100   100    54.01   1.80e-03   FAILURE
blis_csymm1m_llcc_rrr              100   100    53.52   1.79e-03   FAILURE
blis_csymm1m_llct_rrr              100   100    54.40   3.57e-03   FAILURE
blis_csymm1m_llch_rrr              100   100    53.99   1.70e-03   FAILURE
blis_csymm1m_lunn_rrr              100   100    53.63   3.80e-03   FAILURE
blis_csymm1m_lunc_rrr              100   100    53.39   1.74e-03   FAILURE
blis_csymm1m_lunt_rrr              100   100    53.75   1.71e-03   FAILURE
blis_csymm1m_lunh_rrr              100   100    53.54   1.94e-03   FAILURE
blis_csymm1m_lucn_rrr              100   100    53.73   3.56e-03   FAILURE
blis_csymm1m_lucc_rrr              100   100    53.64   3.76e-03   FAILURE
blis_csymm1m_luct_rrr              100   100    54.36   1.67e-03   FAILURE
blis_csymm1m_luch_rrr              100   100    53.96   1.81e-03   FAILURE
blis_csymm1m_rlnn_rrr              100   100    53.26   1.78e-03   FAILURE
blis_csymm1m_rlnc_rrr              100   100    52.65   1.94e-03   FAILURE
blis_csymm1m_rlnt_rrr              100   100    52.16   1.58e-03   FAILURE
blis_csymm1m_rlnh_rrr              100   100    53.76   1.59e-03   FAILURE
blis_csymm1m_rlcn_rrr              100   100    52.90   1.84e-03   FAILURE
blis_csymm1m_rlcc_rrr              100   100    53.78   3.68e-03   FAILURE
blis_csymm1m_rlct_rrr              100   100    51.56   2.15e-03   FAILURE
blis_csymm1m_rlch_rrr              100   100    53.47   2.98e-03   FAILURE
blis_csymm1m_runn_rrr              100   100    51.99   1.45e-03   FAILURE
blis_csymm1m_runc_rrr              100   100    54.22   1.91e-03   FAILURE
blis_csymm1m_runt_rrr              100   100    53.40   3.84e-03   FAILURE
blis_csymm1m_runh_rrr              100   100    53.92   1.86e-03   FAILURE
blis_csymm1m_rucn_rrr              100   100    53.30   1.91e-03   FAILURE
blis_csymm1m_rucc_rrr              100   100    53.60   1.68e-03   FAILURE
blis_csymm1m_ruct_rrr              100   100    51.82   1.60e-03   FAILURE
blis_csymm1m_ruch_rrr              100   100    53.51   1.89e-03   FAILURE
blis_csymm_llnn_rrr                100   100    62.88   3.48e-03   FAILURE
blis_csymm_llnc_rrr                100   100    63.09   1.84e-03   FAILURE
blis_csymm_llnt_rrr                100   100    61.50   3.33e-03   FAILURE
blis_csymm_llnh_rrr                100   100    63.90   2.03e-03   FAILURE
blis_csymm_llcn_rrr                100   100    64.03   1.75e-03   FAILURE
blis_csymm_llcc_rrr                100   100    63.62   1.79e-03   FAILURE
blis_csymm_llct_rrr                100   100    64.05   1.97e-03   FAILURE
blis_csymm_llch_rrr                100   100    59.85   1.97e-03   FAILURE
blis_csymm_lunn_rrr                100   100    63.79   1.70e-03   FAILURE
blis_csymm_lunc_rrr                100   100    63.30   1.63e-03   FAILURE
blis_csymm_lunt_rrr                100   100    63.96   2.06e-03   FAILURE
blis_csymm_lunh_rrr                100   100    63.84   3.65e-03   FAILURE
blis_csymm_lucn_rrr                100   100    64.13   1.85e-03   FAILURE
blis_csymm_lucc_rrr                100   100    63.85   1.68e-03   FAILURE
blis_csymm_luct_rrr                100   100    64.39   1.65e-03   FAILURE
blis_csymm_luch_rrr                100   100    64.36   3.29e-03   FAILURE
blis_csymm_rlnn_rrr                100   100    65.49   3.78e-03   FAILURE
blis_csymm_rlnc_rrr                100   100    63.41   1.79e-03   FAILURE
blis_csymm_rlnt_rrr                100   100    63.35   1.92e-03   FAILURE
blis_csymm_rlnh_rrr                100   100    64.85   3.54e-03   FAILURE
blis_csymm_rlcn_rrr                100   100    65.12   1.92e-03   FAILURE
blis_csymm_rlcc_rrr                100   100    65.29   1.90e-03   FAILURE
blis_csymm_rlct_rrr                100   100    64.96   1.79e-03   FAILURE
blis_csymm_rlch_rrr                100   100    64.25   3.43e-03   FAILURE
blis_csymm_runn_rrr                100   100    61.57   3.41e-03   FAILURE
blis_csymm_runc_rrr                100   100    63.47   1.73e-03   FAILURE
blis_csymm_runt_rrr                100   100    63.31   2.02e-03   FAILURE
blis_csymm_runh_rrr                100   100    64.76   3.12e-03   FAILURE
blis_csymm_rucn_rrr                100   100    65.43   1.71e-03   FAILURE
blis_csymm_rucc_rrr                100   100    65.52   2.02e-03   FAILURE
blis_csymm_ruct_rrr                100   100    65.29   1.65e-03   FAILURE
blis_csymm_ruch_rrr                100   100    64.55   1.88e-03   FAILURE
blis_zsymm1m_llnn_rrr              100   100    29.99   2.15e-03   FAILURE
blis_zsymm1m_llnc_rrr              100   100    29.97   3.47e-03   FAILURE
blis_zsymm1m_llnt_rrr              100   100    27.31   1.88e-03   FAILURE
blis_zsymm1m_llnh_rrr              100   100    27.86   3.63e-03   FAILURE
blis_zsymm1m_llcn_rrr              100   100    27.59   1.51e-03   FAILURE
blis_zsymm1m_llcc_rrr              100   100    27.43   1.91e-03   FAILURE
blis_zsymm1m_llct_rrr              100   100    30.93   1.82e-03   FAILURE
blis_zsymm1m_llch_rrr              100   100    30.86   1.83e-03   FAILURE
blis_zsymm1m_lunn_rrr              100   100    30.23   1.73e-03   FAILURE
blis_zsymm1m_lunc_rrr              100   100    29.21   3.97e-03   FAILURE
blis_zsymm1m_lunt_rrr              100   100    30.37   3.45e-03   FAILURE
blis_zsymm1m_lunh_rrr              100   100    30.53   3.30e-03   FAILURE
blis_zsymm1m_lucn_rrr              100   100    30.65   1.90e-03   FAILURE
blis_zsymm1m_lucc_rrr              100   100    30.07   3.22e-03   FAILURE
blis_zsymm1m_luct_rrr              100   100    30.75   3.98e-03   FAILURE
blis_zsymm1m_luch_rrr              100   100    30.89   1.66e-03   FAILURE
blis_zsymm1m_rlnn_rrr              100   100    30.60   3.53e-03   FAILURE
blis_zsymm1m_rlnc_rrr              100   100    31.01   1.86e-03   FAILURE
blis_zsymm1m_rlnt_rrr              100   100    30.10   3.75e-03   FAILURE
blis_zsymm1m_rlnh_rrr              100   100    30.73   1.75e-03   FAILURE
blis_zsymm1m_rlcn_rrr              100   100    30.63   2.09e-03   FAILURE
blis_zsymm1m_rlcc_rrr              100   100    31.13   1.63e-03   FAILURE
blis_zsymm1m_rlct_rrr              100   100    29.99   2.05e-03   FAILURE
blis_zsymm1m_rlch_rrr              100   100    30.47   3.47e-03   FAILURE
blis_zsymm1m_runn_rrr              100   100    30.67   1.82e-03   FAILURE
blis_zsymm1m_runc_rrr              100   100    31.01   2.06e-03   FAILURE
blis_zsymm1m_runt_rrr              100   100    30.42   3.23e-03   FAILURE
blis_zsymm1m_runh_rrr              100   100    30.72   1.95e-03   FAILURE
blis_zsymm1m_rucn_rrr              100   100    30.60   1.64e-03   FAILURE
blis_zsymm1m_rucc_rrr              100   100    31.02   1.89e-03   FAILURE
blis_zsymm1m_ruct_rrr              100   100    30.47   3.86e-03   FAILURE
blis_zsymm1m_ruch_rrr              100   100    30.73   3.53e-03   FAILURE
blis_zsymm_llnn_rrr                100   100    35.55   3.96e-03   FAILURE
blis_zsymm_llnc_rrr                100   100    35.64   1.87e-03   FAILURE
blis_zsymm_llnt_rrr                100   100    36.02   3.46e-03   FAILURE
blis_zsymm_llnh_rrr                100   100    35.86   1.88e-03   FAILURE
blis_zsymm_llcn_rrr                100   100    36.06   1.76e-03   FAILURE
blis_zsymm_llcc_rrr                100   100    35.84   1.89e-03   FAILURE
blis_zsymm_llct_rrr                100   100    36.07   1.59e-03   FAILURE
blis_zsymm_llch_rrr                100   100    35.88   1.71e-03   FAILURE
blis_zsymm_lunn_rrr                100   100    35.81   1.88e-03   FAILURE
blis_zsymm_lunc_rrr                100   100    35.52   1.86e-03   FAILURE
blis_zsymm_lunt_rrr                100   100    35.88   1.73e-03   FAILURE
blis_zsymm_lunh_rrr                100   100    35.92   1.67e-03   FAILURE
blis_zsymm_lucn_rrr                100   100    36.04   3.35e-03   FAILURE
blis_zsymm_lucc_rrr                100   100    35.90   1.73e-03   FAILURE
blis_zsymm_luct_rrr                100   100    36.04   3.84e-03   FAILURE
blis_zsymm_luch_rrr                100   100    35.38   3.61e-03   FAILURE
blis_zsymm_rlnn_rrr                100   100    36.08   1.82e-03   FAILURE
blis_zsymm_rlnc_rrr                100   100    36.22   3.60e-03   FAILURE
blis_zsymm_rlnt_rrr                100   100    36.14   1.70e-03   FAILURE
blis_zsymm_rlnh_rrr                100   100    36.14   1.68e-03   FAILURE
blis_zsymm_rlcn_rrr                100   100    35.93   1.79e-03   FAILURE
blis_zsymm_rlcc_rrr                100   100    36.10   1.66e-03   FAILURE
blis_zsymm_rlct_rrr                100   100    35.27   1.71e-03   FAILURE
blis_zsymm_rlch_rrr                100   100    35.80   1.86e-03   FAILURE
blis_zsymm_runn_rrr                100   100    35.38   1.85e-03   FAILURE
blis_zsymm_runc_rrr                100   100    36.25   2.00e-03   FAILURE
blis_zsymm_runt_rrr                100   100    35.99   1.92e-03   FAILURE
blis_zsymm_runh_rrr                100   100    35.36   1.66e-03   FAILURE
blis_zsymm_rucn_rrr                100   100    36.00   3.51e-03   FAILURE
blis_zsymm_rucc_rrr                100   100    36.06   3.61e-03   FAILURE
blis_zsymm_ruct_rrr                100   100    35.31   3.09e-03   FAILURE
blis_zsymm_ruch_rrr                100   100    35.78   3.35e-03   FAILURE
blis_csymm1m_llnn_ccc              100   100    52.20   3.62e-03   FAILURE
blis_csymm1m_llnc_ccc              100   100    53.90   2.01e-03   FAILURE
blis_csymm1m_llnt_ccc              100   100    50.36   1.78e-03   FAILURE
blis_csymm1m_llnh_ccc              100   100    53.72   1.96e-03   FAILURE
blis_csymm1m_llcn_ccc              100   100    53.00   2.99e-03   FAILURE
blis_csymm1m_llcc_ccc              100   100    53.64   3.52e-03   FAILURE
blis_csymm1m_llct_ccc              100   100    52.91   2.11e-03   FAILURE
blis_csymm1m_llch_ccc              100   100    53.24   1.67e-03   FAILURE
blis_csymm1m_lunn_ccc              100   100    53.53   1.83e-03   FAILURE
blis_csymm1m_lunc_ccc              100   100    54.32   1.86e-03   FAILURE
blis_csymm1m_lunt_ccc              100   100    53.67   3.22e-03   FAILURE
blis_csymm1m_lunh_ccc              100   100    50.94   1.63e-03   FAILURE
blis_csymm1m_lucn_ccc              100   100    53.34   3.68e-03   FAILURE
blis_csymm1m_lucc_ccc              100   100    53.50   1.68e-03   FAILURE
blis_csymm1m_luct_ccc              100   100    51.73   1.69e-03   FAILURE
blis_csymm1m_luch_ccc              100   100    53.27   1.70e-03   FAILURE
blis_csymm1m_rlnn_ccc              100   100    53.26   1.92e-03   FAILURE
blis_csymm1m_rlnc_ccc              100   100    53.19   3.37e-03   FAILURE
blis_csymm1m_rlnt_ccc              100   100    53.96   3.22e-03   FAILURE
blis_csymm1m_rlnh_ccc              100   100    52.35   2.06e-03   FAILURE
blis_csymm1m_rlcn_ccc              100   100    51.86   1.66e-03   FAILURE
blis_csymm1m_rlcc_ccc              100   100    53.60   2.02e-03   FAILURE
blis_csymm1m_rlct_ccc              100   100    54.21   1.89e-03   FAILURE
blis_csymm1m_rlch_ccc              100   100    54.25   3.29e-03   FAILURE
blis_csymm1m_runn_ccc              100   100    53.15   1.78e-03   FAILURE
blis_csymm1m_runc_ccc              100   100    52.01   1.75e-03   FAILURE
blis_csymm1m_runt_ccc              100   100    53.68   3.21e-03   FAILURE
blis_csymm1m_runh_ccc              100   100    53.61   3.58e-03   FAILURE
blis_csymm1m_rucn_ccc              100   100    50.97   3.64e-03   FAILURE
blis_csymm1m_rucc_ccc              100   100    53.47   1.75e-03   FAILURE
blis_csymm1m_ruct_ccc              100   100    54.49   1.61e-03   FAILURE
blis_csymm1m_ruch_ccc              100   100    54.11   1.80e-03   FAILURE
blis_csymm_llnn_ccc                100   100    64.74   3.28e-03   FAILURE
blis_csymm_llnc_ccc                100   100    65.52   3.44e-03   FAILURE
blis_csymm_llnt_ccc                100   100    65.48   1.82e-03   FAILURE
blis_csymm_llnh_ccc                100   100    64.45   3.17e-03   FAILURE
blis_csymm_llcn_ccc                100   100    60.96   1.92e-03   FAILURE
blis_csymm_llcc_ccc                100   100    65.24   1.85e-03   FAILURE
blis_csymm_llct_ccc                100   100    65.32   3.02e-03   FAILURE
blis_csymm_llch_ccc                100   100    64.47   1.85e-03   FAILURE
blis_csymm_lunn_ccc                100   100    65.29   1.83e-03   FAILURE
blis_csymm_lunc_ccc                100   100    65.51   1.59e-03   FAILURE
blis_csymm_lunt_ccc                100   100    63.16   1.87e-03   FAILURE
blis_csymm_lunh_ccc                100   100    62.20   1.66e-03   FAILURE
blis_csymm_lucn_ccc                100   100    64.98   3.20e-03   FAILURE
blis_csymm_lucc_ccc                100   100    65.06   1.83e-03   FAILURE
blis_csymm_luct_ccc                100   100    64.83   1.73e-03   FAILURE
blis_csymm_luch_ccc                100   100    64.11   1.50e-03   FAILURE
blis_csymm_rlnn_ccc                100   100    63.67   1.87e-03   FAILURE
blis_csymm_rlnc_ccc                100   100    63.61   3.49e-03   FAILURE
blis_csymm_rlnt_ccc                100   100    64.33   1.78e-03   FAILURE
blis_csymm_rlnh_ccc                100   100    64.27   1.96e-03   FAILURE
blis_csymm_rlcn_ccc                100   100    64.16   1.81e-03   FAILURE
blis_csymm_rlcc_ccc                100   100    61.48   1.77e-03   FAILURE
blis_csymm_rlct_ccc                100   100    64.60   1.74e-03   FAILURE
blis_csymm_rlch_ccc                100   100    64.24   1.97e-03   FAILURE
blis_csymm_runn_ccc                100   100    63.98   1.74e-03   FAILURE
blis_csymm_runc_ccc                100   100    61.26   3.93e-03   FAILURE
blis_csymm_runt_ccc                100   100    64.49   3.61e-03   FAILURE
blis_csymm_runh_ccc                100   100    64.22   1.84e-03   FAILURE
blis_csymm_rucn_ccc                100   100    64.26   1.92e-03   FAILURE
blis_csymm_rucc_ccc                100   100    63.44   1.70e-03   FAILURE
blis_csymm_ruct_ccc                100   100    64.50   1.73e-03   FAILURE
blis_csymm_ruch_ccc                100   100    64.41   2.10e-03   FAILURE
blis_zsymm1m_llnn_ccc              100   100    30.38   3.28e-03   FAILURE
blis_zsymm1m_llnc_ccc              100   100    30.39   3.46e-03   FAILURE
blis_zsymm1m_llnt_ccc              100   100    30.35   1.79e-03   FAILURE
blis_zsymm1m_llnh_ccc              100   100    30.79   1.62e-03   FAILURE
blis_zsymm1m_llcn_ccc              100   100    30.62   3.35e-03   FAILURE
blis_zsymm1m_llcc_ccc              100   100    30.87   1.98e-03   FAILURE
blis_zsymm1m_llct_ccc              100   100    30.40   3.88e-03   FAILURE
blis_zsymm1m_llch_ccc              100   100    30.78   1.76e-03   FAILURE
blis_zsymm1m_lunn_ccc              100   100    30.45   1.75e-03   FAILURE
blis_zsymm1m_lunc_ccc              100   100    30.63   2.04e-03   FAILURE
blis_zsymm1m_lunt_ccc              100   100    29.99   1.77e-03   FAILURE
blis_zsymm1m_lunh_ccc              100   100    29.99   1.98e-03   FAILURE
blis_zsymm1m_lucn_ccc              100   100    30.24   1.93e-03   FAILURE
blis_zsymm1m_lucc_ccc              100   100    30.89   4.17e-03   FAILURE
blis_zsymm1m_luct_ccc              100   100    30.48   3.44e-03   FAILURE
blis_zsymm1m_luch_ccc              100   100    30.77   3.46e-03   FAILURE
blis_zsymm1m_rlnn_ccc              100   100    29.74   1.76e-03   FAILURE
blis_zsymm1m_rlnc_ccc              100   100    29.66   1.98e-03   FAILURE
blis_zsymm1m_rlnt_ccc              100   100    30.43   1.83e-03   FAILURE
blis_zsymm1m_rlnh_ccc              100   100    30.54   3.27e-03   FAILURE
blis_zsymm1m_rlcn_ccc              100   100    30.16   1.83e-03   FAILURE
blis_zsymm1m_rlcc_ccc              100   100    30.13   1.93e-03   FAILURE
blis_zsymm1m_rlct_ccc              100   100    30.33   1.83e-03   FAILURE
blis_zsymm1m_rlch_ccc              100   100    30.35   3.59e-03   FAILURE
blis_zsymm1m_runn_ccc              100   100    30.37   1.81e-03   FAILURE
blis_zsymm1m_runc_ccc              100   100    29.88   1.95e-03   FAILURE
blis_zsymm1m_runt_ccc              100   100    30.45   3.47e-03   FAILURE
blis_zsymm1m_runh_ccc              100   100    29.95   1.90e-03   FAILURE
blis_zsymm1m_rucn_ccc              100   100    30.59   3.35e-03   FAILURE
blis_zsymm1m_rucc_ccc              100   100    29.69   1.72e-03   FAILURE
blis_zsymm1m_ruct_ccc              100   100    30.88   1.92e-03   FAILURE
blis_zsymm1m_ruch_ccc              100   100    30.43   1.75e-03   FAILURE
blis_zsymm_llnn_ccc                100   100    35.05   1.63e-03   FAILURE
blis_zsymm_llnc_ccc                100   100    36.01   2.08e-03   FAILURE
blis_zsymm_llnt_ccc                100   100    36.13   2.05e-03   FAILURE
blis_zsymm_llnh_ccc                100   100    35.30   3.40e-03   FAILURE
blis_zsymm_llcn_ccc                100   100    36.04   1.80e-03   FAILURE
blis_zsymm_llcc_ccc                100   100    36.11   1.67e-03   FAILURE
blis_zsymm_llct_ccc                100   100    36.00   1.90e-03   FAILURE
blis_zsymm_llch_ccc                100   100    35.33   1.78e-03   FAILURE
blis_zsymm_lunn_ccc                100   100    36.04   3.41e-03   FAILURE
blis_zsymm_lunc_ccc                100   100    36.12   3.65e-03   FAILURE
blis_zsymm_lunt_ccc                100   100    36.17   1.82e-03   FAILURE
blis_zsymm_lunh_ccc                100   100    36.04   3.61e-03   FAILURE
blis_zsymm_lucn_ccc                100   100    36.01   1.85e-03   FAILURE
blis_zsymm_lucc_ccc                100   100    35.95   1.92e-03   FAILURE
blis_zsymm_luct_ccc                100   100    35.23   2.92e-03   FAILURE
blis_zsymm_luch_ccc                100   100    35.91   1.76e-03   FAILURE
blis_zsymm_rlnn_ccc                100   100    35.83   1.88e-03   FAILURE
blis_zsymm_rlnc_ccc                100   100    35.72   1.96e-03   FAILURE
blis_zsymm_rlnt_ccc                100   100    32.72   1.83e-03   FAILURE
blis_zsymm_rlnh_ccc                100   100    35.88   3.63e-03   FAILURE
blis_zsymm_rlcn_ccc                100   100    35.86   1.81e-03   FAILURE
blis_zsymm_rlcc_ccc                100   100    35.84   1.75e-03   FAILURE
blis_zsymm_rlct_ccc                100   100    36.08   3.66e-03   FAILURE
blis_zsymm_rlch_ccc                100   100    36.06   1.87e-03   FAILURE
blis_zsymm_runn_ccc                100   100    35.13   1.70e-03   FAILURE
blis_zsymm_runc_ccc                100   100    34.48   1.63e-03   FAILURE
blis_zsymm_runt_ccc                100   100    36.01   1.96e-03   FAILURE
blis_zsymm_runh_ccc                100   100    36.02   1.78e-03   FAILURE
blis_zsymm_rucn_ccc                100   100    36.04   1.71e-03   FAILURE
blis_zsymm_rucc_ccc                100   100    35.18   3.58e-03   FAILURE
blis_zsymm_ruct_ccc                100   100    36.08   3.74e-03   FAILURE
blis_zsymm_ruch_ccc                100   100    35.34   3.06e-03   FAILURE
blis_csyrk1m_ln_rr                 100   100    38.56   2.12e-03   FAILURE
blis_csyrk1m_lc_rr                 100   100    39.75   2.46e-03   FAILURE
blis_csyrk1m_lt_rr                 100   100    39.39   4.39e-03   FAILURE
blis_csyrk1m_lh_rr                 100   100    39.31   5.43e-03   FAILURE
blis_csyrk1m_un_rr                 100   100    38.82   4.49e-03   FAILURE
blis_csyrk1m_uc_rr                 100   100    38.98   2.75e-03   FAILURE
blis_csyrk1m_ut_rr                 100   100    37.44   2.30e-03   FAILURE
blis_csyrk1m_uh_rr                 100   100    39.07   3.93e-03   FAILURE
blis_csyrk_ln_rr                   100   100    50.13   2.29e-03   FAILURE
blis_csyrk_lc_rr                   100   100    50.72   2.62e-03   FAILURE
blis_csyrk_lt_rr                   100   100    51.38   4.86e-03   FAILURE
blis_csyrk_lh_rr                   100   100    49.16   4.15e-03   FAILURE
blis_csyrk_un_rr                   100   100    49.81   2.18e-03   FAILURE
blis_csyrk_uc_rr                   100   100    49.68   2.54e-03   FAILURE
blis_csyrk_ut_rr                   100   100    50.15   2.51e-03   FAILURE
blis_csyrk_uh_rr                   100   100    48.27   4.28e-03   FAILURE
blis_zsyrk1m_ln_rr                 100   100    22.63   2.28e-03   FAILURE
blis_zsyrk1m_lc_rr                 100   100    23.55   4.64e-03   FAILURE
blis_zsyrk1m_lt_rr                 100   100    22.22   2.71e-03   FAILURE
blis_zsyrk1m_lh_rr                 100   100    23.06   2.27e-03   FAILURE
blis_zsyrk1m_un_rr                 100   100    23.73   2.77e-03   FAILURE
blis_zsyrk1m_uc_rr                 100   100    24.25   2.53e-03   FAILURE
blis_zsyrk1m_ut_rr                 100   100    22.73   2.56e-03   FAILURE
blis_zsyrk1m_uh_rr                 100   100    23.81   2.34e-03   FAILURE
blis_zsyrk_ln_rr                   100   100    29.12   2.66e-03   FAILURE
blis_zsyrk_lc_rr                   100   100    29.31   2.53e-03   FAILURE
blis_zsyrk_lt_rr                   100   100    29.09   2.61e-03   FAILURE
blis_zsyrk_lh_rr                   100   100    28.66   2.02e-03   FAILURE
blis_zsyrk_un_rr                   100   100    29.95   2.56e-03   FAILURE
blis_zsyrk_uc_rr                   100   100    28.91   2.57e-03   FAILURE
blis_zsyrk_ut_rr                   100   100    29.67   2.37e-03   FAILURE
blis_zsyrk_uh_rr                   100   100    29.49   2.67e-03   FAILURE
blis_csyrk1m_ln_cc                 100   100    38.10   2.45e-03   FAILURE
blis_csyrk1m_lc_cc                 100   100    38.83   4.06e-03   FAILURE
blis_csyrk1m_lt_cc                 100   100    38.83   2.35e-03   FAILURE
blis_csyrk1m_lh_cc                 100   100    39.53   4.57e-03   FAILURE
blis_csyrk1m_un_cc                 100   100    38.92   4.16e-03   FAILURE
blis_csyrk1m_uc_cc                 100   100    39.20   2.68e-03   FAILURE
blis_csyrk1m_ut_cc                 100   100    40.09   2.35e-03   FAILURE
blis_csyrk1m_uh_cc                 100   100    37.38   4.02e-03   FAILURE
blis_csyrk_ln_cc                   100   100    49.36   2.21e-03   FAILURE
blis_csyrk_lc_cc                   100   100    48.16   2.37e-03   FAILURE
blis_csyrk_lt_cc                   100   100    50.12   2.29e-03   FAILURE
blis_csyrk_lh_cc                   100   100    49.29   2.25e-03   FAILURE
blis_csyrk_un_cc                   100   100    50.62   2.30e-03   FAILURE
blis_csyrk_uc_cc                   100   100    47.32   2.68e-03   FAILURE
blis_csyrk_ut_cc                   100   100    51.57   2.45e-03   FAILURE
blis_csyrk_uh_cc                   100   100    51.10   4.30e-03   FAILURE
blis_zsyrk1m_ln_cc                 100   100    23.07   2.07e-03   FAILURE
blis_zsyrk1m_lc_cc                 100   100    23.08   2.35e-03   FAILURE
blis_zsyrk1m_lt_cc                 100   100    23.71   2.42e-03   FAILURE
blis_zsyrk1m_lh_cc                 100   100    24.13   4.44e-03   FAILURE
blis_zsyrk1m_un_cc                 100   100    22.56   2.39e-03   FAILURE
blis_zsyrk1m_uc_cc                 100   100    22.47   4.69e-03   FAILURE
blis_zsyrk1m_ut_cc                 100   100    23.02   2.29e-03   FAILURE
blis_zsyrk1m_uh_cc                 100   100    22.28   5.21e-03   FAILURE
blis_zsyrk_ln_cc                   100   100    29.53   2.35e-03   FAILURE
blis_zsyrk_lc_cc                   100   100    29.43   2.38e-03   FAILURE
blis_zsyrk_lt_cc                   100   100    29.93   2.35e-03   FAILURE
blis_zsyrk_lh_cc                   100   100    29.72   5.00e-03   FAILURE
blis_zsyrk_un_cc                   100   100    28.96   2.11e-03   FAILURE
blis_zsyrk_uc_cc                   100   100    28.79   2.22e-03   FAILURE
blis_zsyrk_ut_cc                   100   100    29.28   4.92e-03   FAILURE
blis_zsyrk_uh_cc                   100   100    29.24   4.62e-03   FAILURE
blis_csyr2k1m_lnn_rrr              100   100    41.49   2.27e-03   FAILURE
blis_csyr2k1m_lnc_rrr              100   100    42.15   3.98e-03   FAILURE
blis_csyr2k1m_lnt_rrr              100   100    41.57   4.49e-03   FAILURE
blis_csyr2k1m_lnh_rrr              100   100    41.54   4.47e-03   FAILURE
blis_csyr2k1m_lcn_rrr              100   100    41.93   2.54e-03   FAILURE
blis_csyr2k1m_lcc_rrr              100   100    42.10   4.31e-03   FAILURE
blis_csyr2k1m_lct_rrr              100   100    40.45   4.68e-03   FAILURE
blis_csyr2k1m_lch_rrr              100   100    41.60   2.67e-03   FAILURE
blis_csyr2k1m_ltn_rrr              100   100    41.56   2.43e-03   FAILURE
blis_csyr2k1m_ltc_rrr              100   100    41.55   4.16e-03   FAILURE
blis_csyr2k1m_ltt_rrr              100   100    41.25   2.43e-03   FAILURE
blis_csyr2k1m_lth_rrr              100   100    39.77   4.52e-03   FAILURE
blis_csyr2k1m_lhn_rrr              100   100    41.48   4.52e-03   FAILURE
blis_csyr2k1m_lhc_rrr              100   100    41.50   2.37e-03   FAILURE
blis_csyr2k1m_lht_rrr              100   100    40.30   2.56e-03   FAILURE
blis_csyr2k1m_lhh_rrr              100   100    41.09   4.68e-03   FAILURE
blis_csyr2k1m_unn_rrr              100   100    41.02   2.55e-03   FAILURE
blis_csyr2k1m_unc_rrr              100   100    41.36   4.07e-03   FAILURE
blis_csyr2k1m_unt_rrr              100   100    40.81   4.64e-03   FAILURE
blis_csyr2k1m_unh_rrr              100   100    40.81   2.49e-03   FAILURE
blis_csyr2k1m_ucn_rrr              100   100    41.41   2.61e-03   FAILURE
blis_csyr2k1m_ucc_rrr              100   100    41.36   3.89e-03   FAILURE
blis_csyr2k1m_uct_rrr              100   100    40.85   4.00e-03   FAILURE
blis_csyr2k1m_uch_rrr              100   100    40.84   3.95e-03   FAILURE
blis_csyr2k1m_utn_rrr              100   100    40.82   2.41e-03   FAILURE
blis_csyr2k1m_utc_rrr              100   100    40.77   4.39e-03   FAILURE
blis_csyr2k1m_utt_rrr              100   100    40.37   4.49e-03   FAILURE
blis_csyr2k1m_uth_rrr              100   100    40.44   2.33e-03   FAILURE
blis_csyr2k1m_uhn_rrr              100   100    40.49   2.69e-03   FAILURE
blis_csyr2k1m_uhc_rrr              100   100    40.59   2.31e-03   FAILURE
blis_csyr2k1m_uht_rrr              100   100    40.34   4.62e-03   FAILURE
blis_csyr2k1m_uhh_rrr              100   100    40.31   2.26e-03   FAILURE
blis_csyr2k_lnn_rrr                100   100    51.74   2.63e-03   FAILURE
blis_csyr2k_lnc_rrr                100   100    51.97   2.35e-03   FAILURE
blis_csyr2k_lnt_rrr                100   100    50.50   4.21e-03   FAILURE
blis_csyr2k_lnh_rrr                100   100    51.03   2.41e-03   FAILURE
blis_csyr2k_lcn_rrr                100   100    51.85   2.44e-03   FAILURE
blis_csyr2k_lcc_rrr                100   100    51.88   2.38e-03   FAILURE
blis_csyr2k_lct_rrr                100   100    51.68   2.51e-03   FAILURE
blis_csyr2k_lch_rrr                100   100    50.68   2.43e-03   FAILURE
blis_csyr2k_ltn_rrr                100   100    51.98   2.48e-03   FAILURE
blis_csyr2k_ltc_rrr                100   100    51.74   2.57e-03   FAILURE
blis_csyr2k_ltt_rrr                100   100    51.80   2.11e-03   FAILURE
blis_csyr2k_lth_rrr                100   100    50.88   2.47e-03   FAILURE
blis_csyr2k_lhn_rrr                100   100    50.98   2.20e-03   FAILURE
blis_csyr2k_lhc_rrr                100   100    50.86   2.49e-03   FAILURE
blis_csyr2k_lht_rrr                100   100    50.81   2.21e-03   FAILURE
blis_csyr2k_lhh_rrr                100   100    50.03   2.57e-03   FAILURE
blis_csyr2k_unn_rrr                100   100    50.57   2.42e-03   FAILURE
blis_csyr2k_unc_rrr                100   100    50.56   2.36e-03   FAILURE
blis_csyr2k_unt_rrr                100   100    49.23   2.51e-03   FAILURE
blis_csyr2k_unh_rrr                100   100    49.64   2.38e-03   FAILURE
blis_csyr2k_ucn_rrr                100   100    50.64   4.59e-03   FAILURE
blis_csyr2k_ucc_rrr                100   100    49.03   2.59e-03   FAILURE
blis_csyr2k_uct_rrr                100   100    50.35   4.79e-03   FAILURE
blis_csyr2k_uch_rrr                100   100    49.51   4.48e-03   FAILURE
blis_csyr2k_utn_rrr                100   100    50.69   4.21e-03   FAILURE
blis_csyr2k_utc_rrr                100   100    50.20   2.57e-03   FAILURE
blis_csyr2k_utt_rrr                100   100    49.09   2.49e-03   FAILURE
blis_csyr2k_uth_rrr                100   100    49.65   2.44e-03   FAILURE
blis_csyr2k_uhn_rrr                100   100    49.95   4.57e-03   FAILURE
blis_csyr2k_uhc_rrr                100   100    48.33   4.52e-03   FAILURE
blis_csyr2k_uht_rrr                100   100    49.74   2.68e-03   FAILURE
blis_csyr2k_uhh_rrr                100   100    48.90   2.54e-03   FAILURE
blis_zsyr2k1m_lnn_rrr              100   100    23.74   2.42e-03   FAILURE
blis_zsyr2k1m_lnc_rrr              100   100    24.17   2.65e-03   FAILURE
blis_zsyr2k1m_lnt_rrr              100   100    23.45   2.50e-03   FAILURE
blis_zsyr2k1m_lnh_rrr              100   100    23.65   2.33e-03   FAILURE
blis_zsyr2k1m_lcn_rrr              100   100    23.93   2.57e-03   FAILURE
blis_zsyr2k1m_lcc_rrr              100   100    24.47   2.47e-03   FAILURE
blis_zsyr2k1m_lct_rrr              100   100    23.39   2.19e-03   FAILURE
blis_zsyr2k1m_lch_rrr              100   100    23.71   2.37e-03   FAILURE
blis_zsyr2k1m_ltn_rrr              100   100    23.55   2.57e-03   FAILURE
blis_zsyr2k1m_ltc_rrr              100   100    23.79   2.62e-03   FAILURE
blis_zsyr2k1m_ltt_rrr              100   100    23.36   2.58e-03   FAILURE
blis_zsyr2k1m_lth_rrr              100   100    23.33   2.81e-03   FAILURE
blis_zsyr2k1m_lhn_rrr              100   100    23.52   2.29e-03   FAILURE
blis_zsyr2k1m_lhc_rrr              100   100    23.92   4.88e-03   FAILURE
blis_zsyr2k1m_lht_rrr              100   100    23.62   2.62e-03   FAILURE
blis_zsyr2k1m_lhh_rrr              100   100    23.40   2.32e-03   FAILURE
blis_zsyr2k1m_unn_rrr              100   100    24.72   5.02e-03   FAILURE
blis_zsyr2k1m_unc_rrr              100   100    24.85   2.30e-03   FAILURE
blis_zsyr2k1m_unt_rrr              100   100    23.80   4.69e-03   FAILURE
blis_zsyr2k1m_unh_rrr              100   100    24.10   2.55e-03   FAILURE
blis_zsyr2k1m_ucn_rrr              100   100    24.62   2.53e-03   FAILURE
blis_zsyr2k1m_ucc_rrr              100   100    25.31   2.43e-03   FAILURE
blis_zsyr2k1m_uct_rrr              100   100    24.51   2.63e-03   FAILURE
blis_zsyr2k1m_uch_rrr              100   100    24.98   2.28e-03   FAILURE
blis_zsyr2k1m_utn_rrr              100   100    23.71   2.72e-03   FAILURE
blis_zsyr2k1m_utc_rrr              100   100    24.47   4.01e-03   FAILURE
blis_zsyr2k1m_utt_rrr              100   100    23.42   2.47e-03   FAILURE
blis_zsyr2k1m_uth_rrr              100   100    24.10   2.54e-03   FAILURE
blis_zsyr2k1m_uhn_rrr              100   100    24.66   4.67e-03   FAILURE
blis_zsyr2k1m_uhc_rrr              100   100    24.58   4.94e-03   FAILURE
blis_zsyr2k1m_uht_rrr              100   100    24.28   2.24e-03   FAILURE
blis_zsyr2k1m_uhh_rrr              100   100    23.98   2.33e-03   FAILURE
blis_zsyr2k_lnn_rrr                100   100    29.16   2.45e-03   FAILURE
blis_zsyr2k_lnc_rrr                100   100    29.10   4.30e-03   FAILURE
blis_zsyr2k_lnt_rrr                100   100    29.50   2.41e-03   FAILURE
blis_zsyr2k_lnh_rrr                100   100    29.40   2.48e-03   FAILURE
blis_zsyr2k_lcn_rrr                100   100    29.70   2.44e-03   FAILURE
blis_zsyr2k_lcc_rrr                100   100    29.55   5.44e-03   FAILURE
blis_zsyr2k_lct_rrr                100   100    29.51   4.80e-03   FAILURE
blis_zsyr2k_lch_rrr                100   100    28.87   2.57e-03   FAILURE
blis_zsyr2k_ltn_rrr                100   100    29.57   4.36e-03   FAILURE
blis_zsyr2k_ltc_rrr                100   100    29.48   2.53e-03   FAILURE
blis_zsyr2k_ltt_rrr                100   100    29.05   2.56e-03   FAILURE
blis_zsyr2k_lth_rrr                100   100    28.89   4.68e-03   FAILURE
blis_zsyr2k_lhn_rrr                100   100    29.28   2.48e-03   FAILURE
blis_zsyr2k_lhc_rrr                100   100    29.30   2.70e-03   FAILURE
blis_zsyr2k_lht_rrr                100   100    28.79   2.31e-03   FAILURE
blis_zsyr2k_lhh_rrr                100   100    29.04   2.40e-03   FAILURE
blis_zsyr2k_unn_rrr                100   100    30.30   4.92e-03   FAILURE
blis_zsyr2k_unc_rrr                100   100    30.38   2.36e-03   FAILURE
blis_zsyr2k_unt_rrr                100   100    30.18   2.16e-03   FAILURE
blis_zsyr2k_unh_rrr                100   100    29.48   2.43e-03   FAILURE
blis_zsyr2k_ucn_rrr                100   100    30.40   2.30e-03   FAILURE
blis_zsyr2k_ucc_rrr                100   100    29.87   5.12e-03   FAILURE
blis_zsyr2k_uct_rrr                100   100    30.18   4.68e-03   FAILURE
blis_zsyr2k_uch_rrr                100   100    29.92   2.51e-03   FAILURE
blis_zsyr2k_utn_rrr                100   100    30.23   2.42e-03   FAILURE
blis_zsyr2k_utc_rrr                100   100    30.08   2.63e-03   FAILURE
blis_zsyr2k_utt_rrr                100   100    30.08   4.91e-03   FAILURE
blis_zsyr2k_uth_rrr                100   100    29.01   2.53e-03   FAILURE
blis_zsyr2k_uhn_rrr                100   100    29.59   2.21e-03   FAILURE
blis_zsyr2k_uhc_rrr                100   100    29.45   4.45e-03   FAILURE
blis_zsyr2k_uht_rrr                100   100    29.87   2.54e-03   FAILURE
blis_zsyr2k_uhh_rrr                100   100    29.74   2.42e-03   FAILURE
blis_csyr2k1m_lnn_ccc              100   100    39.75   2.49e-03   FAILURE
blis_csyr2k1m_lnc_ccc              100   100    40.30   2.55e-03   FAILURE
blis_csyr2k1m_lnt_ccc              100   100    40.89   2.57e-03   FAILURE
blis_csyr2k1m_lnh_ccc              100   100    40.85   2.30e-03   FAILURE
blis_csyr2k1m_lcn_ccc              100   100    39.27   5.22e-03   FAILURE
blis_csyr2k1m_lcc_ccc              100   100    40.29   4.40e-03   FAILURE
blis_csyr2k1m_lct_ccc              100   100    40.71   2.43e-03   FAILURE
blis_csyr2k1m_lch_ccc              100   100    40.76   2.12e-03   FAILURE
blis_csyr2k1m_ltn_ccc              100   100    40.91   2.46e-03   FAILURE
blis_csyr2k1m_ltc_ccc              100   100    39.96   2.73e-03   FAILURE
blis_csyr2k1m_ltt_ccc              100   100    41.43   2.02e-03   FAILURE
blis_csyr2k1m_lth_ccc              100   100    41.19   3.05e-03   FAILURE
blis_csyr2k1m_lhn_ccc              100   100    40.79   2.70e-03   FAILURE
blis_csyr2k1m_lhc_ccc              100   100    40.84   2.26e-03   FAILURE
blis_csyr2k1m_lht_ccc              100   100    41.27   5.04e-03   FAILURE
blis_csyr2k1m_lhh_ccc              100   100    41.23   2.58e-03   FAILURE
blis_csyr2k1m_unn_ccc              100   100    39.95   2.35e-03   FAILURE
blis_csyr2k1m_unc_ccc              100   100    40.23   4.73e-03   FAILURE
blis_csyr2k1m_unt_ccc              100   100    41.52   4.50e-03   FAILURE
blis_csyr2k1m_unh_ccc              100   100    41.49   4.84e-03   FAILURE
blis_csyr2k1m_ucn_ccc              100   100    41.10   2.36e-03   FAILURE
blis_csyr2k1m_ucc_ccc              100   100    41.08   2.56e-03   FAILURE
blis_csyr2k1m_uct_ccc              100   100    41.26   2.59e-03   FAILURE
blis_csyr2k1m_uch_ccc              100   100    40.47   2.34e-03   FAILURE
blis_csyr2k1m_utn_ccc              100   100    41.46   2.41e-03   FAILURE
blis_csyr2k1m_utc_ccc              100   100    40.60   5.04e-03   FAILURE
blis_csyr2k1m_utt_ccc              100   100    41.91   2.39e-03   FAILURE
blis_csyr2k1m_uth_ccc              100   100    42.24   2.35e-03   FAILURE
blis_csyr2k1m_uhn_ccc              100   100    41.57   2.55e-03   FAILURE
blis_csyr2k1m_uhc_ccc              100   100    41.55   2.47e-03   FAILURE
blis_csyr2k1m_uht_ccc              100   100    42.18   4.53e-03   FAILURE
blis_csyr2k1m_uhh_ccc              100   100    40.14   3.90e-03   FAILURE
blis_csyr2k_lnn_ccc                100   100    48.52   2.45e-03   FAILURE
blis_csyr2k_lnc_ccc                100   100    48.20   4.67e-03   FAILURE
blis_csyr2k_lnt_ccc                100   100    50.78   4.90e-03   FAILURE
blis_csyr2k_lnh_ccc                100   100    50.53   2.48e-03   FAILURE
blis_csyr2k_lcn_ccc                100   100    48.27   2.82e-03   FAILURE
blis_csyr2k_lcc_ccc                100   100    48.81   4.39e-03   FAILURE
blis_csyr2k_lct_ccc                100   100    48.37   2.33e-03   FAILURE
blis_csyr2k_lch_ccc                100   100    49.59   4.68e-03   FAILURE
blis_csyr2k_ltn_ccc                100   100    50.73   2.38e-03   FAILURE
blis_csyr2k_ltc_ccc                100   100    49.66   4.33e-03   FAILURE
blis_csyr2k_ltt_ccc                100   100    51.03   2.47e-03   FAILURE
blis_csyr2k_lth_ccc                100   100    50.69   4.79e-03   FAILURE
blis_csyr2k_lhn_ccc                100   100    50.41   2.16e-03   FAILURE
blis_csyr2k_lhc_ccc                100   100    49.56   2.15e-03   FAILURE
blis_csyr2k_lht_ccc                100   100    50.68   2.25e-03   FAILURE
blis_csyr2k_lhh_ccc                100   100    50.45   2.53e-03   FAILURE
blis_csyr2k_unn_ccc                100   100    51.60   2.49e-03   FAILURE
blis_csyr2k_unc_ccc                100   100    50.67   2.37e-03   FAILURE
blis_csyr2k_unt_ccc                100   100    52.05   2.02e-03   FAILURE
blis_csyr2k_unh_ccc                100   100    51.70   2.44e-03   FAILURE
blis_csyr2k_ucn_ccc                100   100    50.94   2.71e-03   FAILURE
blis_csyr2k_ucc_ccc                100   100    50.06   4.88e-03   FAILURE
blis_csyr2k_uct_ccc                100   100    50.99   2.90e-03   FAILURE
blis_csyr2k_uch_ccc                100   100    50.99   4.72e-03   FAILURE
blis_csyr2k_utn_ccc                100   100    51.98   4.45e-03   FAILURE
blis_csyr2k_utc_ccc                100   100    50.99   2.60e-03   FAILURE
blis_csyr2k_utt_ccc                100   100    52.38   2.56e-03   FAILURE
blis_csyr2k_uth_ccc                100   100    52.04   2.39e-03   FAILURE
blis_csyr2k_uhn_ccc                100   100    51.55   2.64e-03   FAILURE
blis_csyr2k_uhc_ccc                100   100    50.80   4.77e-03   FAILURE
blis_csyr2k_uht_ccc                100   100    51.81   2.81e-03   FAILURE
blis_csyr2k_uhh_ccc                100   100    51.77   2.61e-03   FAILURE
blis_zsyr2k1m_lnn_ccc              100   100    23.81   2.37e-03   FAILURE
blis_zsyr2k1m_lnc_ccc              100   100    24.21   4.73e-03   FAILURE
blis_zsyr2k1m_lnt_ccc              100   100    24.11   2.64e-03   FAILURE
blis_zsyr2k1m_lnh_ccc              100   100    24.65   5.03e-03   FAILURE
blis_zsyr2k1m_lcn_ccc              100   100    24.24   2.45e-03   FAILURE
blis_zsyr2k1m_lcc_ccc              100   100    24.57   2.37e-03   FAILURE
blis_zsyr2k1m_lct_ccc              100   100    24.64   4.82e-03   FAILURE
blis_zsyr2k1m_lch_ccc              100   100    24.47   2.42e-03   FAILURE
blis_zsyr2k1m_ltn_ccc              100   100    24.30   4.90e-03   FAILURE
blis_zsyr2k1m_ltc_ccc              100   100    24.31   2.59e-03   FAILURE
blis_zsyr2k1m_ltt_ccc              100   100    24.86   2.36e-03   FAILURE
blis_zsyr2k1m_lth_ccc              100   100    25.01   2.50e-03   FAILURE
blis_zsyr2k1m_lhn_ccc              100   100    24.31   2.71e-03   FAILURE
blis_zsyr2k1m_lhc_ccc              100   100    24.36   2.27e-03   FAILURE
blis_zsyr2k1m_lht_ccc              100   100    25.05   4.84e-03   FAILURE
blis_zsyr2k1m_lhh_ccc              100   100    24.96   2.69e-03   FAILURE
blis_zsyr2k1m_unn_ccc              100   100    23.22   2.71e-03   FAILURE
blis_zsyr2k1m_unc_ccc              100   100    23.50   2.50e-03   FAILURE
blis_zsyr2k1m_unt_ccc              100   100    23.62   2.75e-03   FAILURE
blis_zsyr2k1m_unh_ccc              100   100    23.80   2.51e-03   FAILURE
blis_zsyr2k1m_ucn_ccc              100   100    23.32   2.27e-03   FAILURE
blis_zsyr2k1m_ucc_ccc              100   100    23.79   4.19e-03   FAILURE
blis_zsyr2k1m_uct_ccc              100   100    23.80   2.35e-03   FAILURE
blis_zsyr2k1m_uch_ccc              100   100    23.99   4.34e-03   FAILURE
blis_zsyr2k1m_utn_ccc              100   100    23.30   2.47e-03   FAILURE
blis_zsyr2k1m_utc_ccc              100   100    23.80   2.26e-03   FAILURE
blis_zsyr2k1m_utt_ccc              100   100    23.94   2.63e-03   FAILURE
blis_zsyr2k1m_uth_ccc              100   100    23.91   2.77e-03   FAILURE
blis_zsyr2k1m_uhn_ccc              100   100    24.02   4.77e-03   FAILURE
blis_zsyr2k1m_uhc_ccc              100   100    23.80   4.66e-03   FAILURE
blis_zsyr2k1m_uht_ccc              100   100    24.23   2.78e-03   FAILURE
blis_zsyr2k1m_uhh_ccc              100   100    22.35   5.20e-03   FAILURE
blis_zsyr2k_lnn_ccc                100   100    29.84   2.47e-03   FAILURE
blis_zsyr2k_lnc_ccc                100   100    29.88   2.22e-03   FAILURE
blis_zsyr2k_lnt_ccc                100   100    30.26   4.64e-03   FAILURE
blis_zsyr2k_lnh_ccc                100   100    29.72   2.56e-03   FAILURE
blis_zsyr2k_lcn_ccc                100   100    29.90   2.80e-03   FAILURE
blis_zsyr2k_lcc_ccc                100   100    29.81   2.31e-03   FAILURE
blis_zsyr2k_lct_ccc                100   100    30.00   2.65e-03   FAILURE
blis_zsyr2k_lch_ccc                100   100    30.01   2.41e-03   FAILURE
blis_zsyr2k_ltn_ccc                100   100    30.31   2.14e-03   FAILURE
blis_zsyr2k_ltc_ccc                100   100    29.54   2.62e-03   FAILURE
blis_zsyr2k_ltt_ccc                100   100    29.99   2.57e-03   FAILURE
blis_zsyr2k_lth_ccc                100   100    30.34   4.73e-03   FAILURE
blis_zsyr2k_lhn_ccc                100   100    30.16   2.48e-03   FAILURE
blis_zsyr2k_lhc_ccc                100   100    29.95   2.48e-03   FAILURE
blis_zsyr2k_lht_ccc                100   100    29.85   4.50e-03   FAILURE
blis_zsyr2k_lhh_ccc                100   100    30.25   2.28e-03   FAILURE
blis_zsyr2k_unn_ccc                100   100    29.33   4.74e-03   FAILURE
blis_zsyr2k_unc_ccc                100   100    29.21   4.94e-03   FAILURE
blis_zsyr2k_unt_ccc                100   100    29.48   4.25e-03   FAILURE
blis_zsyr2k_unh_ccc                100   100    29.50   4.74e-03   FAILURE
blis_zsyr2k_ucn_ccc                100   100    28.82   2.34e-03   FAILURE
blis_zsyr2k_ucc_ccc                100   100    29.04   2.44e-03   FAILURE
blis_zsyr2k_uct_ccc                100   100    29.32   2.20e-03   FAILURE
blis_zsyr2k_uch_ccc                100   100    28.50   4.54e-03   FAILURE
blis_zsyr2k_utn_ccc                100   100    29.56   2.41e-03   FAILURE
blis_zsyr2k_utc_ccc                100   100    26.80   2.51e-03   FAILURE
blis_zsyr2k_utt_ccc                100   100    27.29   2.59e-03   FAILURE
blis_zsyr2k_uth_ccc                100   100    27.15   2.36e-03   FAILURE
blis_zsyr2k_uhn_ccc                100   100    29.48   4.47e-03   FAILURE
blis_zsyr2k_uhc_ccc                100   100    29.27   2.81e-03   FAILURE
blis_zsyr2k_uht_ccc                100   100    29.63   2.22e-03   FAILURE
blis_zsyr2k_uhh_ccc                100   100    29.56   2.07e-03   FAILURE

[jeffhammond]

The test errors with Intel 19.4 (2019.4.243) are even greater for the other configurations I tested.

icc-2019.4.243-generic.log:10396
icc-2019.4.243-haswell.log:6420
icc-2019.4.243-penryn.log:10392
icc-2019.4.243-sandybridge.log:10543

I am blacklisting Intel 19+ for now.

[jeffhammond]

Intel 18 is broken for the skx configuration for blis_[cz]trsm1m. I will add that to the blacklist.

[jrhammon@pcl-tiergarten blis-skx]$ grep FAILURE -c icc-*log
icc-2016.1.150.log:0
icc-2016.3.210.log:0
icc-2016.4.258.log:0
icc-2017.0.098.log:0
icc-2017.2.174.log:0
icc-2017.4.196.log:0
icc-2017.5.239.log:0
icc-2018.0.128.log:640
icc-2018.1.163.log:640
icc-2018.2.199.log:640
icc-2018.3.222.log:640
icc-2019.0.117.log:10560
icc-2019.2.187.log:10560
icc-2019.3.199.log:10560
icc-2019.4.243.log:10560
icc-2019.5.281.log:10560
icc-2020.0.166.log:10560

[jeffhammond]

Intel 18 is broken for the knl configuration for blis_[cz]trsm1m. I will add that to the blacklist.

icc-2016.1.150.log:0
icc-2016.3.210.log:0
icc-2016.4.258.log:0
icc-2017.0.098.log:0
icc-2017.2.174.log:0
icc-2017.4.196.log:0
icc-2017.5.239.log:0
icc-2018.0.128.log:128
icc-2018.1.163.log:128
icc-2018.2.199.log:128
icc-2018.3.222.log:128
icc-2019.0.117.log:2155
icc-2019.2.187.log:2155
icc-2019.3.199.log:2155
icc-2019.4.243.log:2155
icc-2019.5.281.log:2155
icc-2020.0.166.log:2155