You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
See the RUN statements in the dockerfile for the setup if you want to recreate outside of a container.
Run container with docker run --rm -it onnx_numpy2_pytest:3.11-main
run pytest in the container
Expected behavior
Tests pass
Actual behavior
============================================== test session starts ===============================================
platform linux -- Python 3.11.9, pytest-8.2.0, pluggy-1.5.0
rootdir: /onnx
configfile: pyproject.toml
testpaths: onnx/test, onnx/examples
plugins: nbval-0.11.0
collected 7482 items
onnx/test/basic_test.py .................................... [ 0%]
onnx/test/checker_test.py ......................................... [ 1%]
onnx/test/compose_test.py .......................... [ 1%]
onnx/test/data_propagation_test.py ..... [ 1%]
onnx/test/elu_test.py . [ 1%]
onnx/test/function_inference_test.py ... [ 1%]
onnx/test/function_test.py . [ 1%]
onnx/test/helper_test.py ................................................F.F.F.F.......................... [ 2%]
................................ [ 3%]
onnx/test/hub_test.py sssssssssss [ 3%]
onnx/test/inference_function_test.py ...... [ 3%]
onnx/test/inliner_test.py ... [ 3%]
onnx/test/model_container_refeval_test.py ... [ 3%]
onnx/test/model_container_test.py ... [ 3%]
onnx/test/model_inference_test.py ........... [ 3%]
onnx/test/numpy_helper_test.py ..................................................... [ 4%]
onnx/test/parser_test.py ...................... [ 4%]
onnx/test/printer_test.py . [ 4%]
onnx/test/reference_evaluator_ml_test.py ........................................................... [ 5%]
onnx/test/reference_evaluator_model_test.py . [ 5%]
onnx/test/reference_evaluator_test.py ..................F...FF.......s.ss....s.....................F..F... [ 6%]
..................................................s........................................ss............. [ 7%]
.F......... [ 7%]
onnx/test/relu_test.py . [ 7%]
onnx/test/schema_test.py ................................ [ 8%]
onnx/test/serialization_test.py .... [ 8%]
onnx/test/shape_inference_test.py ...............................................sssss.................... [ 9%]
.......................................................................................................... [ 10%]
.......................................................................................................... [ 12%]
...........................s..ss.ss....................................................................... [ 13%]
........................s.....................s...............s...............s.ssss....s....sss..sss..s.. [ 14%]
.......sss..sss..sss..sss..sss..sss..........................................................s...s...s...s [ 16%]
...s...................................................................................................... [ 17%]
..... [ 17%]
onnx/test/symbolic_shape_test.py .... [ 17%]
onnx/test/test_backend_reference.py .s.s.s.s.sFsFs.sss.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s [ 18%]
.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.sss.s.s.s.s.s.s.s.s [ 20%]
.s.s.s.s.s.s.s.s.s.s.s.s.s.s.sssssssssssss.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.sss.s.s.sss [ 21%]
ssssss.sssss.s.s.s.s.s.s.s.sss.s.sssssssssssssss.s.s.s.s.s.s.sssssssssssssssssssss.s.s.s.s.s.s.s.s.s.s.s.s [ 23%]
.s.s.s.sssss.s.s.s.sssssssssssssssssssss.s.s.s.s.s.s.s.s.s.s.sss.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s [ 24%]
.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s [ 25%]
.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.sFsFs.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s [ 27%]
.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.sss.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s [ 28%]
.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s [ 30%]
.s.s.s.s.s.s.s.s.s.s.s.s.s.s.sss.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s [ 31%]
.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s [ 32%]
.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.sssFsFsssFsFsFsFsFs.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s [ 34%]
.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s [ 35%]
.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s [ 37%]
.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s [ 38%]
.s.s.s.s.s.s.s.s.s.sssss.sss.sss.sss.sss.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s [ 40%]
.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s [ 41%]
.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s [ 42%]
.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s [ 44%]
ss.s.s.s.s.s.sssss.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s [ 45%]
.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s [ 47%]
.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s [ 48%]
.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.sssssssssssss.s.s.s [ 49%]
.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s [ 51%]
.s.s.s.s.sFsFsFs.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.sssssssssssssssssss.s.s.s.sssss.s.s.s.s.s.s.s.s.s.s [ 52%]
.sssssssssssss.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s [ 54%]
.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s [ 55%]
.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s [ 56%]
onnx/test/test_backend_test.py .s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s. [ 57%]
s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s. [ 58%]
s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s. [ 59%]
s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s. [ 61%]
s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s. [ 62%]
s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s. [ 64%]
s.s.s.s.s.s.s.s.s.s.s.s.s.sss.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s. [ 65%]
s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s. [ 67%]
s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s. [ 68%]
s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s. [ 69%]
s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s. [ 71%]
s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s. [ 72%]
s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s. [ 74%]
s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s. [ 75%]
s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s. [ 76%]
s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s. [ 78%]
s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s. [ 79%]
s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s. [ 81%]
s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s. [ 82%]
s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s. [ 84%]
s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s. [ 85%]
s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s. [ 86%]
s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s. [ 88%]
s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s. [ 89%]
s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s. [ 91%]
s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s. [ 92%]
s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s. [ 93%]
s.s.s.s.s.s.s.s.s.s.s.s.s.s.s.s [ 94%]
onnx/test/test_external_data.py .....s...........s............................................sss [ 95%]
onnx/test/test_with_ort.py s [ 95%]
onnx/test/tools_test.py ........ [ 95%]
onnx/test/training_tool_test.py . [ 95%]
onnx/test/utils_test.py . [ 95%]
onnx/test/version_converter/automatic_downgrade_test.py .............. [ 95%]
onnx/test/version_converter/automatic_upgrade_test.py .................................................... [ 96%]
.......................................................................................................... [ 97%]
............................................................. [ 98%]
onnx/test/version_converter_test.py ...................................................................... [ 99%]
................. [ 99%]
onnx/examples/Protobufs.ipynb .ssssssss. [ 99%]
onnx/examples/check_model.ipynb s. [ 99%]
onnx/examples/load_model.ipynb s. [ 99%]
onnx/examples/make_model.ipynb s. [ 99%]
onnx/examples/np_array_tensorproto.ipynb ..... [ 99%]
onnx/examples/save_model.ipynb . [ 99%]
onnx/examples/shape_inference.ipynb .. [100%]
==================================================== FAILURES ====================================================
__________________________ TestHelperTensorFunctions.test_make_float8e4m3fn_tensor_raw ___________________________
onnx/test/helper_test.py:588: in test_make_float8e4m3fn_tensor_raw
ynp = numpy_helper.to_array(y)
onnx/numpy_helper.py:267: in to_array
return float8e4m3_to_float32(data, dims)
onnx/numpy_helper.py:112: in float8e4m3_to_float32
res = _float8e4m3_to_float32(data, fn=fn, uz=uz)
/usr/local/lib/python3.11/site-packages/numpy/lib/_function_base_impl.py:2397: in __call__
return self._call_as_normal(*args, **kwargs)
/usr/local/lib/python3.11/site-packages/numpy/lib/_function_base_impl.py:2390: in _call_as_normal
return self._vectorize_call(func=func, args=vargs)
/usr/local/lib/python3.11/site-packages/numpy/lib/_function_base_impl.py:2475: in _vectorize_call
ufunc, otypes = self._get_ufunc_and_otypes(func=func, args=args)
/usr/local/lib/python3.11/site-packages/numpy/lib/_function_base_impl.py:2435: in _get_ufunc_and_otypes
outputs = func(*inputs)
/usr/local/lib/python3.11/site-packages/numpy/lib/_function_base_impl.py:2385: in func
return self.pyfunc(*the_args, **kwargs)
onnx/numpy_helper.py:60: in _float8e4m3_to_float32_scalar
sign = ival & 0x80
E OverflowError: Python integer 128 out of bounds for int8
_________________________ TestHelperTensorFunctions.test_make_float8e4m3fnuz_tensor_raw __________________________
onnx/test/helper_test.py:604: in test_make_float8e4m3fnuz_tensor_raw
ynp = numpy_helper.to_array(y)
onnx/numpy_helper.py:271: in to_array
return float8e4m3_to_float32(data, dims, uz=True)
onnx/numpy_helper.py:112: in float8e4m3_to_float32
res = _float8e4m3_to_float32(data, fn=fn, uz=uz)
/usr/local/lib/python3.11/site-packages/numpy/lib/_function_base_impl.py:2397: in __call__
return self._call_as_normal(*args, **kwargs)
/usr/local/lib/python3.11/site-packages/numpy/lib/_function_base_impl.py:2390: in _call_as_normal
return self._vectorize_call(func=func, args=vargs)
/usr/local/lib/python3.11/site-packages/numpy/lib/_function_base_impl.py:2475: in _vectorize_call
ufunc, otypes = self._get_ufunc_and_otypes(func=func, args=args)
/usr/local/lib/python3.11/site-packages/numpy/lib/_function_base_impl.py:2435: in _get_ufunc_and_otypes
outputs = func(*inputs)
/usr/local/lib/python3.11/site-packages/numpy/lib/_function_base_impl.py:2385: in func
return self.pyfunc(*the_args, **kwargs)
onnx/numpy_helper.py:60: in _float8e4m3_to_float32_scalar
sign = ival & 0x80
E OverflowError: Python integer 128 out of bounds for int8
___________________________ TestHelperTensorFunctions.test_make_float8e5m2_tensor_raw ____________________________
onnx/test/helper_test.py:620: in test_make_float8e5m2_tensor_raw
ynp = numpy_helper.to_array(y)
onnx/numpy_helper.py:275: in to_array
return float8e5m2_to_float32(data, dims)
onnx/numpy_helper.py:182: in float8e5m2_to_float32
res = _float8e5m2_to_float32(data, fn=fn, uz=uz)
/usr/local/lib/python3.11/site-packages/numpy/lib/_function_base_impl.py:2397: in __call__
return self._call_as_normal(*args, **kwargs)
/usr/local/lib/python3.11/site-packages/numpy/lib/_function_base_impl.py:2390: in _call_as_normal
return self._vectorize_call(func=func, args=vargs)
/usr/local/lib/python3.11/site-packages/numpy/lib/_function_base_impl.py:2475: in _vectorize_call
ufunc, otypes = self._get_ufunc_and_otypes(func=func, args=args)
/usr/local/lib/python3.11/site-packages/numpy/lib/_function_base_impl.py:2435: in _get_ufunc_and_otypes
outputs = func(*inputs)
/usr/local/lib/python3.11/site-packages/numpy/lib/_function_base_impl.py:2385: in func
return self.pyfunc(*the_args, **kwargs)
onnx/numpy_helper.py:138: in _float8e5m2_to_float32_scalar
sign = ival & 0x80
E OverflowError: Python integer 128 out of bounds for int8
_________________________ TestHelperTensorFunctions.test_make_float8e5m2fnuz_tensor_raw __________________________
onnx/test/helper_test.py:637: in test_make_float8e5m2fnuz_tensor_raw
ynp = numpy_helper.to_array(y)
onnx/numpy_helper.py:279: in to_array
return float8e5m2_to_float32(data, dims, fn=True, uz=True)
onnx/numpy_helper.py:182: in float8e5m2_to_float32
res = _float8e5m2_to_float32(data, fn=fn, uz=uz)
/usr/local/lib/python3.11/site-packages/numpy/lib/_function_base_impl.py:2397: in __call__
return self._call_as_normal(*args, **kwargs)
/usr/local/lib/python3.11/site-packages/numpy/lib/_function_base_impl.py:2390: in _call_as_normal
return self._vectorize_call(func=func, args=vargs)
/usr/local/lib/python3.11/site-packages/numpy/lib/_function_base_impl.py:2475: in _vectorize_call
ufunc, otypes = self._get_ufunc_and_otypes(func=func, args=args)
/usr/local/lib/python3.11/site-packages/numpy/lib/_function_base_impl.py:2435: in _get_ufunc_and_otypes
outputs = func(*inputs)
/usr/local/lib/python3.11/site-packages/numpy/lib/_function_base_impl.py:2385: in func
return self.pyfunc(*the_args, **kwargs)
onnx/numpy_helper.py:138: in _float8e5m2_to_float32_scalar
sign = ival & 0x80
E OverflowError: Python integer 128 out of bounds for int8
____________________________________ TestReferenceEvaluator.test_cast_float8 _____________________________________
onnx/test/reference_evaluator_test.py:3309: in test_cast_float8
assert_allclose(got[0], expected1)
/usr/local/lib/python3.11/contextlib.py:81: in inner
return func(*args, **kwds)
E AssertionError:
E Not equal to tolerance rtol=1e-07, atol=0
E
E Mismatched elements: 4 / 5 (80%)
E Max absolute difference among violations: 192.
E Max relative difference among violations: 1.
E ACTUAL: array([0., 0., 0., 0., 0.], dtype=float32)
E DESIRED: array([0.000000e+00, 1.000000e+00, 2.000000e+00, 5.078125e-02,
E 1.920000e+02], dtype=float32)
_________________________________ TestReferenceEvaluator.test_cast_int4_input_0 __________________________________
/usr/local/lib/python3.11/site-packages/parameterized/parameterized.py:620: in standalone_func
return func(*(a + p.args), **p.kwargs, **kw)
onnx/test/reference_evaluator_test.py:5681: in test_cast_int4_input
[subbyte.float32_to_4bit_unpacked(x, cast_from_np) for x in data]
onnx/test/reference_evaluator_test.py:5681: in <listcomp>
[subbyte.float32_to_4bit_unpacked(x, cast_from_np) for x in data]
onnx/subbyte.py:32: in float32_to_4bit_unpacked
return np.rint(np.clip(x, clip_low, clip_high)).astype(dtype) # type: ignore[no-any-return]
/usr/local/lib/python3.11/site-packages/numpy/_core/fromnumeric.py:2247: in clip
return _wrapfunc(a, 'clip', a_min, a_max, out=out, **kwargs)
/usr/local/lib/python3.11/site-packages/numpy/_core/fromnumeric.py:57: in _wrapfunc
return bound(*args, **kwds)
/usr/local/lib/python3.11/site-packages/numpy/_core/_methods.py:108: in _clip
return um.clip(a, min, max, out=out, **kwargs)
E OverflowError: Python integer -8 out of bounds for uint8
_________________________________ TestReferenceEvaluator.test_cast_int4_input_1 __________________________________
/usr/local/lib/python3.11/site-packages/parameterized/parameterized.py:620: in standalone_func
return func(*(a + p.args), **p.kwargs, **kw)
onnx/test/reference_evaluator_test.py:5681: in test_cast_int4_input
[subbyte.float32_to_4bit_unpacked(x, cast_from_np) for x in data]
onnx/test/reference_evaluator_test.py:5681: in <listcomp>
[subbyte.float32_to_4bit_unpacked(x, cast_from_np) for x in data]
onnx/subbyte.py:32: in float32_to_4bit_unpacked
return np.rint(np.clip(x, clip_low, clip_high)).astype(dtype) # type: ignore[no-any-return]
/usr/local/lib/python3.11/site-packages/numpy/_core/fromnumeric.py:2247: in clip
return _wrapfunc(a, 'clip', a_min, a_max, out=out, **kwargs)
/usr/local/lib/python3.11/site-packages/numpy/_core/fromnumeric.py:57: in _wrapfunc
return bound(*args, **kwds)
/usr/local/lib/python3.11/site-packages/numpy/_core/_methods.py:108: in _clip
return um.clip(a, min, max, out=out, **kwargs)
E OverflowError: Python integer -8 out of bounds for uint8
_____________________________________ TestReferenceEvaluator.test_eval_cast ______________________________________
onnx/test/reference_evaluator_test.py:1511: in test_eval_cast
assert_allclose(expected, dy)
/usr/local/lib/python3.11/contextlib.py:81: in inner
return func(*args, **kwds)
E AssertionError:
E Not equal to tolerance rtol=1e-07, atol=0
E
E Mismatched elements: 3 / 4 (75%)
E Max absolute difference among violations: 2.
E Max relative difference among violations: inf
E ACTUAL: array([[ 0., 1.],
E [-1., 2.]], dtype=float32)
E DESIRED: array([[0., 0.],
E [0., 0.]], dtype=float32)
___________________________________ TestReferenceEvaluator.test_float8_4_types ___________________________________
onnx/test/reference_evaluator_test.py:3497: in test_float8_4_types
y = ref.run(None, {"X": x})[0]
onnx/reference/reference_evaluator.py:599: in run
outputs = node.run(*inputs, **linked_attributes)
onnx/reference/op_run.py:514: in run
res = self._run(*args, **kwargs)
onnx/reference/ops/op_cast.py:142: in _run
return (cast_to(x, to, saturate),)
onnx/reference/ops/op_cast.py:67: in cast_to
el = cvt(xr[i])
onnx/numpy_helper.py:112: in float8e4m3_to_float32
res = _float8e4m3_to_float32(data, fn=fn, uz=uz)
/usr/local/lib/python3.11/site-packages/numpy/lib/_function_base_impl.py:2397: in __call__
return self._call_as_normal(*args, **kwargs)
/usr/local/lib/python3.11/site-packages/numpy/lib/_function_base_impl.py:2390: in _call_as_normal
return self._vectorize_call(func=func, args=vargs)
/usr/local/lib/python3.11/site-packages/numpy/lib/_function_base_impl.py:2475: in _vectorize_call
ufunc, otypes = self._get_ufunc_and_otypes(func=func, args=args)
/usr/local/lib/python3.11/site-packages/numpy/lib/_function_base_impl.py:2435: in _get_ufunc_and_otypes
outputs = func(*inputs)
/usr/local/lib/python3.11/site-packages/numpy/lib/_function_base_impl.py:2385: in func
return self.pyfunc(*the_args, **kwargs)
onnx/numpy_helper.py:74: in _float8e4m3_to_float32_scalar
res |= expo << 23
E OverflowError: Python integer 1006632960 out of bounds for uint8
________________________________ TestReferenceEvaluator.test_string_concat_2_cat _________________________________
/usr/local/lib/python3.11/site-packages/parameterized/parameterized.py:620: in standalone_func
return func(*(a + p.args), **p.kwargs, **kw)
onnx/test/reference_evaluator_test.py:5349: in test_string_concat
self.assertEqual(result.dtype.kind, "O")
E AssertionError: 'U' != 'O'
E - U
E + O
___________________________________ OnnxBackendNodeModelTest.test_adagrad_cpu ____________________________________
onnx/backend/test/runner/__init__.py:483: in run
self.assert_similar_outputs(
onnx/backend/test/runner/__init__.py:217: in assert_similar_outputs
np.testing.assert_equal(outputs[i].dtype, ref_outputs[i].dtype)
E AssertionError:
E Items are not equal:
E ACTUAL: dtype('float64')
E DESIRED: dtype('float32')
_______________________________ OnnxBackendNodeModelTest.test_adagrad_multiple_cpu _______________________________
onnx/backend/test/runner/__init__.py:483: in run
self.assert_similar_outputs(
onnx/backend/test/runner/__init__.py:217: in assert_similar_outputs
np.testing.assert_equal(outputs[i].dtype, ref_outputs[i].dtype)
E AssertionError:
E Items are not equal:
E ACTUAL: dtype('float64')
E DESIRED: dtype('float32')
_________________________________ OnnxBackendNodeModelTest.test_dft_inverse_cpu __________________________________
onnx/backend/test/runner/__init__.py:483: in run
self.assert_similar_outputs(
onnx/backend/test/runner/__init__.py:221: in assert_similar_outputs
np.testing.assert_allclose(
/usr/local/lib/python3.11/contextlib.py:81: in inner
return func(*args, **kwds)
E AssertionError:
E Not equal to tolerance rtol=0.001, atol=1e-07
E
E Mismatched elements: 10 / 200 (5%)
E Max absolute difference among violations: 1.9073487e-07
E Max relative difference among violations: 1.3421773e+08
E ACTUAL: array([[[[ 4.500000e+01, 0.000000e+00],
E [ 4.600000e+01, 0.000000e+00],
E [ 4.700000e+01, 0.000000e+00],...
E DESIRED: array([[[[ 4.500000e+01, 0.000000e+00],
E [ 4.600000e+01, 0.000000e+00],
E [ 4.700000e+01, 0.000000e+00],...
_____________________________ OnnxBackendNodeModelTest.test_dft_inverse_opset19_cpu ______________________________
onnx/backend/test/runner/__init__.py:483: in run
self.assert_similar_outputs(
onnx/backend/test/runner/__init__.py:221: in assert_similar_outputs
np.testing.assert_allclose(
/usr/local/lib/python3.11/contextlib.py:81: in inner
return func(*args, **kwds)
E AssertionError:
E Not equal to tolerance rtol=0.001, atol=1e-07
E
E Mismatched elements: 10 / 200 (5%)
E Max absolute difference among violations: 1.9073487e-07
E Max relative difference among violations: 1.3421773e+08
E ACTUAL: array([[[[ 4.500000e+01, 0.000000e+00],
E [ 4.600000e+01, 0.000000e+00],
E [ 4.700000e+01, 0.000000e+00],...
E DESIRED: array([[[[ 4.500000e+01, 0.000000e+00],
E [ 4.600000e+01, 0.000000e+00],
E [ 4.700000e+01, 0.000000e+00],...
______________________________ OnnxBackendNodeModelTest.test_lppool_1d_default_cpu _______________________________
onnx/backend/test/runner/__init__.py:483: in run
self.assert_similar_outputs(
onnx/backend/test/runner/__init__.py:217: in assert_similar_outputs
np.testing.assert_equal(outputs[i].dtype, ref_outputs[i].dtype)
E AssertionError:
E Items are not equal:
E ACTUAL: dtype('float64')
E DESIRED: dtype('float32')
______________________________ OnnxBackendNodeModelTest.test_lppool_2d_default_cpu _______________________________
onnx/backend/test/runner/__init__.py:483: in run
self.assert_similar_outputs(
onnx/backend/test/runner/__init__.py:217: in assert_similar_outputs
np.testing.assert_equal(outputs[i].dtype, ref_outputs[i].dtype)
E AssertionError:
E Items are not equal:
E ACTUAL: dtype('float64')
E DESIRED: dtype('float32')
________________________________ OnnxBackendNodeModelTest.test_lppool_2d_pads_cpu ________________________________
onnx/backend/test/runner/__init__.py:483: in run
self.assert_similar_outputs(
onnx/backend/test/runner/__init__.py:217: in assert_similar_outputs
np.testing.assert_equal(outputs[i].dtype, ref_outputs[i].dtype)
E AssertionError:
E Items are not equal:
E ACTUAL: dtype('float64')
E DESIRED: dtype('float32')
_____________________________ OnnxBackendNodeModelTest.test_lppool_2d_same_lower_cpu _____________________________
onnx/backend/test/runner/__init__.py:483: in run
self.assert_similar_outputs(
onnx/backend/test/runner/__init__.py:217: in assert_similar_outputs
np.testing.assert_equal(outputs[i].dtype, ref_outputs[i].dtype)
E AssertionError:
E Items are not equal:
E ACTUAL: dtype('float64')
E DESIRED: dtype('float32')
_____________________________ OnnxBackendNodeModelTest.test_lppool_2d_same_upper_cpu _____________________________
onnx/backend/test/runner/__init__.py:483: in run
self.assert_similar_outputs(
onnx/backend/test/runner/__init__.py:217: in assert_similar_outputs
np.testing.assert_equal(outputs[i].dtype, ref_outputs[i].dtype)
E AssertionError:
E Items are not equal:
E ACTUAL: dtype('float64')
E DESIRED: dtype('float32')
______________________________ OnnxBackendNodeModelTest.test_lppool_2d_strides_cpu _______________________________
onnx/backend/test/runner/__init__.py:483: in run
self.assert_similar_outputs(
onnx/backend/test/runner/__init__.py:217: in assert_similar_outputs
np.testing.assert_equal(outputs[i].dtype, ref_outputs[i].dtype)
E AssertionError:
E Items are not equal:
E ACTUAL: dtype('float64')
E DESIRED: dtype('float32')
______________________________ OnnxBackendNodeModelTest.test_lppool_3d_default_cpu _______________________________
onnx/backend/test/runner/__init__.py:483: in run
self.assert_similar_outputs(
onnx/backend/test/runner/__init__.py:217: in assert_similar_outputs
np.testing.assert_equal(outputs[i].dtype, ref_outputs[i].dtype)
E AssertionError:
E Items are not equal:
E ACTUAL: dtype('float64')
E DESIRED: dtype('float32')
__________________________ OnnxBackendNodeModelTest.test_unique_sorted_with_axis_3d_cpu __________________________
onnx/backend/test/runner/__init__.py:483: in run
self.assert_similar_outputs(
onnx/backend/test/runner/__init__.py:221: in assert_similar_outputs
np.testing.assert_allclose(
/usr/local/lib/python3.11/contextlib.py:81: in inner
return func(*args, **kwds)
E AssertionError:
E Not equal to tolerance rtol=0.001, atol=1e-07
E
E (shapes (1, 4, 1), (4,) mismatch)
E ACTUAL: array([[[1],
E [0],
E [2],
E [0]]])
E DESIRED: array([1, 0, 2, 0])
___________________________ OnnxBackendNodeModelTest.test_unique_sorted_with_axis_cpu ____________________________
onnx/backend/test/runner/__init__.py:483: in run
self.assert_similar_outputs(
onnx/backend/test/runner/__init__.py:221: in assert_similar_outputs
np.testing.assert_allclose(
/usr/local/lib/python3.11/contextlib.py:81: in inner
return func(*args, **kwds)
E AssertionError:
E Not equal to tolerance rtol=0.001, atol=1e-07
E
E (shapes (3, 1), (3,) mismatch)
E ACTUAL: array([[0],
E [0],
E [1]])
E DESIRED: array([0, 0, 1])
_______________________ OnnxBackendNodeModelTest.test_unique_sorted_with_negative_axis_cpu _______________________
onnx/backend/test/runner/__init__.py:483: in run
self.assert_similar_outputs(
onnx/backend/test/runner/__init__.py:221: in assert_similar_outputs
np.testing.assert_allclose(
/usr/local/lib/python3.11/contextlib.py:81: in inner
return func(*args, **kwds)
E AssertionError:
E Not equal to tolerance rtol=0.001, atol=1e-07
E
E (shapes (1, 3), (3,) mismatch)
E ACTUAL: array([[1, 0, 0]])
E DESIRED: array([1, 0, 0])
================================================ warnings summary ================================================
onnx/test/basic_test.py::TestIO_3_onnxtxt::test_load_model_when_input_is_bytes
/onnx/onnx/__init__.py:258: UserWarning: The onnxtxt format is experimental. Please report any errors to the ONNX GitHub repository.
return _get_serializer(format).deserialize_proto(s, ModelProto())
onnx/test/basic_test.py::TestIO_3_onnxtxt::test_save_and_load_model_when_input_has_read_function
onnx/test/basic_test.py::TestIO_3_onnxtxt::test_save_and_load_model_when_input_is_file_name
onnx/test/basic_test.py::TestIO_3_onnxtxt::test_save_and_load_model_when_input_is_pathlike
/onnx/onnx/__init__.py:212: UserWarning: The onnxtxt format is experimental. Please report any errors to the ONNX GitHub repository.
model = _get_serializer(format, f).deserialize_proto(_load_bytes(f), ModelProto())
onnx/test/numpy_helper_test.py::TestNumpyHelper::test_bfloat16_to_float32_5
/onnx/onnx/test/numpy_helper_test.py:27: RuntimeWarning: overflow encountered in cast
return np.float32(fval)
onnx/test/reference_evaluator_ml_test.py::TestReferenceEvaluatorAiOnnxMl::test_svm_classifier_linear
onnx/test/reference_evaluator_ml_test.py::TestReferenceEvaluatorAiOnnxMl::test_svm_classifier_noprob_linear
/onnx/onnx/reference/ops/aionnxml/_common_classifier.py:65: RuntimeWarning: invalid value encountered in log
log = np.log(x)
onnx/test/test_backend_reference.py: 12 warnings
onnx/test/tools_test.py: 3 warnings
/onnx/onnx/reference/ops/op_range.py:13: DeprecationWarning: Conversion of an array with ndim > 0 to a scalar is deprecated, and will error in future. Ensure you extract a single element from your array before performing this operation. (Deprecated NumPy 1.25.)
return (np.arange(starts, ends, steps).astype(starts.dtype),)
onnx/test/test_backend_reference.py::OnnxBackendNodeModelTest::test_maxpool_2d_uint8_cpu
/usr/local/lib/python3.11/site-packages/numpy/lib/_arraypad_impl.py:147: RuntimeWarning: invalid value encountered in cast
padded[left_slice] = value_pair[0]
onnx/test/test_backend_reference.py::OnnxBackendNodeModelTest::test_maxpool_2d_uint8_cpu
/usr/local/lib/python3.11/site-packages/numpy/lib/_arraypad_impl.py:151: RuntimeWarning: invalid value encountered in cast
padded[right_slice] = value_pair[1]
onnx/test/test_backend_reference.py::OnnxBackendNodeModelTest::test_reduce_log_sum_empty_set_expanded_cpu
onnx/test/test_backend_reference.py::OnnxBackendNodeModelTest::test_reduce_log_sum_exp_empty_set_expanded_cpu
/onnx/onnx/reference/ops/op_log.py:13: RuntimeWarning: divide by zero encountered in log
return (np.log(x).astype(x.dtype),)
-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html
============================================ short test summary info =============================================
FAILED onnx/test/helper_test.py::TestHelperTensorFunctions::test_make_float8e4m3fn_tensor_raw - OverflowError: Python integer 128 out of bounds for int8
FAILED onnx/test/helper_test.py::TestHelperTensorFunctions::test_make_float8e4m3fnuz_tensor_raw - OverflowError: Python integer 128 out of bounds for int8
FAILED onnx/test/helper_test.py::TestHelperTensorFunctions::test_make_float8e5m2_tensor_raw - OverflowError: Python integer 128 out of bounds for int8
FAILED onnx/test/helper_test.py::TestHelperTensorFunctions::test_make_float8e5m2fnuz_tensor_raw - OverflowError: Python integer 128 out of bounds for int8
FAILED onnx/test/reference_evaluator_test.py::TestReferenceEvaluator::test_cast_float8 - AssertionError:
FAILED onnx/test/reference_evaluator_test.py::TestReferenceEvaluator::test_cast_int4_input_0 - OverflowError: Python integer -8 out of bounds for uint8
FAILED onnx/test/reference_evaluator_test.py::TestReferenceEvaluator::test_cast_int4_input_1 - OverflowError: Python integer -8 out of bounds for uint8
FAILED onnx/test/reference_evaluator_test.py::TestReferenceEvaluator::test_eval_cast - AssertionError:
FAILED onnx/test/reference_evaluator_test.py::TestReferenceEvaluator::test_float8_4_types - OverflowError: Python integer 1006632960 out of bounds for uint8
FAILED onnx/test/reference_evaluator_test.py::TestReferenceEvaluator::test_string_concat_2_cat - AssertionError: 'U' != 'O'
FAILED onnx/test/test_backend_reference.py::OnnxBackendNodeModelTest::test_adagrad_cpu - AssertionError:
FAILED onnx/test/test_backend_reference.py::OnnxBackendNodeModelTest::test_adagrad_multiple_cpu - AssertionError:
FAILED onnx/test/test_backend_reference.py::OnnxBackendNodeModelTest::test_dft_inverse_cpu - AssertionError:
FAILED onnx/test/test_backend_reference.py::OnnxBackendNodeModelTest::test_dft_inverse_opset19_cpu - AssertionError:
FAILED onnx/test/test_backend_reference.py::OnnxBackendNodeModelTest::test_lppool_1d_default_cpu - AssertionError:
FAILED onnx/test/test_backend_reference.py::OnnxBackendNodeModelTest::test_lppool_2d_default_cpu - AssertionError:
FAILED onnx/test/test_backend_reference.py::OnnxBackendNodeModelTest::test_lppool_2d_pads_cpu - AssertionError:
FAILED onnx/test/test_backend_reference.py::OnnxBackendNodeModelTest::test_lppool_2d_same_lower_cpu - AssertionError:
FAILED onnx/test/test_backend_reference.py::OnnxBackendNodeModelTest::test_lppool_2d_same_upper_cpu - AssertionError:
FAILED onnx/test/test_backend_reference.py::OnnxBackendNodeModelTest::test_lppool_2d_strides_cpu - AssertionError:
FAILED onnx/test/test_backend_reference.py::OnnxBackendNodeModelTest::test_lppool_3d_default_cpu - AssertionError:
FAILED onnx/test/test_backend_reference.py::OnnxBackendNodeModelTest::test_unique_sorted_with_axis_3d_cpu - AssertionError:
FAILED onnx/test/test_backend_reference.py::OnnxBackendNodeModelTest::test_unique_sorted_with_axis_cpu - AssertionError:
FAILED onnx/test/test_backend_reference.py::OnnxBackendNodeModelTest::test_unique_sorted_with_negative_axis_cpu - AssertionError:
===================== 24 failed, 4429 passed, 3029 skipped, 26 warnings in 168.03s (0:02:48) =====================
The text was updated successfully, but these errors were encountered:
Bug Report
Is the issue related to model conversion?
No
Describe the bug
Numpy is working towards a 2.0 release. If the numpy 2.0.0rc2 is installed, when
pytest
is run against onnx, tests fail.System information
pip install -e .
uses if cmake isn't pre-installed)Reproduction instructions
docker build -t onnx_numpy2_pytest:3.11-main -f onnx_numpy2_pytest.txt .
main
commit and builds itdocker run --rm -it onnx_numpy2_pytest:3.11-main
pytest
in the containerExpected behavior
Tests pass
Actual behavior
The text was updated successfully, but these errors were encountered: