Moving to opset 11 is causing issues

[ttdd11]

Trying to build a model for opset 11. For version 1.5.1, I am getting an error regarding inferring shapes and dtypes. For version 1.5.6, the optimizer doesn't seem to be working and it failing because of deep_copy. Any help would be greatly appreciated.

Trace version 1.5.1:

2020-04-15 05:32:20,772 - WARNING - From C:\Users\tmp.conda\envs\tensorflow_gpu2\lib\site-packages\tf2onnx\verbose_logging.py:71: The name tf.logging.set_verbosity is deprecated. Please use tf.compat.v1.logging.set_verbosity instead.

2020-04-15 05:32:37,748 - INFO - Using tensorflow=1.14.0, onnx=1.6.0, tf2onnx=1.5.1/0c735a
2020-04-15 05:32:37,756 - INFO - Using opset <onnx, 11>
2020-04-15 05:32:42,706 - WARNING - ONNX Failed to infer shapes and dtypes for [Resize__219, type: Resize]
Traceback (most recent call last):
File "C:\Users\tmp.conda\envs\tensorflow_gpu2\lib\site-packages\tf2onnx\schemas.py", line 157, in infer_onnx_shape_dtype
inferred_model = shape_inference.infer_shapes(model_proto)
File "C:\Users\tmp.conda\envs\tensorflow_gpu2\lib\site-packages\onnx\shape_inference.py", line 35, in infer_shapes
inferred_model_str = C.infer_shapes(model_str)
RuntimeError: input 2 is out of bounds
2020-04-15 05:32:42,789 - WARNING - ONNX Failed to infer shapes and dtypes for [Resize__242, type: Resize]
Traceback (most recent call last):
File "C:\Users\tmp.conda\envs\tensorflow_gpu2\lib\site-packages\tf2onnx\schemas.py", line 157, in infer_onnx_shape_dtype
inferred_model = shape_inference.infer_shapes(model_proto)
File "C:\Users\tmp.conda\envs\tensorflow_gpu2\lib\site-packages\onnx\shape_inference.py", line 35, in infer_shapes
inferred_model_str = C.infer_shapes(model_str)
RuntimeError: input 2 is out of bounds
2020-04-15 05:32:42,810 - WARNING - ONNX Failed to infer shapes and dtypes for [Resize__247, type: Resize]
Traceback (most recent call last):
File "C:\Users\tmp.conda\envs\tensorflow_gpu2\lib\site-packages\tf2onnx\schemas.py", line 157, in infer_onnx_shape_dtype
inferred_model = shape_inference.infer_shapes(model_proto)
File "C:\Users\tmp.conda\envs\tensorflow_gpu2\lib\site-packages\onnx\shape_inference.py", line 35, in infer_shapes
inferred_model_str = C.infer_shapes(model_str)
RuntimeError: input 2 is out of bounds
2020-04-15 05:32:42,867 - WARNING - ONNX Failed to infer shapes and dtypes for [Resize__264, type: Resize]
Traceback (most recent call last):
File "C:\Users\tmp.conda\envs\tensorflow_gpu2\lib\site-packages\tf2onnx\schemas.py", line 157, in infer_onnx_shape_dtype
inferred_model = shape_inference.infer_shapes(model_proto)
File "C:\Users\tmp.conda\envs\tensorflow_gpu2\lib\site-packages\onnx\shape_inference.py", line 35, in infer_shapes
inferred_model_str = C.infer_shapes(model_str)
RuntimeError: input 2 is out of bounds
2020-04-15 05:32:42,873 - WARNING - ONNX Failed to infer shapes and dtypes for [Resize__269, type: Resize]
Traceback (most recent call last):
File "C:\Users\tmp.conda\envs\tensorflow_gpu2\lib\site-packages\tf2onnx\schemas.py", line 157, in infer_onnx_shape_dtype
inferred_model = shape_inference.infer_shapes(model_proto)
File "C:\Users\tmp.conda\envs\tensorflow_gpu2\lib\site-packages\onnx\shape_inference.py", line 35, in infer_shapes
inferred_model_str = C.infer_shapes(model_str)
RuntimeError: input 2 is out of bounds
2020-04-15 05:32:42,913 - WARNING - ONNX Failed to infer shapes and dtypes for [Resize__280, type: Resize]
Traceback (most recent call last):
File "C:\Users\tmp.conda\envs\tensorflow_gpu2\lib\site-packages\tf2onnx\schemas.py", line 157, in infer_onnx_shape_dtype
inferred_model = shape_inference.infer_shapes(model_proto)
File "C:\Users\tmp.conda\envs\tensorflow_gpu2\lib\site-packages\onnx\shape_inference.py", line 35, in infer_shapes
inferred_model_str = C.infer_shapes(model_str)
RuntimeError: input 2 is out of bounds
2020-04-15 05:32:42,924 - WARNING - ONNX Failed to infer shapes and dtypes for [Resize__285, type: Resize]
Traceback (most recent call last):
File "C:\Users\tmp.conda\envs\tensorflow_gpu2\lib\site-packages\tf2onnx\schemas.py", line 157, in infer_onnx_shape_dtype
inferred_model = shape_inference.infer_shapes(model_proto)
File "C:\Users\tmp.conda\envs\tensorflow_gpu2\lib\site-packages\onnx\shape_inference.py", line 35, in infer_shapes
inferred_model_str = C.infer_shapes(model_str)
RuntimeError: input 2 is out of bounds
2020-04-15 05:32:43,345 - INFO -
2020-04-15 05:32:44,187 - WARNING - Failed to optimize model proto
Traceback (most recent call last):
File "C:\Users\tmp.conda\envs\tensorflow_gpu2\lib\site-packages\tf2onnx\graph.py", line 1167, in optimize_model_proto
graph = GraphUtil.create_graph_from_onnx_model(onnx_model_proto)
File "C:\Users\tmp.conda\envs\tensorflow_gpu2\lib\site-packages\tf2onnx\graph.py", line 1206, in create_graph_from_onnx_model
inferred_model = shape_inference.infer_shapes(onnx_model_proto)
File "C:\Users\tmp.conda\envs\tensorflow_gpu2\lib\site-packages\onnx\shape_inference.py", line 35, in infer_shapes
inferred_model_str = C.infer_shapes(model_str)
RuntimeError: input 1 is out of bounds
2020-04-15 05:32:44,218 - INFO -
2020-04-15 05:32:44,218 - INFO - Successfully converted TensorFlow model C:/Users/tmp/net.pb to ONNX
2020-04-15 05:32:45,539 - INFO - ONNX model is saved at C:/Users/tmp/net.onnx

Trace version 1.5.6:

2020-04-15 05:33:53,665 - WARNING - From C:\Users\tmp.conda\envs\tensorflow_gpu2\lib\site-packages\tf2onnx\verbose_logging.py:72: The name tf.logging.set_verbosity is deprecated. Please use tf.compat.v1.logging.set_verbosity instead.

2020-04-15 05:34:08,464 - INFO - Using tensorflow=1.14.0, onnx=1.6.0, tf2onnx=1.5.6/80edd7
2020-04-15 05:34:08,464 - INFO - Using opset <onnx, 11>
2020-04-15 05:34:11,773 - INFO - Optimizing ONNX model
2020-04-15 05:34:11,873 - WARNING - Failed to apply optimize_transpose
Traceback (most recent call last):
File "C:\Users\tmp.conda\envs\tensorflow_gpu2\lib\site-packages\tf2onnx\optimizer_init_.py", line 50, in optimize_graph
current = copy.deepcopy(graph)
File "C:\Users\tmp.conda\envs\tensorflow_gpu2\lib\copy.py", line 180, in deepcopy
y = _reconstruct(x, memo, *rv)
File "C:\Users\tmp.conda\envs\tensorflow_gpu2\lib\copy.py", line 280, in _reconstruct
state = deepcopy(state, memo)
File "C:\Users\tmp.conda\envs\tensorflow_gpu2\lib\copy.py", line 150, in deepcopy
y = copier(x, memo)
File "C:\Users\tmp.conda\envs\tensorflow_gpu2\lib\copy.py", line 240, in _deepcopy_dict
y[deepcopy(key, memo)] = deepcopy(value, memo)
File "C:\Users\tmp.conda\envs\tensorflow_gpu2\lib\copy.py", line 150, in deepcopy
y = copier(x, memo)
File "C:\Users\tmp.conda\envs\tensorflow_gpu2\lib\copy.py", line 240, in _deepcopy_dict
y[deepcopy(key, memo)] = deepcopy(value, memo)
File "C:\Users\tmp.conda\envs\tensorflow_gpu2\lib\copy.py", line 180, in deepcopy
y = _reconstruct(x, memo, *rv)
File "C:\Users\tmp.conda\envs\tensorflow_gpu2\lib\copy.py", line 280, in _reconstruct
state = deepcopy(state, memo)
File "C:\Users\tmp.conda\envs\tensorflow_gpu2\lib\copy.py", line 150, in deepcopy
y = copier(x, memo)
File "C:\Users\tmp.conda\envs\tensorflow_gpu2\lib\copy.py", line 220, in _deepcopy_tuple
y = [deepcopy(a, memo) for a in x]
File "C:\Users\tmp.conda\envs\tensorflow_gpu2\lib\copy.py", line 220, in
y = [deepcopy(a, memo) for a in x]
File "C:\Users\tmp.conda\envs\tensorflow_gpu2\lib\copy.py", line 150, in deepcopy
y = copier(x, memo)
File "C:\Users\tmp.conda\envs\tensorflow_gpu2\lib\copy.py", line 240, in _deepcopy_dict
y[deepcopy(key, memo)] = deepcopy(value, memo)
File "C:\Users\tmp.conda\envs\tensorflow_gpu2\lib\copy.py", line 180, in deepcopy
y = _reconstruct(x, memo, *rv)
File "C:\Users\tmp.conda\envs\tensorflow_gpu2\lib\copy.py", line 280, in _reconstruct
state = deepcopy(state, memo)
File "C:\Users\tmp.conda\envs\tensorflow_gpu2\lib\copy.py", line 150, in deepcopy
y = copier(x, memo)
File "C:\Users\tmp.conda\envs\tensorflow_gpu2\lib\copy.py", line 240, in deepcopy_dict
y[deepcopy(key, memo)] = deepcopy(value, memo)
File "C:\Users\tmp.conda\envs\tensorflow_gpu2\lib\copy.py", line 159, in deepcopy
copier = getattr(x, "deepcopy", None)
ReferenceError: weakly-referenced object no longer exists
2020-04-15 05:34:12,103 - WARNING - Failed to apply fold_constants
Traceback (most recent call last):
File "C:\Users\tmp.conda\envs\tensorflow_gpu2\lib\site-packages\tf2onnx\optimizer_init.py", line 50, in optimize_graph
current = copy.deepcopy(graph)
File "C:\Users\tmp.conda\envs\tensorflow_gpu2\lib\copy.py", line 180, in deepcopy
y = _reconstruct(x, memo, *rv)
File "C:\Users\tmp.conda\envs\tensorflow_gpu2\lib\copy.py", line 280, in _reconstruct
state = deepcopy(state, memo)
File "C:\Users\tmp.conda\envs\tensorflow_gpu2\lib\copy.py", line 150, in deepcopy
y = copier(x, memo)
File "C:\Users\tmp.conda\envs\tensorflow_gpu2\lib\copy.py", line 240, in _deepcopy_dict
y[deepcopy(key, memo)] = deepcopy(value, memo)
File "C:\Users\tmp.conda\envs\tensorflow_gpu2\lib\copy.py", line 150, in deepcopy
y = copier(x, memo)
File "C:\Users\tmp.conda\envs\tensorflow_gpu2\lib\copy.py", line 240, in _deepcopy_dict
y[deepcopy(key, memo)] = deepcopy(value, memo)
File "C:\Users\tmp.conda\envs\tensorflow_gpu2\lib\copy.py", line 180, in deepcopy
y = _reconstruct(x, memo, *rv)
File "C:\Users\tmp.conda\envs\tensorflow_gpu2\lib\copy.py", line 280, in _reconstruct
state = deepcopy(state, memo)
File "C:\Users\tmp.conda\envs\tensorflow_gpu2\lib\copy.py", line 150, in deepcopy
y = copier(x, memo)
File "C:\Users\tmp.conda\envs\tensorflow_gpu2\lib\copy.py", line 220, in _deepcopy_tuple
y = [deepcopy(a, memo) for a in x]
File "C:\Users\tmp.conda\envs\tensorflow_gpu2\lib\copy.py", line 220, in
y = [deepcopy(a, memo) for a in x]
File "C:\Users\tmp.conda\envs\tensorflow_gpu2\lib\copy.py", line 150, in deepcopy
y = copier(x, memo)
File "C:\Users\tmp.conda\envs\tensorflow_gpu2\lib\copy.py", line 240, in _deepcopy_dict
y[deepcopy(key, memo)] = deepcopy(value, memo)
File "C:\Users\tmp.conda\envs\tensorflow_gpu2\lib\copy.py", line 180, in deepcopy
y = _reconstruct(x, memo, *rv)
File "C:\Users\tmp.conda\envs\tensorflow_gpu2\lib\copy.py", line 280, in _reconstruct
state = deepcopy(state, memo)
File "C:\Users\tmp.conda\envs\tensorflow_gpu2\lib\copy.py", line 150, in deepcopy
y = copier(x, memo)
File "C:\Users\tmp.conda\envs\tensorflow_gpu2\lib\copy.py", line 240, in deepcopy_dict
y[deepcopy(key, memo)] = deepcopy(value, memo)
File "C:\Users\tmp.conda\envs\tensorflow_gpu2\lib\copy.py", line 159, in deepcopy
copier = getattr(x, "deepcopy", None)
ReferenceError: weakly-referenced object no longer exists
2020-04-15 05:34:12,215 - WARNING - Failed to apply loop_optimizer
Traceback (most recent call last):
File "C:\Users\tmp.conda\envs\tensorflow_gpu2\lib\site-packages\tf2onnx\optimizer_init.py", line 50, in optimize_graph
current = copy.deepcopy(graph)
File "C:\Users\tmp.conda\envs\tensorflow_gpu2\lib\copy.py", line 180, in deepcopy
y = _reconstruct(x, memo, *rv)
File "C:\Users\tmp.conda\envs\tensorflow_gpu2\lib\copy.py", line 280, in _reconstruct
state = deepcopy(state, memo)
File "C:\Users\tmp.conda\envs\tensorflow_gpu2\lib\copy.py", line 150, in deepcopy
y = copier(x, memo)
File "C:\Users\tmp.conda\envs\tensorflow_gpu2\lib\copy.py", line 240, in _deepcopy_dict
y[deepcopy(key, memo)] = deepcopy(value, memo)
File "C:\Users\tmp.conda\envs\tensorflow_gpu2\lib\copy.py", line 150, in deepcopy
y = copier(x, memo)
File "C:\Users\tmp.conda\envs\tensorflow_gpu2\lib\copy.py", line 240, in _deepcopy_dict
y[deepcopy(key, memo)] = deepcopy(value, memo)
File "C:\Users\tmp.conda\envs\tensorflow_gpu2\lib\copy.py", line 180, in deepcopy
y = _reconstruct(x, memo, *rv)
File "C:\Users\tmp.conda\envs\tensorflow_gpu2\lib\copy.py", line 280, in _reconstruct
state = deepcopy(state, memo)
File "C:\Users\tmp.conda\envs\tensorflow_gpu2\lib\copy.py", line 150, in deepcopy
y = copier(x, memo)
File "C:\Users\tmp.conda\envs\tensorflow_gpu2\lib\copy.py", line 220, in _deepcopy_tuple
y = [deepcopy(a, memo) for a in x]
File "C:\Users\tmp.conda\envs\tensorflow_gpu2\lib\copy.py", line 220, in
y = [deepcopy(a, memo) for a in x]
File "C:\Users\tmp.conda\envs\tensorflow_gpu2\lib\copy.py", line 150, in deepcopy
y = copier(x, memo)
File "C:\Users\tmp.conda\envs\tensorflow_gpu2\lib\copy.py", line 240, in _deepcopy_dict
y[deepcopy(key, memo)] = deepcopy(value, memo)
File "C:\Users\tmp.conda\envs\tensorflow_gpu2\lib\copy.py", line 180, in deepcopy
y = _reconstruct(x, memo, *rv)
File "C:\Users\tmp.conda\envs\tensorflow_gpu2\lib\copy.py", line 280, in _reconstruct
state = deepcopy(state, memo)
File "C:\Users\tmp.conda\envs\tensorflow_gpu2\lib\copy.py", line 150, in deepcopy
y = copier(x, memo)
File "C:\Users\tmp.conda\envs\tensorflow_gpu2\lib\copy.py", line 240, in deepcopy_dict
y[deepcopy(key, memo)] = deepcopy(value, memo)
File "C:\Users\tmp.conda\envs\tensorflow_gpu2\lib\copy.py", line 159, in deepcopy
copier = getattr(x, "deepcopy", None)
ReferenceError: weakly-referenced object no longer exists
2020-04-15 05:34:12,323 - WARNING - Failed to apply merge_duplication
Traceback (most recent call last):
File "C:\Users\tmp.conda\envs\tensorflow_gpu2\lib\site-packages\tf2onnx\optimizer_init.py", line 50, in optimize_graph
current = copy.deepcopy(graph)
File "C:\Users\tmp.conda\envs\tensorflow_gpu2\lib\copy.py", line 180, in deepcopy
y = _reconstruct(x, memo, *rv)
File "C:\Users\tmp.conda\envs\tensorflow_gpu2\lib\copy.py", line 280, in _reconstruct
state = deepcopy(state, memo)
File "C:\Users\tmp.conda\envs\tensorflow_gpu2\lib\copy.py", line 150, in deepcopy
y = copier(x, memo)
File "C:\Users\tmp.conda\envs\tensorflow_gpu2\lib\copy.py", line 240, in _deepcopy_dict
y[deepcopy(key, memo)] = deepcopy(value, memo)
File "C:\Users\tmp.conda\envs\tensorflow_gpu2\lib\copy.py", line 150, in deepcopy
y = copier(x, memo)
File "C:\Users\tmp.conda\envs\tensorflow_gpu2\lib\copy.py", line 240, in _deepcopy_dict
y[deepcopy(key, memo)] = deepcopy(value, memo)
File "C:\Users\tmp.conda\envs\tensorflow_gpu2\lib\copy.py", line 180, in deepcopy
y = _reconstruct(x, memo, *rv)
File "C:\Users\tmp.conda\envs\tensorflow_gpu2\lib\copy.py", line 280, in _reconstruct
state = deepcopy(state, memo)
File "C:\Users\tmp.conda\envs\tensorflow_gpu2\lib\copy.py", line 150, in deepcopy
y = copier(x, memo)
File "C:\Users\tmp.conda\envs\tensorflow_gpu2\lib\copy.py", line 220, in _deepcopy_tuple
y = [deepcopy(a, memo) for a in x]
File "C:\Users\tmp.conda\envs\tensorflow_gpu2\lib\copy.py", line 220, in
y = [deepcopy(a, memo) for a in x]
File "C:\Users\tmp.conda\envs\tensorflow_gpu2\lib\copy.py", line 150, in deepcopy
y = copier(x, memo)
File "C:\Users\tmp.conda\envs\tensorflow_gpu2\lib\copy.py", line 240, in _deepcopy_dict
y[deepcopy(key, memo)] = deepcopy(value, memo)
File "C:\Users\tmp.conda\envs\tensorflow_gpu2\lib\copy.py", line 180, in deepcopy
y = _reconstruct(x, memo, *rv)
File "C:\Users\tmp.conda\envs\tensorflow_gpu2\lib\copy.py", line 280, in _reconstruct
state = deepcopy(state, memo)
File "C:\Users\tmp.conda\envs\tensorflow_gpu2\lib\copy.py", line 150, in deepcopy
y = copier(x, memo)
File "C:\Users\tmp.conda\envs\tensorflow_gpu2\lib\copy.py", line 240, in deepcopy_dict
y[deepcopy(key, memo)] = deepcopy(value, memo)
File "C:\Users\tmp.conda\envs\tensorflow_gpu2\lib\copy.py", line 159, in deepcopy
copier = getattr(x, "deepcopy", None)
ReferenceError: weakly-referenced object no longer exists
2020-04-15 05:34:12,540 - WARNING - Failed to apply remove_identity
Traceback (most recent call last):
File "C:\Users\tmp.conda\envs\tensorflow_gpu2\lib\site-packages\tf2onnx\optimizer_init.py", line 50, in optimize_graph
current = copy.deepcopy(graph)
File "C:\Users\tmp.conda\envs\tensorflow_gpu2\lib\copy.py", line 180, in deepcopy
y = _reconstruct(x, memo, *rv)
File "C:\Users\tmp.conda\envs\tensorflow_gpu2\lib\copy.py", line 280, in _reconstruct
state = deepcopy(state, memo)
File "C:\Users\tmp.conda\envs\tensorflow_gpu2\lib\copy.py", line 150, in deepcopy
y = copier(x, memo)
File "C:\Users\tmp.conda\envs\tensorflow_gpu2\lib\copy.py", line 240, in _deepcopy_dict
y[deepcopy(key, memo)] = deepcopy(value, memo)
File "C:\Users\tmp.conda\envs\tensorflow_gpu2\lib\copy.py", line 150, in deepcopy
y = copier(x, memo)
File "C:\Users\tmp.conda\envs\tensorflow_gpu2\lib\copy.py", line 240, in _deepcopy_dict
y[deepcopy(key, memo)] = deepcopy(value, memo)
File "C:\Users\tmp.conda\envs\tensorflow_gpu2\lib\copy.py", line 180, in deepcopy
y = _reconstruct(x, memo, *rv)
File "C:\Users\tmp.conda\envs\tensorflow_gpu2\lib\copy.py", line 280, in _reconstruct
state = deepcopy(state, memo)
File "C:\Users\tmp.conda\envs\tensorflow_gpu2\lib\copy.py", line 150, in deepcopy
y = copier(x, memo)
File "C:\Users\tmp.conda\envs\tensorflow_gpu2\lib\copy.py", line 220, in _deepcopy_tuple
y = [deepcopy(a, memo) for a in x]
File "C:\Users\tmp.conda\envs\tensorflow_gpu2\lib\copy.py", line 220, in
y = [deepcopy(a, memo) for a in x]
File "C:\Users\tmp.conda\envs\tensorflow_gpu2\lib\copy.py", line 150, in deepcopy
y = copier(x, memo)
File "C:\Users\tmp.conda\envs\tensorflow_gpu2\lib\copy.py", line 240, in _deepcopy_dict
y[deepcopy(key, memo)] = deepcopy(value, memo)
File "C:\Users\tmp.conda\envs\tensorflow_gpu2\lib\copy.py", line 180, in deepcopy
y = _reconstruct(x, memo, *rv)
File "C:\Users\tmp.conda\envs\tensorflow_gpu2\lib\copy.py", line 280, in _reconstruct
state = deepcopy(state, memo)
File "C:\Users\tmp.conda\envs\tensorflow_gpu2\lib\copy.py", line 150, in deepcopy
y = copier(x, memo)
File "C:\Users\tmp.conda\envs\tensorflow_gpu2\lib\copy.py", line 240, in deepcopy_dict
y[deepcopy(key, memo)] = deepcopy(value, memo)
File "C:\Users\tmp.conda\envs\tensorflow_gpu2\lib\copy.py", line 159, in deepcopy
copier = getattr(x, "deepcopy", None)
ReferenceError: weakly-referenced object no longer exists
2020-04-15 05:34:12,649 - WARNING - Failed to apply remove_back_to_back
Traceback (most recent call last):
File "C:\Users\tmp.conda\envs\tensorflow_gpu2\lib\site-packages\tf2onnx\optimizer_init.py", line 50, in optimize_graph
current = copy.deepcopy(graph)
File "C:\Users\tmp.conda\envs\tensorflow_gpu2\lib\copy.py", line 180, in deepcopy
y = _reconstruct(x, memo, *rv)
File "C:\Users\tmp.conda\envs\tensorflow_gpu2\lib\copy.py", line 280, in _reconstruct
state = deepcopy(state, memo)
File "C:\Users\tmp.conda\envs\tensorflow_gpu2\lib\copy.py", line 150, in deepcopy
y = copier(x, memo)
File "C:\Users\tmp.conda\envs\tensorflow_gpu2\lib\copy.py", line 240, in _deepcopy_dict
y[deepcopy(key, memo)] = deepcopy(value, memo)
File "C:\Users\tmp.conda\envs\tensorflow_gpu2\lib\copy.py", line 150, in deepcopy
y = copier(x, memo)
File "C:\Users\tmp.conda\envs\tensorflow_gpu2\lib\copy.py", line 240, in _deepcopy_dict
y[deepcopy(key, memo)] = deepcopy(value, memo)
File "C:\Users\tmp.conda\envs\tensorflow_gpu2\lib\copy.py", line 180, in deepcopy
y = _reconstruct(x, memo, *rv)
File "C:\Users\tmp.conda\envs\tensorflow_gpu2\lib\copy.py", line 280, in _reconstruct
state = deepcopy(state, memo)
File "C:\Users\tmp.conda\envs\tensorflow_gpu2\lib\copy.py", line 150, in deepcopy
y = copier(x, memo)
File "C:\Users\tmp.conda\envs\tensorflow_gpu2\lib\copy.py", line 220, in _deepcopy_tuple
y = [deepcopy(a, memo) for a in x]
File "C:\Users\tmp.conda\envs\tensorflow_gpu2\lib\copy.py", line 220, in
y = [deepcopy(a, memo) for a in x]
File "C:\Users\tmp.conda\envs\tensorflow_gpu2\lib\copy.py", line 150, in deepcopy
y = copier(x, memo)
File "C:\Users\tmp.conda\envs\tensorflow_gpu2\lib\copy.py", line 240, in _deepcopy_dict
y[deepcopy(key, memo)] = deepcopy(value, memo)
File "C:\Users\tmp.conda\envs\tensorflow_gpu2\lib\copy.py", line 180, in deepcopy
y = _reconstruct(x, memo, *rv)
File "C:\Users\tmp.conda\envs\tensorflow_gpu2\lib\copy.py", line 280, in _reconstruct
state = deepcopy(state, memo)
File "C:\Users\tmp.conda\envs\tensorflow_gpu2\lib\copy.py", line 150, in deepcopy
y = copier(x, memo)
File "C:\Users\tmp.conda\envs\tensorflow_gpu2\lib\copy.py", line 240, in _deepcopy_dict
y[deepcopy(key, memo)] = deepcopy(value, memo)
File "C:\Users\tmp.conda\envs\tensorflow_gpu2\lib\copy.py", line 159, in deepcopy
copier = getattr(x, "deepcopy", None)
ReferenceError: weakly-referenced object no longer exists
2020-04-15 05:34:12,689 - INFO - After optimization: no change
2020-04-15 05:34:12,826 - INFO -
2020-04-15 05:34:12,827 - INFO - Successfully converted TensorFlow model C:/Users/tmp/net.pb to ONNX
2020-04-15 05:34:14,159 - INFO - ONNX model is saved at C:/Users/tmp/net.onnx

[guschmue]

tf2onnx-1.5.1 did not have support for opset 11 but we are accepting the --opset 11 so we tag the model with opset 11 (lame excuse - we don't fail because it makes it easier for us when we are in the middle of adding a new opset). We'll discuss changing that to fail when the opset is not fully implemented.

If you upgrade to tf2onnx-1.5.6 (pip install tf2onnx -U) things should work.

[ttdd11]

@guschmue Did you take a look at the trace for 1.5.6? I can't seem to get for optimizer working for that version either.

[guschmue]

got it. There is another bug like this, something new that we have not been able to reproduce.
What python version is this ? Anaconda or system python ?

[ttdd11]

Anaconda I think version 3.6. What do you recommend I can try some things if that helps.

[guschmue]

I'm looking for some way of reproducing this but so far anaconda/3.6 is happy on linux on windows.

[ttdd11]

Would the model help?

…

On Wed., Apr. 15, 2020, 5:28 p.m. Guenther Schmuelling, < ***@***.***> wrote: I'm looking for some way of reproducing this but so far anaconda/3.6 is happy on linux on windows. — You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub <#886 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AJPVGLP3RRDXHQJBCG7YVULRMYRI7ANCNFSM4MIRNQYQ> .

[guschmue]

Sure, since it is failing for you I hope it would fail for me.

[ttdd11]

Do you have an email I can send this to? I probably shouldn't post the model here.

[ttdd11]

@guschmue I tried many variants of onnx, tensorflow and tf2onnx and all version are unhappy with opset 11.

I also built the master branch and tried that, same issues regardless of the tensorflow version.

[guschmue]

This deepcopy issue seems unrelated to the opset, something wrong in the optimizer. There are 2 other deepcopy issues that came in recently and they all look the same, failing in the back_to_back optimizer making me think that the identity optimizer that runs before back_to_back must have some issue. Going to review that code.
If you can share the model you can send a link to guschmue@microsoft.com.

[ttdd11]

Just sent, thanks for taking a look.

[guschmue]

So I tried your model on tf-1.14, tf-2.2, tf2onnx-1.5.6 and tf2onnx-master with python3.6 and python3.7 on both windows and linux ... all working for me.
The only thing in my env that might be different is that I only use anacoda.
Let me check with some team mates if they have ever seen the deepcopy error.

[ttdd11]

I'm not sure what you mean by I only use anaconda? That's also what I am using.

What version of anaconda are you using? I may re-install and send all my instructions. What version of cuda are you using?