Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

ERROR: Failed to parse the ONNX file. #2

Closed
duohaoxue opened this issue Jun 8, 2021 · 7 comments
Closed

ERROR: Failed to parse the ONNX file. #2

duohaoxue opened this issue Jun 8, 2021 · 7 comments

Comments

@duohaoxue
Copy link

[TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (-1, 256, -1, -1)
[TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 510 for ONNX tensor: 510
[TensorRT] VERBOSE: ModelImporter.cpp:179: [Conv] outputs: [510 -> (-1, 256, -1, -1)],
[TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: [Constant]
[TensorRT] VERBOSE: ModelImporter.cpp:125: [Constant] inputs:
[TensorRT] VERBOSE: ModelImporter.cpp:179: [Constant] outputs: [511 -> (3)],
[TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: [Reshape]
[TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 510
[TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 511
[TensorRT] VERBOSE: ModelImporter.cpp:125: [Reshape] inputs: [510 -> (-1, 256, -1, -1)], [511 -> (3)],
[TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 234) [Shuffle] for ONNX node:
[TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 512 for ONNX tensor: 512
[TensorRT] VERBOSE: ModelImporter.cpp:179: [Reshape] outputs: [512 -> (-1, 32, -1)],
[TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: [Constant]
[TensorRT] VERBOSE: ModelImporter.cpp:125: [Constant] inputs:
[TensorRT] VERBOSE: ModelImporter.cpp:179: [Constant] outputs: [513 -> (32)],
[TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: [Constant]
[TensorRT] VERBOSE: ModelImporter.cpp:125: [Constant] inputs:
[TensorRT] VERBOSE: ModelImporter.cpp:179: [Constant] outputs: [514 -> (32)],
[TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: [InstanceNormalization]
[TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 512
[TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 513
[TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 514
[TensorRT] VERBOSE: ModelImporter.cpp:125: [InstanceNormalization] inputs: [512 -> (-1, 32, -1)], [513 -> (32)], [514 -> (32)],
ERROR: Failed to parse the ONNX file.
In node -1 (importInstanceNormalization): UNSUPPORTED_NODE: Assertion failed: !isDynamic(tensorPtr->getDimensions()) && "InstanceNormalization does not support dynamic inputs!
@duohaoxue
Copy link
Author

Hello, how did you solve this problem?

@zhangjinsong3
Copy link
Owner

@duohaoxue You should add tensorrt official plugins

trt.init_libnvinfer_plugins(TRT_LOGGER, '')
I added it in common.py

@duohaoxue
Copy link
Author

import pycuda.driver as cuda
import pycuda.autoinit
import numpy as np

import tensorrt as trt
TRT_LOGGER = trt.Logger(trt.Logger.VERBOSE)
#TRT_LOGGER = trt.Logger()
trt.init_libnvinfer_plugins(TRT_LOGGER, '')

I didn't change it, and I still have this error

@zhangjinsong3
Copy link
Owner

zhangjinsong3 commented Jun 8, 2021 •
edited

did u see log bellow?

[TensorRT] VERBOSE: Registered plugin creator - ::GridAnchor_TRT version 1
[TensorRT] VERBOSE: Registered plugin creator - ::NMS_TRT version 1
[TensorRT] VERBOSE: Registered plugin creator - ::Reorg_TRT version 1
[TensorRT] VERBOSE: Registered plugin creator - ::Region_TRT version 1
[TensorRT] VERBOSE: Registered plugin creator - ::Clip_TRT version 1
[TensorRT] VERBOSE: Registered plugin creator - ::LReLU_TRT version 1
[TensorRT] VERBOSE: Registered plugin creator - ::PriorBox_TRT version 1
[TensorRT] VERBOSE: Registered plugin creator - ::Normalize_TRT version 1
[TensorRT] VERBOSE: Registered plugin creator - ::RPROI_TRT version 1
[TensorRT] VERBOSE: Registered plugin creator - ::BatchedNMS_TRT version 1
[TensorRT] VERBOSE: Registered plugin creator - ::BatchedNMSDynamic_TRT version 1
[TensorRT] VERBOSE: Registered plugin creator - ::FlattenConcat_TRT version 1
[TensorRT] VERBOSE: Registered plugin creator - ::CropAndResize version 1
[TensorRT] VERBOSE: Registered plugin creator - ::DetectionLayer_TRT version 1
[TensorRT] VERBOSE: Registered plugin creator - ::Proposal version 1
[TensorRT] VERBOSE: Registered plugin creator - ::ProposalLayer_TRT version 1
[TensorRT] VERBOSE: Registered plugin creator - ::PyramidROIAlign_TRT version 1
[TensorRT] VERBOSE: Registered plugin creator - ::ResizeNearest_TRT version 1
[TensorRT] VERBOSE: Registered plugin creator - ::Split version 1
[TensorRT] VERBOSE: Registered plugin creator - ::SpecialSlice_TRT version 1
[TensorRT] VERBOSE: Registered plugin creator - ::InstanceNormalization_TRT version 1

@duohaoxue
Copy link
Author

Finally, something went wrong

[TensorRT] VERBOSE: Registered plugin creator - ::GridAnchor_TRT version 1
[TensorRT] VERBOSE: Registered plugin creator - ::NMS_TRT version 1
[TensorRT] VERBOSE: Registered plugin creator - ::Reorg_TRT version 1
[TensorRT] VERBOSE: Registered plugin creator - ::Region_TRT version 1
[TensorRT] VERBOSE: Registered plugin creator - ::Clip_TRT version 1
[TensorRT] VERBOSE: Registered plugin creator - ::LReLU_TRT version 1
[TensorRT] VERBOSE: Registered plugin creator - ::PriorBox_TRT version 1
[TensorRT] VERBOSE: Registered plugin creator - ::Normalize_TRT version 1
[TensorRT] VERBOSE: Registered plugin creator - ::RPROI_TRT version 1
[TensorRT] VERBOSE: Registered plugin creator - ::BatchedNMS_TRT version 1
[TensorRT] VERBOSE: Registered plugin creator - ::FlattenConcat_TRT version 1
[TensorRT] VERBOSE: Registered plugin creator - ::CropAndResize version 1
[TensorRT] VERBOSE: Registered plugin creator - ::DetectionLayer_TRT version 1
[TensorRT] VERBOSE: Registered plugin creator - ::Proposal version 1
[TensorRT] VERBOSE: Registered plugin creator - ::ProposalLayer_TRT version 1
[TensorRT] VERBOSE: Registered plugin creator - ::PyramidROIAlign_TRT version 1
[TensorRT] VERBOSE: Registered plugin creator - ::ResizeNearest_TRT version 1
[TensorRT] VERBOSE: Registered plugin creator - ::Split version 1
[TensorRT] VERBOSE: Registered plugin creator - ::SpecialSlice_TRT version 1
[TensorRT] VERBOSE: Registered plugin creator - ::InstanceNormalization_TRT version 1
Load onnx model from ../weights/SOLOv2_light_R34.onnx.
===================>
[TensorRT] VERBOSE: Plugin creator already registered - ::GridAnchor_TRT version 1
[TensorRT] VERBOSE: Plugin creator already registered - ::NMS_TRT version 1
[TensorRT] VERBOSE: Plugin creator already registered - ::Reorg_TRT version 1
[TensorRT] VERBOSE: Plugin creator already registered - ::Region_TRT version 1
[TensorRT] VERBOSE: Plugin creator already registered - ::Clip_TRT version 1
[TensorRT] VERBOSE: Plugin creator already registered - ::LReLU_TRT version 1
[TensorRT] VERBOSE: Plugin creator already registered - ::PriorBox_TRT version 1
[TensorRT] VERBOSE: Plugin creator already registered - ::Normalize_TRT version 1
[TensorRT] VERBOSE: Plugin creator already registered - ::RPROI_TRT version 1
[TensorRT] VERBOSE: Plugin creator already registered - ::BatchedNMS_TRT version 1
[TensorRT] VERBOSE: Plugin creator already registered - ::FlattenConcat_TRT version 1
[TensorRT] VERBOSE: Plugin creator already registered - ::CropAndResize version 1
[TensorRT] VERBOSE: Plugin creator already registered - ::DetectionLayer_TRT version 1
[TensorRT] VERBOSE: Plugin creator already registered - ::Proposal version 1
[TensorRT] VERBOSE: Plugin creator already registered - ::ProposalLayer_TRT version 1
[TensorRT] VERBOSE: Plugin creator already registered - ::PyramidROIAlign_TRT version 1
[TensorRT] VERBOSE: Plugin creator already registered - ::ResizeNearest_TRT version 1
[TensorRT] VERBOSE: Plugin creator already registered - ::Split version 1
[TensorRT] VERBOSE: Plugin creator already registered - ::SpecialSlice_TRT version 1
[TensorRT] VERBOSE: Plugin creator already registered - ::InstanceNormalization_TRT version 1
1===================>
Loading ONNX file from path ../weights/SOLOv2_light_R34.onnx...
Beginning ONNX file parsing
[TensorRT] VERBOSE: Plugin creator already registered - ::GridAnchor_TRT version 1
[TensorRT] VERBOSE: Plugin creator already registered - ::NMS_TRT version 1
[TensorRT] VERBOSE: Plugin creator already registered - ::Reorg_TRT version 1
[TensorRT] VERBOSE: Plugin creator already registered - ::Region_TRT version 1
[TensorRT] VERBOSE: Plugin creator already registered - ::Clip_TRT version 1
[TensorRT] VERBOSE: Plugin creator already registered - ::LReLU_TRT version 1
[TensorRT] VERBOSE: Plugin creator already registered - ::PriorBox_TRT version 1
[TensorRT] VERBOSE: Plugin creator already registered - ::Normalize_TRT version 1
[TensorRT] VERBOSE: Plugin creator already registered - ::RPROI_TRT version 1
[TensorRT] VERBOSE: Plugin creator already registered - ::BatchedNMS_TRT version 1
[TensorRT] VERBOSE: Plugin creator already registered - ::FlattenConcat_TRT version 1
[TensorRT] VERBOSE: Plugin creator already registered - ::CropAndResize version 1
[TensorRT] VERBOSE: Plugin creator already registered - ::DetectionLayer_TRT version 1
[TensorRT] VERBOSE: Plugin creator already registered - ::Proposal version 1
[TensorRT] VERBOSE: Plugin creator already registered - ::ProposalLayer_TRT version 1
[TensorRT] VERBOSE: Plugin creator already registered - ::PyramidROIAlign_TRT version 1
[TensorRT] VERBOSE: Plugin creator already registered - ::ResizeNearest_TRT version 1
[TensorRT] VERBOSE: Plugin creator already registered - ::Split version 1
[TensorRT] VERBOSE: Plugin creator already registered - ::SpecialSlice_TRT version 1
[TensorRT] VERBOSE: Plugin creator already registered - ::InstanceNormalization_TRT version 1
[TensorRT] VERBOSE: ModelImporter.cpp:202: Adding network input: input with dtype: float32, dimensions: (1, 3, 448, 672)
[TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: input for ONNX tensor: input
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.bn1.bias
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.bn1.num_batches_tracked
[TensorRT] WARNING: onnx2trt_utils.cpp:220: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.bn1.running_mean
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.bn1.running_var
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.bn1.weight
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.conv1.weight
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer1.0.bn1.bias
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer1.0.bn1.num_batches_tracked
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer1.0.bn1.running_mean
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer1.0.bn1.running_var
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer1.0.bn1.weight
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer1.0.bn2.bias
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer1.0.bn2.num_batches_tracked
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer1.0.bn2.running_mean
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer1.0.bn2.running_var
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer1.0.bn2.weight
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer1.0.conv1.weight
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer1.0.conv2.weight
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer1.1.bn1.bias
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer1.1.bn1.num_batches_tracked
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer1.1.bn1.running_mean
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer1.1.bn1.running_var
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer1.1.bn1.weight
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer1.1.bn2.bias
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer1.1.bn2.num_batches_tracked
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer1.1.bn2.running_mean
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer1.1.bn2.running_var
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer1.1.bn2.weight
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer1.1.conv1.weight
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer1.1.conv2.weight
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer1.2.bn1.bias
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer1.2.bn1.num_batches_tracked
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer1.2.bn1.running_mean
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer1.2.bn1.running_var
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer1.2.bn1.weight
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer1.2.bn2.bias
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer1.2.bn2.num_batches_tracked
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer1.2.bn2.running_mean
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer1.2.bn2.running_var
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer1.2.bn2.weight
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer1.2.conv1.weight
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer1.2.conv2.weight
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer2.0.bn1.bias
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer2.0.bn1.num_batches_tracked
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer2.0.bn1.running_mean
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer2.0.bn1.running_var
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer2.0.bn1.weight
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer2.0.bn2.bias
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer2.0.bn2.num_batches_tracked
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer2.0.bn2.running_mean
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer2.0.bn2.running_var
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer2.0.bn2.weight
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer2.0.conv1.weight
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer2.0.conv2.weight
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer2.0.downsample.0.weight
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer2.0.downsample.1.bias
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer2.0.downsample.1.num_batches_tracked
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer2.0.downsample.1.running_mean
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer2.0.downsample.1.running_var
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer2.0.downsample.1.weight
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer2.1.bn1.bias
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer2.1.bn1.num_batches_tracked
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer2.1.bn1.running_mean
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer2.1.bn1.running_var
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer2.1.bn1.weight
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer2.1.bn2.bias
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer2.1.bn2.num_batches_tracked
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer2.1.bn2.running_mean
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer2.1.bn2.running_var
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer2.1.bn2.weight
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer2.1.conv1.weight
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer2.1.conv2.weight
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer2.2.bn1.bias
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer2.2.bn1.num_batches_tracked
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer2.2.bn1.running_mean
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer2.2.bn1.running_var
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer2.2.bn1.weight
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer2.2.bn2.bias
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer2.2.bn2.num_batches_tracked
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer2.2.bn2.running_mean
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer2.2.bn2.running_var
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer2.2.bn2.weight
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer2.2.conv1.weight
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer2.2.conv2.weight
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer2.3.bn1.bias
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer2.3.bn1.num_batches_tracked
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer2.3.bn1.running_mean
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer2.3.bn1.running_var
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer2.3.bn1.weight
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer2.3.bn2.bias
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer2.3.bn2.num_batches_tracked
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer2.3.bn2.running_mean
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer2.3.bn2.running_var
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer2.3.bn2.weight
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer2.3.conv1.weight
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer2.3.conv2.weight
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer3.0.bn1.bias
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer3.0.bn1.num_batches_tracked
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer3.0.bn1.running_mean
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer3.0.bn1.running_var
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer3.0.bn1.weight
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer3.0.bn2.bias
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer3.0.bn2.num_batches_tracked
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer3.0.bn2.running_mean
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer3.0.bn2.running_var
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer3.0.bn2.weight
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer3.0.conv1.weight
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer3.0.conv2.weight
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer3.0.downsample.0.weight
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer3.0.downsample.1.bias
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer3.0.downsample.1.num_batches_tracked
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer3.0.downsample.1.running_mean
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer3.0.downsample.1.running_var
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer3.0.downsample.1.weight
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer3.1.bn1.bias
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer3.1.bn1.num_batches_tracked
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer3.1.bn1.running_mean
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer3.1.bn1.running_var
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer3.1.bn1.weight
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer3.1.bn2.bias
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer3.1.bn2.num_batches_tracked
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer3.1.bn2.running_mean
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer3.1.bn2.running_var
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer3.1.bn2.weight
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer3.1.conv1.weight
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer3.1.conv2.weight
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer3.2.bn1.bias
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer3.2.bn1.num_batches_tracked
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer3.2.bn1.running_mean
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer3.2.bn1.running_var
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer3.2.bn1.weight
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer3.2.bn2.bias
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer3.2.bn2.num_batches_tracked
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer3.2.bn2.running_mean
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer3.2.bn2.running_var
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer3.2.bn2.weight
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer3.2.conv1.weight
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer3.2.conv2.weight
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer3.3.bn1.bias
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer3.3.bn1.num_batches_tracked
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer3.3.bn1.running_mean
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer3.3.bn1.running_var
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer3.3.bn1.weight
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer3.3.bn2.bias
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer3.3.bn2.num_batches_tracked
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer3.3.bn2.running_mean
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer3.3.bn2.running_var
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer3.3.bn2.weight
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer3.3.conv1.weight
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer3.3.conv2.weight
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer3.4.bn1.bias
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer3.4.bn1.num_batches_tracked
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer3.4.bn1.running_mean
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer3.4.bn1.running_var
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer3.4.bn1.weight
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer3.4.bn2.bias
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer3.4.bn2.num_batches_tracked
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer3.4.bn2.running_mean
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer3.4.bn2.running_var
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer3.4.bn2.weight
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer3.4.conv1.weight
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer3.4.conv2.weight
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer3.5.bn1.bias
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer3.5.bn1.num_batches_tracked
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer3.5.bn1.running_mean
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer3.5.bn1.running_var
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer3.5.bn1.weight
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer3.5.bn2.bias
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer3.5.bn2.num_batches_tracked
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer3.5.bn2.running_mean
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer3.5.bn2.running_var
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer3.5.bn2.weight
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer3.5.conv1.weight
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer3.5.conv2.weight
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer4.0.bn1.bias
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer4.0.bn1.num_batches_tracked
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer4.0.bn1.running_mean
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer4.0.bn1.running_var
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer4.0.bn1.weight
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer4.0.bn2.bias
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer4.0.bn2.num_batches_tracked
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer4.0.bn2.running_mean
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer4.0.bn2.running_var
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer4.0.bn2.weight
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer4.0.conv1.weight
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer4.0.conv2.weight
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer4.0.downsample.0.weight
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer4.0.downsample.1.bias
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer4.0.downsample.1.num_batches_tracked
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer4.0.downsample.1.running_mean
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer4.0.downsample.1.running_var
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer4.0.downsample.1.weight
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer4.1.bn1.bias
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer4.1.bn1.num_batches_tracked
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer4.1.bn1.running_mean
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer4.1.bn1.running_var
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer4.1.bn1.weight
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer4.1.bn2.bias
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer4.1.bn2.num_batches_tracked
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer4.1.bn2.running_mean
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer4.1.bn2.running_var
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer4.1.bn2.weight
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer4.1.conv1.weight
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer4.1.conv2.weight
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer4.2.bn1.bias
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer4.2.bn1.num_batches_tracked
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer4.2.bn1.running_mean
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer4.2.bn1.running_var
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer4.2.bn1.weight
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer4.2.bn2.bias
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer4.2.bn2.num_batches_tracked
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer4.2.bn2.running_mean
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer4.2.bn2.running_var
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer4.2.bn2.weight
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer4.2.conv1.weight
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: backbone.layer4.2.conv2.weight
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: bbox_head.cate_convs.0.conv.weight
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: bbox_head.cate_convs.0.gn.bias
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: bbox_head.cate_convs.0.gn.weight
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: bbox_head.cate_convs.1.conv.weight
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: bbox_head.cate_convs.1.gn.bias
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: bbox_head.cate_convs.1.gn.weight
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: bbox_head.kernel_convs.0.conv.weight
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: bbox_head.kernel_convs.0.gn.bias
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: bbox_head.kernel_convs.0.gn.weight
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: bbox_head.kernel_convs.1.conv.weight
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: bbox_head.kernel_convs.1.gn.bias
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: bbox_head.kernel_convs.1.gn.weight
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: bbox_head.solo_cate.bias
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: bbox_head.solo_cate.weight
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: bbox_head.solo_kernel.bias
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: bbox_head.solo_kernel.weight
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: mask_feat_head.conv_pred.0.conv.weight
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: mask_feat_head.conv_pred.0.gn.bias
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: mask_feat_head.conv_pred.0.gn.weight
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: mask_feat_head.convs_all_levels.0.conv0.conv.weight
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: mask_feat_head.convs_all_levels.0.conv0.gn.bias
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: mask_feat_head.convs_all_levels.0.conv0.gn.weight
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: mask_feat_head.convs_all_levels.1.conv0.conv.weight
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: mask_feat_head.convs_all_levels.1.conv0.gn.bias
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: mask_feat_head.convs_all_levels.1.conv0.gn.weight
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: mask_feat_head.convs_all_levels.2.conv0.conv.weight
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: mask_feat_head.convs_all_levels.2.conv0.gn.bias
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: mask_feat_head.convs_all_levels.2.conv0.gn.weight
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: mask_feat_head.convs_all_levels.2.conv1.conv.weight
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: mask_feat_head.convs_all_levels.2.conv1.gn.bias
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: mask_feat_head.convs_all_levels.2.conv1.gn.weight
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: mask_feat_head.convs_all_levels.3.conv0.conv.weight
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: mask_feat_head.convs_all_levels.3.conv0.gn.bias
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: mask_feat_head.convs_all_levels.3.conv0.gn.weight
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: mask_feat_head.convs_all_levels.3.conv1.conv.weight
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: mask_feat_head.convs_all_levels.3.conv1.gn.bias
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: mask_feat_head.convs_all_levels.3.conv1.gn.weight
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: mask_feat_head.convs_all_levels.3.conv2.conv.weight
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: mask_feat_head.convs_all_levels.3.conv2.gn.bias
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: mask_feat_head.convs_all_levels.3.conv2.gn.weight
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: neck.fpn_convs.0.conv.bias
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: neck.fpn_convs.0.conv.weight
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: neck.fpn_convs.1.conv.bias
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: neck.fpn_convs.1.conv.weight
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: neck.fpn_convs.2.conv.bias
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: neck.fpn_convs.2.conv.weight
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: neck.fpn_convs.3.conv.bias
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: neck.fpn_convs.3.conv.weight
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: neck.lateral_convs.0.conv.bias
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: neck.lateral_convs.0.conv.weight
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: neck.lateral_convs.1.conv.bias
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: neck.lateral_convs.1.conv.weight
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: neck.lateral_convs.2.conv.bias
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: neck.lateral_convs.2.conv.weight
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: neck.lateral_convs.3.conv.bias
[TensorRT] VERBOSE: ModelImporter.cpp:90: Importing initializer: neck.lateral_convs.3.conv.weight
[TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: [Conv]
[TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: input
[TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: backbone.conv1.weight
[TensorRT] VERBOSE: ModelImporter.cpp:125: [Conv] inputs: [input -> (1, 3, 448, 672)], [backbone.conv1.weight -> (64, 3, 7, 7)],
[TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (1, 3, 448, 672)
[TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 0) [Convolution] for ONNX node:
[TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (7, 7), strides: (2, 2), prepadding: (3, 3), postpadding: (3, 3), dilations: (1, 1), numOutputs: 64
[TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (1, 64, 224, 336)
[TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 273 for ONNX tensor: 273
[TensorRT] VERBOSE: ModelImporter.cpp:179: [Conv] outputs: [273 -> (1, 64, 224, 336)],
[TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: [BatchNormalization]
[TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 273
[TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: backbone.bn1.weight
[TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: backbone.bn1.bias
[TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: backbone.bn1.running_mean
[TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: backbone.bn1.running_var
[TensorRT] VERBOSE: ModelImporter.cpp:125: [BatchNormalization] inputs: [273 -> (1, 64, 224, 336)], [backbone.bn1.weight -> (64)], [backbone.bn1.bias -> (64)], [backbone.bn1.running_mean -> (64)], [backbone.bn1.running_var -> (64)],
[TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 1) [Scale] for ONNX node:
[TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 274 for ONNX tensor: 274
[TensorRT] VERBOSE: ModelImporter.cpp:179: [BatchNormalization] outputs: [274 -> (1, 64, 224, 336)],
[TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: [Relu]
[TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 274
[TensorRT] VERBOSE: ModelImporter.cpp:125: [Relu] inputs: [274 -> (1, 64, 224, 336)],
[TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 2) [Activation] for ONNX node:
[TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 275 for ONNX tensor: 275
[TensorRT] VERBOSE: ModelImporter.cpp:179: [Relu] outputs: [275 -> (1, 64, 224, 336)],
[TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: [MaxPool]
[TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 275
[TensorRT] VERBOSE: ModelImporter.cpp:125: [MaxPool] inputs: [275 -> (1, 64, 224, 336)],
[TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 3) [Pooling] for ONNX node:
[TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 276 for ONNX tensor: 276
[TensorRT] VERBOSE: ModelImporter.cpp:179: [MaxPool] outputs: [276 -> (1, 64, 112, 168)],
[TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: [Conv]
[TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 276
[TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: backbone.layer1.0.conv1.weight
[TensorRT] VERBOSE: ModelImporter.cpp:125: [Conv] inputs: [276 -> (1, 64, 112, 168)], [backbone.layer1.0.conv1.weight -> (64, 64, 3, 3)],
[TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (1, 64, 112, 168)
[TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 4) [Convolution] for ONNX node:
[TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 64
[TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (1, 64, 112, 168)
[TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 277 for ONNX tensor: 277
[TensorRT] VERBOSE: ModelImporter.cpp:179: [Conv] outputs: [277 -> (1, 64, 112, 168)],
[TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: [BatchNormalization]
[TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 277
[TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: backbone.layer1.0.bn1.weight
[TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: backbone.layer1.0.bn1.bias
[TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: backbone.layer1.0.bn1.running_mean
[TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: backbone.layer1.0.bn1.running_var
[TensorRT] VERBOSE: ModelImporter.cpp:125: [BatchNormalization] inputs: [277 -> (1, 64, 112, 168)], [backbone.layer1.0.bn1.weight -> (64)], [backbone.layer1.0.bn1.bias -> (64)], [backbone.layer1.0.bn1.running_mean -> (64)], [backbone.layer1.0.bn1.running_var -> (64)],
[TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 5) [Scale] for ONNX node:
[TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 278 for ONNX tensor: 278
[TensorRT] VERBOSE: ModelImporter.cpp:179: [BatchNormalization] outputs: [278 -> (1, 64, 112, 168)],
[TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: [Relu]
[TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 278
[TensorRT] VERBOSE: ModelImporter.cpp:125: [Relu] inputs: [278 -> (1, 64, 112, 168)],
[TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 6) [Activation] for ONNX node:
[TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 279 for ONNX tensor: 279
[TensorRT] VERBOSE: ModelImporter.cpp:179: [Relu] outputs: [279 -> (1, 64, 112, 168)],
[TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: [Conv]
[TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 279
[TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: backbone.layer1.0.conv2.weight
[TensorRT] VERBOSE: ModelImporter.cpp:125: [Conv] inputs: [279 -> (1, 64, 112, 168)], [backbone.layer1.0.conv2.weight -> (64, 64, 3, 3)],
[TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (1, 64, 112, 168)
[TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 7) [Convolution] for ONNX node:
[TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 64
[TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (1, 64, 112, 168)
[TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 280 for ONNX tensor: 280
[TensorRT] VERBOSE: ModelImporter.cpp:179: [Conv] outputs: [280 -> (1, 64, 112, 168)],
[TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: [BatchNormalization]
[TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 280
[TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: backbone.layer1.0.bn2.weight
[TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: backbone.layer1.0.bn2.bias
[TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: backbone.layer1.0.bn2.running_mean
[TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: backbone.layer1.0.bn2.running_var
[TensorRT] VERBOSE: ModelImporter.cpp:125: [BatchNormalization] inputs: [280 -> (1, 64, 112, 168)], [backbone.layer1.0.bn2.weight -> (64)], [backbone.layer1.0.bn2.bias -> (64)], [backbone.layer1.0.bn2.running_mean -> (64)], [backbone.layer1.0.bn2.running_var -> (64)],
[TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 8) [Scale] for ONNX node:
[TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 281 for ONNX tensor: 281
[TensorRT] VERBOSE: ModelImporter.cpp:179: [BatchNormalization] outputs: [281 -> (1, 64, 112, 168)],
[TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: [Add]
[TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 281
[TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 276
[TensorRT] VERBOSE: ModelImporter.cpp:125: [Add] inputs: [281 -> (1, 64, 112, 168)], [276 -> (1, 64, 112, 168)],
[TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 9) [ElementWise] for ONNX node:
[TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 282 for ONNX tensor: 282
[TensorRT] VERBOSE: ModelImporter.cpp:179: [Add] outputs: [282 -> (1, 64, 112, 168)],
[TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: [Relu]
[TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 282
[TensorRT] VERBOSE: ModelImporter.cpp:125: [Relu] inputs: [282 -> (1, 64, 112, 168)],
[TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 10) [Activation] for ONNX node:
[TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 283 for ONNX tensor: 283
[TensorRT] VERBOSE: ModelImporter.cpp:179: [Relu] outputs: [283 -> (1, 64, 112, 168)],
[TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: [Conv]
[TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: 283
[TensorRT] VERBOSE: ModelImporter.cpp:119: Searching for input: backbone.layer1.1.conv1.weight
[TensorRT] VERBOSE: ModelImporter.cpp:125: [Conv] inputs: [283 -> (1, 64, 112, 168)], [backbone.layer1.1.conv1.weight -> (64, 64, 3, 3)],
[TensorRT] VERBOSE: builtin_op_importers.cpp:450: Convolution input dimensions: (1, 64, 112, 168)
[TensorRT] VERBOSE: ImporterContext.hpp:141: Registering layer: (Unnamed Layer* 11) [Convolution] for ONNX node:
[TensorRT] VERBOSE: builtin_op_importers.cpp:533: Using kernel: (3, 3), strides: (1, 1), prepadding: (1, 1), postpadding: (1, 1), dilations: (1, 1), numOutputs: 64
[TensorRT] VERBOSE: builtin_op_importers.cpp:534: Convolution output dimensions: (1, 64, 112, 168)
[TensorRT] VERBOSE: ImporterContext.hpp:116: Registering tensor: 284 for ONNX tensor: 284
[TensorRT] VERBOSE: ModelImporter.cpp:179: [Conv] outputs: [284 -> (1, 64, 112, 168)],
[TensorRT] VERBOSE: ModelImporter.cpp:103: Parsing node: [BatchNormalization]

@duohaoxue
Copy link
Author

Can I add WeChat to you? This is my WeChat ID yf88859

@zhangjinsong3
Copy link
Owner

Please check your tensorRT and onnx-tensorrt version. Besides, I do not run well in dynamic input mode. Maybe u should run in explict shape first!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@zhangjinsong3 @duohaoxue