[TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Relu6) (CudaDepthwiseConvolution) [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Relu6) (CudnnConvolution) [TRT] Tactic: 0 Time: 0.451797 [TRT] Tactic: 1 Time: 0.455234 [TRT] Tactic: 2 Time: 0.487943 [TRT] Tactic: 4 skipped. Scratch requested: 214564864, available: 33554432 [TRT] Tactic: 5 Time: 2.17661 [TRT] Fastest Tactic: 0 Time: 0.451797 [TRT] Setting workspace to 214564864enables more tactics for profiling [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Relu6) (CublasConvolution) [TRT] CublasConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Relu6) (CaskConvolution) [TRT] FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758 [TRT] Tactic: 1062367460111450758 Time: 0.191901 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 Tactic: 1698681053543049347 [TRT] Tactic: 1698681053543049347 Time: 0.173619 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441 [TRT] Tactic: 4501471010995462441 Time: 0.155964 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826 [TRT] Tactic: 5137655947464784826 Time: 0.153724 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929 [TRT] Tactic: 5288347012147084929 Time: 0.159687 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 Tactic: 5326823351883942011 [TRT] Tactic: 5326823351883942011 Time: 0.157604 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 Tactic: 5500448035057547314 [TRT] Tactic: 5500448035057547314 Time: 0.162265 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056 [TRT] Tactic: 6645123197870846056 Time: 0.157552 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478 [TRT] Tactic: 7144526460361122478 Time: 0.190183 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730 [TRT] Tactic: -8262349710178828730 Time: 0.162136 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 Tactic: -6576203419454146580 [TRT] Tactic: -6576203419454146580 Time: 0.174687 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159 [TRT] Tactic: -4787320710726427159 Time: 0.194791 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839 [TRT] Tactic: -3456450830548107839 Time: 0.180808 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241 [TRT] Tactic: -1218658103698133241 Time: 0.168125 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091 [TRT] Tactic: -836875257600482091 Time: 0.164297 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746 [TRT] Tactic: -410470605513481746 Time: 0.159193 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 Tactic: -377491875521947884 [TRT] Tactic: -377491875521947884 Time: 0.159218 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 Tactic: -37215280111360163 [TRT] Tactic: -37215280111360163 Time: 0.151928 [TRT] Fastest Tactic: -37215280111360163 Time: 0.151928 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -37215280111360163 [TRT] *************** Autotuning format combination: Float(23104,1,1216,64) -> Float(138624,1,7296,384) *************** [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Relu6) (CudnnConvolution) [TRT] CudnnConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Relu6) (CublasConvolution) [TRT] CublasConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Relu6) (CaskConvolution) [TRT] FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Relu6) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 3886731678879822788 [TRT] Tactic: 3886731678879822788 Time: 0.173855 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Relu6) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 6629944304117643200 [TRT] Tactic: 6629944304117643200 Time: 0.391537 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Relu6) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -9153228964338181824 [TRT] Tactic: -9153228964338181824 Time: 0.393412 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Relu6) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -7394439838318485025 [TRT] Tactic: -7394439838318485025 Time: 0.177579 [TRT] Fastest Tactic: 3886731678879822788 Time: 0.173855 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3886731678879822788 [TRT] *************** Autotuning format combination: Half(23104,361,19,1) -> Half(138624,361,19,1) *************** [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Relu6) (CudnnConvolution) [TRT] Tactic: 0 Time: 0.457891 [TRT] Tactic: 1 Time: 0.40987 [TRT] Tactic: 2 Time: 0.452552 [TRT] Tactic: 4 skipped. Scratch requested: 214564864, available: 33554432 [TRT] Tactic: 5 Time: 2.13104 [TRT] Fastest Tactic: 1 Time: 0.40987 [TRT] Setting workspace to 214564864enables more tactics for profiling [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Relu6) (CublasConvolution) [TRT] CublasConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Relu6) (CaskConvolution) [TRT] CaskConvolution has no valid tactics for this config, skipping [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 1 [TRT] *************** Autotuning format combination: Half(11552,361:2,19,1) -> Half(138624,361,19,1) *************** [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Relu6) (CaskConvolution) [TRT] CaskConvolution has no valid tactics for this config, skipping [TRT] *************** Autotuning format combination: Half(11552,361:2,19,1) -> Half(69312,361:2,19,1) *************** [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Relu6) (FusedConvActConvolution) [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Relu6) (CudnnConvolution) [TRT] CudnnConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Relu6) (CublasConvolution) [TRT] CublasConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Relu6) (CaskConvolution) [TRT] FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Relu6) Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 3066127711859985668 [TRT] Tactic: 3066127711859985668 Time: 0.115469 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Relu6) Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 3564772625446233998 [TRT] Tactic: 3564772625446233998 Time: 0.115364 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Relu6) Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: 5319956359050645452 [TRT] Tactic: 5319956359050645452 Time: 0.108985 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Relu6) Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 7205456024582378848 [TRT] Tactic: 7205456024582378848 Time: 0.092057 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Relu6) Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 8163473458334948789 [TRT] Tactic: 8163473458334948789 Time: 0.088854 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Relu6) Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -4212163711445252890 [TRT] Tactic: -4212163711445252890 Time: 0.090495 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Relu6) Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: -3898373634979201110 [TRT] Tactic: -3898373634979201110 Time: 0.0909635 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Relu6) Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: -2409163523992614473 [TRT] Tactic: -2409163523992614473 Time: 0.089818 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Relu6) Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: -1716393687483585322 [TRT] Tactic: -1716393687483585322 Time: 0.088672 [TRT] Fastest Tactic: -1716393687483585322 Time: 0.088672 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -1716393687483585322 [TRT] =============== Computing costs for [TRT] *************** Autotuning format combination: Float(138624,361,19,1) -> Float(138624,361,19,1) *************** [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/Relu6) (CudaDepthwiseConvolution) [TRT] Tactic: -1 Time: 0.25974 [TRT] Fastest Tactic: -1 Time: 0.25974 [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/Relu6) (CudnnConvolution) [TRT] Tactic: 0 Time: 0.446536 [TRT] Tactic: 1 Time: 0.447318 [TRT] Tactic: 2 Time: 0.490469 [TRT] Tactic: 4 Time: 55.1735 [TRT] Tactic: 5 Time: 119.698 [TRT] Tactic: 6 Time: 20.1197 [TRT] Fastest Tactic: 0 Time: 0.446536 [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/Relu6) (CaskConvolution) [TRT] FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758 [TRT] Tactic: 1062367460111450758 Time: 18.4203 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v0 Tactic: 1754984623894446479 [TRT] Tactic: 1754984623894446479 Time: 19.2808 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v0 Tactic: 3611739942397549984 [TRT] Tactic: 3611739942397549984 Time: 12.6774 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/Relu6) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v1 Tactic: 3827454225649558724 [TRT] Tactic: 3827454225649558724 Time: 17.1321 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 Tactic: 4337000649858996379 [TRT] Tactic: 4337000649858996379 Time: 11.4397 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441 [TRT] Tactic: 4501471010995462441 Time: 12.1332 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826 [TRT] Tactic: 5137655947464784826 Time: 10.7146 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929 [TRT] Tactic: 5288347012147084929 Time: 12.6526 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/Relu6) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148m_nt_v1 Tactic: 5921334924264294896 [TRT] Tactic: 5921334924264294896 Time: 12.9211 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056 [TRT] Tactic: 6645123197870846056 Time: 10.9072 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478 [TRT] Tactic: 7144526460361122478 Time: 10.5591 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/Relu6) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 Tactic: 7852627285308570038 [TRT] Tactic: 7852627285308570038 Time: 18.452 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 Tactic: -9137461792520977713 [TRT] Tactic: -9137461792520977713 Time: 11.8439 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/Relu6) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v0 Tactic: -8776506421218919509 [TRT] Tactic: -8776506421218919509 Time: 16.7005 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730 [TRT] Tactic: -8262349710178828730 Time: 12.3229 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v0 Tactic: -8133971918129952780 [TRT] Tactic: -8133971918129952780 Time: 11.326 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 Tactic: -6092040395344634144 [TRT] Tactic: -6092040395344634144 Time: 11.388 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159 [TRT] Tactic: -4787320710726427159 Time: 11.3047 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839 [TRT] Tactic: -3456450830548107839 Time: 10.8439 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/Relu6) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v0 Tactic: -2318106587342035239 [TRT] Tactic: -2318106587342035239 Time: 17.522 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/Relu6) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_mobile_relu_tile148t_nt_v0 Tactic: -1343271414618805657 [TRT] Tactic: -1343271414618805657 Time: 12.3816 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241 [TRT] Tactic: -1218658103698133241 Time: 11.1143 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091 [TRT] Tactic: -836875257600482091 Time: 10.603 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746 [TRT] Tactic: -410470605513481746 Time: 11.9362 [TRT] Fastest Tactic: 7144526460361122478 Time: 10.5591 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: -1 [TRT] *************** Autotuning format combination: Float(138624,1,7296,384) -> Float(138624,1,7296,384) *************** [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/Relu6) (CudnnConvolution) [TRT] CudnnConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/Relu6) (CaskConvolution) [TRT] CaskConvolution has no valid tactics for this config, skipping [TRT] *************** Autotuning format combination: Half(138624,361,19,1) -> Half(138624,361,19,1) *************** [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/Relu6) (CudnnConvolution) [TRT] Tactic: 0 Time: 0.245834 [TRT] Tactic: 1 Time: 0.242188 [TRT] Tactic: 2 Time: 18.2814 [TRT] Tactic: 4 Time: 55.4079 [TRT] Tactic: 5 Time: 119.551 [TRT] Tactic: 6 Time: 131.205 [TRT] Fastest Tactic: 1 Time: 0.242188 [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/Relu6) (CaskConvolution) [TRT] CaskConvolution has no valid tactics for this config, skipping [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 1 [TRT] *************** Autotuning format combination: Half(69312,361:2,19,1) -> Half(69312,361:2,19,1) *************** [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/Relu6) (CaskConvolution) [TRT] CaskConvolution has no valid tactics for this config, skipping [TRT] =============== Computing costs for [TRT] *************** Autotuning format combination: Float(138624,361,19,1), Float(23104,361,19,1) -> Float(23104,361,19,1) *************** [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_7/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_7/add (FusedConvActConvolution) [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_7/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_7/add (CudaDepthwiseConvolution) [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_7/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_7/add (CudnnConvolution) [TRT] Tactic: 0 Time: 0.288984 [TRT] Tactic: 1 Time: 0.244166 [TRT] Tactic: 2 Time: 0.532864 [TRT] Tactic: 4 skipped. Scratch requested: 217350144, available: 33554432 [TRT] Tactic: 5 Time: 1.68716 [TRT] Fastest Tactic: 1 Time: 0.244166 [TRT] Setting workspace to 217350144enables more tactics for profiling [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_7/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_7/add (CublasConvolution) [TRT] CublasConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_7/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_7/add (CaskConvolution) [TRT] FeatureExtractor/MobilenetV2/expanded_conv_7/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_7/add Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758 [TRT] Tactic: 1062367460111450758 Time: 0.156927 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_7/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_7/add Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 Tactic: 1698681053543049347 [TRT] Tactic: 1698681053543049347 Time: 0.138855 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_7/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_7/add Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441 [TRT] Tactic: 4501471010995462441 Time: 0.230886 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_7/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_7/add Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826 [TRT] Tactic: 5137655947464784826 Time: 0.128437 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_7/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_7/add Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929 [TRT] Tactic: 5288347012147084929 Time: 0.2325 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_7/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_7/add Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 Tactic: 5326823351883942011 [TRT] Tactic: 5326823351883942011 Time: 0.228594 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_7/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_7/add Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 Tactic: 5500448035057547314 [TRT] Tactic: 5500448035057547314 Time: 0.13539 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_7/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_7/add Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056 [TRT] Tactic: 6645123197870846056 Time: 0.130677 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_7/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_7/add Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478 [TRT] Tactic: 7144526460361122478 Time: 0.202057 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_7/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_7/add Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730 [TRT] Tactic: -8262349710178828730 Time: 0.237214 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_7/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_7/add Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 Tactic: -6576203419454146580 [TRT] Tactic: -6576203419454146580 Time: 0.141641 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_7/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_7/add Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159 [TRT] Tactic: -4787320710726427159 Time: 0.214739 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_7/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_7/add Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839 [TRT] Tactic: -3456450830548107839 Time: 0.150912 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_7/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_7/add Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241 [TRT] Tactic: -1218658103698133241 Time: 0.145339 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_7/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_7/add Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091 [TRT] Tactic: -836875257600482091 Time: 0.138073 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_7/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_7/add Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746 [TRT] Tactic: -410470605513481746 Time: 0.226406 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_7/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_7/add Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 Tactic: -377491875521947884 [TRT] Tactic: -377491875521947884 Time: 0.228255 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_7/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_7/add Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 Tactic: -37215280111360163 [TRT] Tactic: -37215280111360163 Time: 0.12323 [TRT] Fastest Tactic: -37215280111360163 Time: 0.12323 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -37215280111360163 [TRT] *************** Autotuning format combination: Float(138624,1,7296,384), Float(23104,1,1216,64) -> Float(23104,1,1216,64) *************** [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_7/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_7/add (CudnnConvolution) [TRT] CudnnConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_7/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_7/add (CublasConvolution) [TRT] CublasConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_7/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_7/add (CaskConvolution) [TRT] FeatureExtractor/MobilenetV2/expanded_conv_7/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_7/add Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 3886731678879822788 [TRT] Tactic: 3886731678879822788 Time: 0.133594 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_7/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_7/add Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 6629944304117643200 [TRT] Tactic: 6629944304117643200 Time: 0.215156 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_7/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_7/add Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -9153228964338181824 [TRT] Tactic: -9153228964338181824 Time: 0.211823 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_7/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_7/add Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -7394439838318485025 [TRT] Tactic: -7394439838318485025 Time: 0.136771 [TRT] Fastest Tactic: 3886731678879822788 Time: 0.133594 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3886731678879822788 [TRT] *************** Autotuning format combination: Half(138624,361,19,1), Half(23104,361,19,1) -> Half(23104,361,19,1) *************** [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_7/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_7/add (CudnnConvolution) [TRT] Tactic: 0 Time: 0.31323 [TRT] Tactic: 1 Time: 0.250912 [TRT] Tactic: 2 Time: 0.523541 [TRT] Tactic: 4 skipped. Scratch requested: 217350144, available: 33554432 [TRT] Tactic: 5 Time: 1.60177 [TRT] Fastest Tactic: 1 Time: 0.250912 [TRT] Setting workspace to 217350144enables more tactics for profiling [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_7/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_7/add (CublasConvolution) [TRT] CublasConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_7/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_7/add (CaskConvolution) [TRT] CaskConvolution has no valid tactics for this config, skipping [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 1 [TRT] *************** Autotuning format combination: Half(69312,361:2,19,1), Half(11552,361:2,19,1) -> Half(11552,361:2,19,1) *************** [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_7/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_7/add (FusedConvActConvolution) [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_7/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_7/add (CudnnConvolution) [TRT] CudnnConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_7/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_7/add (CublasConvolution) [TRT] CublasConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_7/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_7/add (CaskConvolution) [TRT] FeatureExtractor/MobilenetV2/expanded_conv_7/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_7/add Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 3066127711859985668 [TRT] Tactic: 3066127711859985668 Time: 0.068906 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_7/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_7/add Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 3564772625446233998 [TRT] Tactic: 3564772625446233998 Time: 0.08349 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_7/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_7/add Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: 5319956359050645452 [TRT] Tactic: 5319956359050645452 Time: 0.073594 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_7/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_7/add Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 7205456024582378848 [TRT] Tactic: 7205456024582378848 Time: 0.068542 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_7/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_7/add Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 8163473458334948789 [TRT] Tactic: 8163473458334948789 Time: 0.064271 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_7/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_7/add Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -4212163711445252890 [TRT] Tactic: -4212163711445252890 Time: 0.115443 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_7/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_7/add Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: -3898373634979201110 [TRT] Tactic: -3898373634979201110 Time: 0.116901 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_7/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_7/add Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: -2409163523992614473 [TRT] Tactic: -2409163523992614473 Time: 0.0709635 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_7/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_7/add Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: -1716393687483585322 [TRT] Tactic: -1716393687483585322 Time: 0.113359 [TRT] Fastest Tactic: 8163473458334948789 Time: 0.064271 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 8163473458334948789 [TRT] =============== Computing costs for [TRT] *************** Autotuning format combination: Float(23104,361,19,1) -> Float(138624,361,19,1) *************** [TRT] *************** Autotuning format combination: Float(23104,1,1216,64) -> Float(138624,1,7296,384) *************** [TRT] *************** Autotuning format combination: Half(23104,361,19,1) -> Half(138624,361,19,1) *************** [TRT] *************** Autotuning format combination: Half(11552,361:2,19,1) -> Half(138624,361,19,1) *************** [TRT] *************** Autotuning format combination: Half(11552,361:2,19,1) -> Half(69312,361:2,19,1) *************** [TRT] =============== Computing costs for [TRT] *************** Autotuning format combination: Float(138624,361,19,1) -> Float(138624,361,19,1) *************** [TRT] *************** Autotuning format combination: Float(138624,1,7296,384) -> Float(138624,1,7296,384) *************** [TRT] *************** Autotuning format combination: Half(138624,361,19,1) -> Half(138624,361,19,1) *************** [TRT] *************** Autotuning format combination: Half(69312,361:2,19,1) -> Half(69312,361:2,19,1) *************** [TRT] =============== Computing costs for [TRT] *************** Autotuning format combination: Float(138624,361,19,1), Float(23104,361,19,1) -> Float(23104,361,19,1) *************** [TRT] *************** Autotuning format combination: Float(138624,1,7296,384), Float(23104,1,1216,64) -> Float(23104,1,1216,64) *************** [TRT] *************** Autotuning format combination: Half(138624,361,19,1), Half(23104,361,19,1) -> Half(23104,361,19,1) *************** [TRT] *************** Autotuning format combination: Half(69312,361:2,19,1), Half(11552,361:2,19,1) -> Half(11552,361:2,19,1) *************** [TRT] =============== Computing costs for [TRT] *************** Autotuning format combination: Float(23104,361,19,1) -> Float(138624,361,19,1) *************** [TRT] *************** Autotuning format combination: Float(23104,1,1216,64) -> Float(138624,1,7296,384) *************** [TRT] *************** Autotuning format combination: Half(23104,361,19,1) -> Half(138624,361,19,1) *************** [TRT] *************** Autotuning format combination: Half(11552,361:2,19,1) -> Half(138624,361,19,1) *************** [TRT] *************** Autotuning format combination: Half(11552,361:2,19,1) -> Half(69312,361:2,19,1) *************** [TRT] =============== Computing costs for [TRT] *************** Autotuning format combination: Float(138624,361,19,1) -> Float(138624,361,19,1) *************** [TRT] *************** Autotuning format combination: Float(138624,1,7296,384) -> Float(138624,1,7296,384) *************** [TRT] *************** Autotuning format combination: Half(138624,361,19,1) -> Half(138624,361,19,1) *************** [TRT] *************** Autotuning format combination: Half(69312,361:2,19,1) -> Half(69312,361:2,19,1) *************** [TRT] =============== Computing costs for [TRT] *************** Autotuning format combination: Float(138624,361,19,1), Float(23104,361,19,1) -> Float(23104,361,19,1) *************** [TRT] *************** Autotuning format combination: Float(138624,1,7296,384), Float(23104,1,1216,64) -> Float(23104,1,1216,64) *************** [TRT] *************** Autotuning format combination: Half(138624,361,19,1), Half(23104,361,19,1) -> Half(23104,361,19,1) *************** [TRT] *************** Autotuning format combination: Half(69312,361:2,19,1), Half(11552,361:2,19,1) -> Half(11552,361:2,19,1) *************** [TRT] =============== Computing costs for [TRT] *************** Autotuning format combination: Float(23104,361,19,1) -> Float(138624,361,19,1) *************** [TRT] *************** Autotuning format combination: Float(23104,1,1216,64) -> Float(138624,1,7296,384) *************** [TRT] *************** Autotuning format combination: Half(23104,361,19,1) -> Half(138624,361,19,1) *************** [TRT] *************** Autotuning format combination: Half(11552,361:2,19,1) -> Half(138624,361,19,1) *************** [TRT] *************** Autotuning format combination: Half(11552,361:2,19,1) -> Half(69312,361:2,19,1) *************** [TRT] =============== Computing costs for [TRT] *************** Autotuning format combination: Float(138624,361,19,1) -> Float(138624,361,19,1) *************** [TRT] *************** Autotuning format combination: Float(138624,1,7296,384) -> Float(138624,1,7296,384) *************** [TRT] *************** Autotuning format combination: Half(138624,361,19,1) -> Half(138624,361,19,1) *************** [TRT] *************** Autotuning format combination: Half(69312,361:2,19,1) -> Half(69312,361:2,19,1) *************** [TRT] =============== Computing costs for [TRT] *************** Autotuning format combination: Float(138624,361,19,1) -> Float(34656,361,19,1) *************** [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_10/project/Conv2D (FusedConvActConvolution) [TRT] Tactic: 589823 Time: 0.420286 [TRT] Tactic: 655359 Time: 0.391172 [TRT] Tactic: 786431 Time: 0.410416 [TRT] Tactic: 851967 Time: 0.48724 [TRT] Tactic: 1179647 Time: 0.604219 [TRT] Tactic: 1310719 Time: 0.901042 [TRT] Tactic: 1376255 Time: 0.501354 [TRT] Tactic: 1441791 Time: 0.538385 [TRT] Tactic: 1507327 Time: 0.467839 [TRT] Tactic: 1638399 Time: 0.480339 [TRT] Tactic: 1835007 Time: 0.433515 [TRT] Tactic: 1900543 Time: 0.539974 [TRT] Tactic: 2097151 Time: 0.512084 [TRT] Tactic: 2162687 Time: 0.40802 [TRT] Tactic: 2293759 Time: 0.505756 [TRT] Tactic: 2359295 Time: 0.427083 [TRT] Tactic: 2686975 Time: 0.381328 [TRT] Tactic: 3080191 Time: 0.421354 [TRT] Tactic: 3342335 Time: 0.544973 [TRT] Tactic: 3407871 Time: 0.482318 [TRT] Tactic: 3538943 Time: 0.508802 [TRT] Tactic: 3670015 Time: 0.341458 [TRT] Tactic: 3932159 Time: 0.459271 [TRT] Tactic: 3997695 Time: 0.425626 [TRT] Tactic: 4063231 Time: 0.519792 [TRT] Tactic: 4194303 Time: 0.432682 [TRT] Tactic: 4259839 Time: 0.52875 [TRT] Tactic: 4325375 Time: 0.430625 [TRT] Tactic: 4521983 Time: 0.437448 [TRT] Tactic: 4587519 Time: 0.539792 [TRT] Tactic: 4653055 Time: 0.656354 [TRT] Tactic: 4915199 Time: 0.421302 [TRT] Tactic: 4980735 Time: 0.42823 [TRT] Tactic: 5177343 Time: 0.591771 [TRT] Tactic: 5242879 Time: 0.427083 [TRT] Tactic: 5373951 Time: 0.728724 [TRT] Tactic: 5439487 Time: 0.509193 [TRT] Tactic: 5570559 Time: 0.353047 [TRT] Tactic: 5636095 Time: 0.518854 [TRT] Tactic: 5701631 Time: 0.500078 [TRT] Tactic: 5767167 Time: 0.789245 [TRT] Tactic: 5832703 Time: 0.47823 [TRT] Tactic: 5898239 Time: 0.428177 [TRT] Tactic: 6029311 Time: 0.470443 [TRT] Tactic: 6225919 Time: 0.471797 [TRT] Tactic: 6291455 Time: 0.602188 [TRT] Tactic: 6422527 Time: 0.427422 [TRT] Tactic: 6750207 Time: 0.437083 [TRT] Tactic: 6815743 Time: 0.465885 [TRT] Tactic: 6946815 Time: 0.622682 [TRT] Tactic: 7012351 Time: 0.512214 [TRT] Tactic: 7077887 Time: 0.517396 [TRT] Tactic: 7143423 Time: 0.733046 [TRT] Tactic: 7208959 Time: 0.438646 [TRT] Tactic: 7340031 Time: 0.463516 [TRT] Tactic: 7405567 Time: 0.533933 [TRT] Tactic: 7536639 Time: 0.499374 [TRT] Tactic: 7602175 Time: 0.573463 [TRT] Tactic: 7733247 Time: 0.469922 [TRT] Tactic: 7798783 Time: 0.410286 [TRT] Tactic: 8191999 Time: 0.670313 [TRT] Tactic: 8257535 Time: 0.431979 [TRT] Tactic: 8323071 Time: 0.433074 [TRT] Tactic: 8650751 Time: 0.539297 [TRT] Tactic: 8716287 Time: 0.495781 [TRT] Tactic: 9109503 Time: 0.574323 [TRT] Tactic: 9568255 Time: 0.422813 [TRT] Tactic: 9895935 Time: 0.429402 [TRT] Tactic: 10223615 Time: 0.382084 [TRT] Tactic: 10354687 Time: 0.513177 [TRT] Tactic: 10551295 Time: 0.456666 [TRT] Tactic: 10747903 Time: 0.438854 [TRT] Tactic: 10944511 Time: 0.428203 [TRT] Fastest Tactic: 3670015 Time: 0.341458 [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_10/project/Conv2D (CudaDepthwiseConvolution) [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_10/project/Conv2D (CudnnConvolution) [TRT] Tactic: 0 Time: 0.383646 [TRT] Tactic: 1 Time: 0.319167 [TRT] Tactic: 2 Time: 0.529401 [TRT] Tactic: 4 skipped. Scratch requested: 324354048, available: 33554432 [TRT] Tactic: 5 Time: 2.22737 [TRT] Fastest Tactic: 1 Time: 0.319167 [TRT] Setting workspace to 324354048enables more tactics for profiling [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_10/project/Conv2D (CublasConvolution) [TRT] CublasConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_10/project/Conv2D (CaskConvolution) [TRT] FeatureExtractor/MobilenetV2/expanded_conv_10/project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758 [TRT] Tactic: 1062367460111450758 Time: 0.237527 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_10/project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 Tactic: 1698681053543049347 [TRT] Tactic: 1698681053543049347 Time: 0.215912 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_10/project/Conv2D Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441 [TRT] Tactic: 4501471010995462441 Time: 0.231692 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_10/project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826 [TRT] Tactic: 5137655947464784826 Time: 0.222396 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_10/project/Conv2D Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929 [TRT] Tactic: 5288347012147084929 Time: 0.232005 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_10/project/Conv2D Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 Tactic: 5326823351883942011 [TRT] Tactic: 5326823351883942011 Time: 0.210234 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_10/project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 Tactic: 5500448035057547314 [TRT] Tactic: 5500448035057547314 Time: 0.259531 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_10/project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056 [TRT] Tactic: 6645123197870846056 Time: 0.231719 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_10/project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478 [TRT] Tactic: 7144526460361122478 Time: 0.225703 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_10/project/Conv2D Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730 [TRT] Tactic: -8262349710178828730 Time: 0.237709 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_10/project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 Tactic: -6576203419454146580 [TRT] Tactic: -6576203419454146580 Time: 0.211562 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_10/project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159 [TRT] Tactic: -4787320710726427159 Time: 0.235494 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_10/project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839 [TRT] Tactic: -3456450830548107839 Time: 0.223438 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_10/project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241 [TRT] Tactic: -1218658103698133241 Time: 0.262266 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_10/project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091 [TRT] Tactic: -836875257600482091 Time: 0.255053 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_10/project/Conv2D Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746 [TRT] Tactic: -410470605513481746 Time: 0.211796 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_10/project/Conv2D Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 Tactic: -377491875521947884 [TRT] Tactic: -377491875521947884 Time: 0.228646 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_10/project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 Tactic: -37215280111360163 [TRT] Tactic: -37215280111360163 Time: 0.215782 [TRT] Fastest Tactic: 5326823351883942011 Time: 0.210234 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5326823351883942011 [TRT] *************** Autotuning format combination: Float(138624,1,7296,384) -> Float(34656,1,1824,96) *************** [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_10/project/Conv2D (CudnnConvolution) [TRT] CudnnConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_10/project/Conv2D (CublasConvolution) [TRT] CublasConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_10/project/Conv2D (CaskConvolution) [TRT] FeatureExtractor/MobilenetV2/expanded_conv_10/project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 3886731678879822788 [TRT] Tactic: 3886731678879822788 Time: 0.214218 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_10/project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 6629944304117643200 [TRT] Tactic: 6629944304117643200 Time: 0.275546 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_10/project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -9153228964338181824 [TRT] Tactic: -9153228964338181824 Time: 0.288672 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_10/project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -7394439838318485025 [TRT] Tactic: -7394439838318485025 Time: 0.214687 [TRT] Fastest Tactic: 3886731678879822788 Time: 0.214218 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3886731678879822788 [TRT] *************** Autotuning format combination: Half(138624,361,19,1) -> Half(34656,361,19,1) *************** [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_10/project/Conv2D (CudnnConvolution) [TRT] Tactic: 0 Time: 0.419141 [TRT] Tactic: 1 Time: 0.331329 [TRT] Tactic: 2 Time: 0.511823 [TRT] Tactic: 4 skipped. Scratch requested: 324354048, available: 33554432 [TRT] Tactic: 5 Time: 2.15836 [TRT] Fastest Tactic: 1 Time: 0.331329 [TRT] Setting workspace to 324354048enables more tactics for profiling [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_10/project/Conv2D (CublasConvolution) [TRT] CublasConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_10/project/Conv2D (CaskConvolution) [TRT] CaskConvolution has no valid tactics for this config, skipping [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 1 [TRT] *************** Autotuning format combination: Half(69312,361:2,19,1) -> Half(34656,361,19,1) *************** [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_10/project/Conv2D (CaskConvolution) [TRT] CaskConvolution has no valid tactics for this config, skipping [TRT] *************** Autotuning format combination: Half(69312,361:2,19,1) -> Half(17328,361:2,19,1) *************** [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_10/project/Conv2D (FusedConvActConvolution) [TRT] Tactic: 589823 Time: 0.209375 [TRT] Tactic: 655359 Time: 0.268672 [TRT] Tactic: 786431 Time: 0.252187 [TRT] Tactic: 851967 Time: 0.247057 [TRT] Tactic: 1179647 Time: 0.270338 [TRT] Tactic: 1310719 Time: 0.459714 [TRT] Tactic: 1376255 Time: 0.24323 [TRT] Tactic: 1441791 Time: 0.261953 [TRT] Tactic: 1507327 Time: 0.240755 [TRT] Tactic: 1638399 Time: 0.241536 [TRT] Tactic: 1835007 Time: 0.245468 [TRT] Tactic: 1900543 Time: 0.273255 [TRT] Tactic: 2097151 Time: 0.311328 [TRT] Tactic: 2162687 Time: 0.211979 [TRT] Tactic: 2293759 Time: 0.263437 [TRT] Tactic: 2359295 Time: 0.21638 [TRT] Tactic: 2686975 Time: 0.349479 [TRT] Tactic: 3080191 Time: 0.248906 [TRT] Tactic: 3342335 Time: 0.274999 [TRT] Tactic: 3407871 Time: 0.256746 [TRT] Tactic: 3538943 Time: 0.261041 [TRT] Tactic: 3670015 Time: 0.202604 [TRT] Tactic: 3932159 Time: 0.184375 [TRT] Tactic: 3997695 Time: 0.256432 [TRT] Tactic: 4063231 Time: 0.263672 [TRT] Tactic: 4194303 Time: 0.236901 [TRT] Tactic: 4259839 Time: 0.312708 [TRT] Tactic: 4325375 Time: 0.213307 [TRT] Tactic: 4521983 Time: 0.214947 [TRT] Tactic: 4587519 Time: 0.316902 [TRT] Tactic: 4653055 Time: 0.333984 [TRT] Tactic: 4915199 Time: 0.239479 [TRT] Tactic: 4980735 Time: 0.217969 [TRT] Tactic: 5177343 Time: 0.237943 [TRT] Tactic: 5242879 Time: 0.216745 [TRT] Tactic: 5373951 Time: 0.336667 [TRT] Tactic: 5439487 Time: 0.288828 [TRT] Tactic: 5570559 Time: 0.245365 [TRT] Tactic: 5636095 Time: 0.261198 [TRT] Tactic: 5701631 Time: 0.222292 [TRT] Tactic: 5767167 Time: 0.348021 [TRT] Tactic: 5832703 Time: 0.240937 [TRT] Tactic: 5898239 Time: 0.255078 [TRT] Tactic: 6029311 Time: 0.235547 [TRT] Tactic: 6225919 Time: 0.219088 [TRT] Tactic: 6291455 Time: 0.270131 [TRT] Tactic: 6422527 Time: 0.228178 [TRT] Tactic: 6750207 Time: 0.247553 [TRT] Tactic: 6815743 Time: 0.241276 [TRT] Tactic: 6946815 Time: 0.300859 [TRT] Tactic: 7012351 Time: 0.311563 [TRT] Tactic: 7077887 Time: 0.242969 [TRT] Tactic: 7143423 Time: 0.366432 [TRT] Tactic: 7208959 Time: 0.218177 [TRT] Tactic: 7340031 Time: 0.270625 [TRT] Tactic: 7405567 Time: 0.26164 [TRT] Tactic: 7536639 Time: 0.282578 [TRT] Tactic: 7602175 Time: 0.263802 [TRT] Tactic: 7733247 Time: 0.249323 [TRT] Tactic: 7798783 Time: 0.251719 [TRT] Tactic: 8191999 Time: 0.343828 [TRT] Tactic: 8257535 Time: 0.246016 [TRT] Tactic: 8323071 Time: 0.24474 [TRT] Tactic: 8650751 Time: 0.244895 [TRT] Tactic: 8716287 Time: 0.253489 [TRT] Tactic: 9109503 Time: 0.326433 [TRT] Tactic: 9568255 Time: 0.239818 [TRT] Tactic: 9895935 Time: 0.237031 [TRT] Tactic: 10223615 Time: 0.3475 [TRT] Tactic: 10354687 Time: 0.309557 [TRT] Tactic: 10551295 Time: 0.226719 [TRT] Tactic: 10747903 Time: 0.230053 [TRT] Tactic: 10944511 Time: 0.218334 [TRT] Fastest Tactic: 3932159 Time: 0.184375 [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_10/project/Conv2D (CudnnConvolution) [TRT] CudnnConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_10/project/Conv2D (CublasConvolution) [TRT] CublasConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_10/project/Conv2D (CaskConvolution) [TRT] FeatureExtractor/MobilenetV2/expanded_conv_10/project/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 3066127711859985668 [TRT] Tactic: 3066127711859985668 Time: 0.113386 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_10/project/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 3564772625446233998 [TRT] Tactic: 3564772625446233998 Time: 0.127708 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_10/project/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: 5319956359050645452 [TRT] Tactic: 5319956359050645452 Time: 0.126927 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_10/project/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 7205456024582378848 [TRT] Tactic: 7205456024582378848 Time: 0.122422 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_10/project/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 8163473458334948789 [TRT] Tactic: 8163473458334948789 Time: 0.116407 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_10/project/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -4212163711445252890 [TRT] Tactic: -4212163711445252890 Time: 0.11375 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_10/project/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: -3898373634979201110 [TRT] Tactic: -3898373634979201110 Time: 0.114662 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_10/project/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: -2409163523992614473 [TRT] Tactic: -2409163523992614473 Time: 0.122162 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_10/project/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: -1716393687483585322 [TRT] Tactic: -1716393687483585322 Time: 0.111927 [TRT] Fastest Tactic: -1716393687483585322 Time: 0.111927 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -1716393687483585322 [TRT] =============== Computing costs for [TRT] *************** Autotuning format combination: Float(34656,361,19,1) -> Float(207936,361,19,1) *************** [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Relu6) (FusedConvActConvolution) [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Relu6) (CudaDepthwiseConvolution) [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Relu6) (CudnnConvolution) [TRT] Tactic: 0 Time: 0.794505 [TRT] Tactic: 1 Time: 0.702291 [TRT] Tactic: 2 Time: 0.809662 [TRT] Tactic: 4 skipped. Scratch requested: 482353152, available: 33554432 [TRT] Tactic: 5 Time: 4.73425 [TRT] Fastest Tactic: 1 Time: 0.702291 [TRT] Setting workspace to 482353152enables more tactics for profiling [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Relu6) (CublasConvolution) [TRT] CublasConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Relu6) (CaskConvolution) [TRT] FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758 [TRT] Tactic: 1062367460111450758 Time: 0.371901 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 Tactic: 1698681053543049347 [TRT] Tactic: 1698681053543049347 Time: 0.330026 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441 [TRT] Tactic: 4501471010995462441 Time: 0.337526 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826 [TRT] Tactic: 5137655947464784826 Time: 0.295624 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929 [TRT] Tactic: 5288347012147084929 Time: 0.336693 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 Tactic: 5326823351883942011 [TRT] Tactic: 5326823351883942011 Time: 0.320183 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 Tactic: 5500448035057547314 [TRT] Tactic: 5500448035057547314 Time: 0.324505 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056 [TRT] Tactic: 6645123197870846056 Time: 0.307474 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478 [TRT] Tactic: 7144526460361122478 Time: 0.364323 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730 [TRT] Tactic: -8262349710178828730 Time: 0.344766 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 Tactic: -6576203419454146580 [TRT] Tactic: -6576203419454146580 Time: 0.348412 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159 [TRT] Tactic: -4787320710726427159 Time: 0.381979 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839 [TRT] Tactic: -3456450830548107839 Time: 0.344921 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241 [TRT] Tactic: -1218658103698133241 Time: 0.340599 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091 [TRT] Tactic: -836875257600482091 Time: 0.319245 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746 [TRT] Tactic: -410470605513481746 Time: 0.330521 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 Tactic: -377491875521947884 [TRT] Tactic: -377491875521947884 Time: 0.333412 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 Tactic: -37215280111360163 [TRT] Tactic: -37215280111360163 Time: 0.285495 [TRT] Fastest Tactic: -37215280111360163 Time: 0.285495 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -37215280111360163 [TRT] *************** Autotuning format combination: Float(34656,1,1824,96) -> Float(207936,1,10944,576) *************** [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Relu6) (CudnnConvolution) [TRT] CudnnConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Relu6) (CublasConvolution) [TRT] CublasConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Relu6) (CaskConvolution) [TRT] FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Relu6) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 3886731678879822788 [TRT] Tactic: 3886731678879822788 Time: 0.329167 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Relu6) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 6629944304117643200 [TRT] Tactic: 6629944304117643200 Time: 0.665079 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Relu6) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -9153228964338181824 [TRT] Tactic: -9153228964338181824 Time: 0.683385 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Relu6) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -7394439838318485025 [TRT] Tactic: -7394439838318485025 Time: 0.321615 [TRT] Fastest Tactic: -7394439838318485025 Time: 0.321615 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7394439838318485025 [TRT] *************** Autotuning format combination: Half(34656,361,19,1) -> Half(207936,361,19,1) *************** [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Relu6) (CudnnConvolution) [TRT] Tactic: 0 Time: 0.787213 [TRT] Tactic: 1 Time: 0.700208 [TRT] Tactic: 2 Time: 0.75237 [TRT] Tactic: 4 skipped. Scratch requested: 482353152, available: 33554432 [TRT] Tactic: 5 Time: 4.74331 [TRT] Fastest Tactic: 1 Time: 0.700208 [TRT] Setting workspace to 482353152enables more tactics for profiling [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Relu6) (CublasConvolution) [TRT] CublasConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Relu6) (CaskConvolution) [TRT] CaskConvolution has no valid tactics for this config, skipping [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 1 [TRT] *************** Autotuning format combination: Half(17328,361:2,19,1) -> Half(207936,361,19,1) *************** [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Relu6) (CaskConvolution) [TRT] CaskConvolution has no valid tactics for this config, skipping [TRT] *************** Autotuning format combination: Half(17328,361:2,19,1) -> Half(103968,361:2,19,1) *************** [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Relu6) (FusedConvActConvolution) [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Relu6) (CudnnConvolution) [TRT] CudnnConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Relu6) (CublasConvolution) [TRT] CublasConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Relu6) (CaskConvolution) [TRT] FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Relu6) Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 3066127711859985668 [TRT] Tactic: 3066127711859985668 Time: 0.190051 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Relu6) Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 3564772625446233998 [TRT] Tactic: 3564772625446233998 Time: 0.210261 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Relu6) Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: 5319956359050645452 [TRT] Tactic: 5319956359050645452 Time: 0.200599 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Relu6) Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 7205456024582378848 [TRT] Tactic: 7205456024582378848 Time: 0.169713 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Relu6) Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 8163473458334948789 [TRT] Tactic: 8163473458334948789 Time: 0.163801 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Relu6) Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -4212163711445252890 [TRT] Tactic: -4212163711445252890 Time: 0.180963 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Relu6) Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: -3898373634979201110 [TRT] Tactic: -3898373634979201110 Time: 0.184062 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Relu6) Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: -2409163523992614473 [TRT] Tactic: -2409163523992614473 Time: 0.163385 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Relu6) Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: -1716393687483585322 [TRT] Tactic: -1716393687483585322 Time: 0.177135 [TRT] Fastest Tactic: -2409163523992614473 Time: 0.163385 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -2409163523992614473 [TRT] =============== Computing costs for [TRT] *************** Autotuning format combination: Float(207936,361,19,1) -> Float(207936,361,19,1) *************** [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/Relu6) (CudaDepthwiseConvolution) [TRT] Tactic: -1 Time: 0.386641 [TRT] Fastest Tactic: -1 Time: 0.386641 [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/Relu6) (CudnnConvolution) [TRT] Tactic: 0 Time: 0.655625 [TRT] Tactic: 1 Time: 0.658386 [TRT] Tactic: 2 Time: 0.724558 [TRT] Tactic: 4 Time: 82.6702 [TRT] Tactic: 5 Time: 179.008 [TRT] Tactic: 6 Time: 29.8016 [TRT] Fastest Tactic: 0 Time: 0.655625 [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/Relu6) (CaskConvolution) [TRT] FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758 [TRT] Tactic: 1062367460111450758 Time: 16.0803 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v0 Tactic: 1754984623894446479 [TRT] Tactic: 1754984623894446479 Time: 17.5322 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v0 Tactic: 3611739942397549984 [TRT] Tactic: 3611739942397549984 Time: 18.2907 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/Relu6) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v1 Tactic: 3827454225649558724 [TRT] Tactic: 3827454225649558724 Time: 26.5307 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 Tactic: 4337000649858996379 [TRT] Tactic: 4337000649858996379 Time: 17.5528 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441 [TRT] Tactic: 4501471010995462441 Time: 17.655 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826 [TRT] Tactic: 5137655947464784826 Time: 15.9777 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929 [TRT] Tactic: 5288347012147084929 Time: 18.0602 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/Relu6) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148m_nt_v1 Tactic: 5921334924264294896 [TRT] Tactic: 5921334924264294896 Time: 19.3945 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056 [TRT] Tactic: 6645123197870846056 Time: 16.9608 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478 [TRT] Tactic: 7144526460361122478 Time: 15.6117 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/Relu6) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 Tactic: 7852627285308570038 [TRT] Tactic: 7852627285308570038 Time: 28.1983 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 Tactic: -9137461792520977713 [TRT] Tactic: -9137461792520977713 Time: 17.7528 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/Relu6) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v0 Tactic: -8776506421218919509 [TRT] Tactic: -8776506421218919509 Time: 25.5326 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730 [TRT] Tactic: -8262349710178828730 Time: 19.2863 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v0 Tactic: -8133971918129952780 [TRT] Tactic: -8133971918129952780 Time: 17.4399 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 Tactic: -6092040395344634144 [TRT] Tactic: -6092040395344634144 Time: 17.605 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159 [TRT] Tactic: -4787320710726427159 Time: 16.2871 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839 [TRT] Tactic: -3456450830548107839 Time: 16.6557 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/Relu6) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v0 Tactic: -2318106587342035239 [TRT] Tactic: -2318106587342035239 Time: 26.1797 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/Relu6) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_mobile_relu_tile148t_nt_v0 Tactic: -1343271414618805657 [TRT] Tactic: -1343271414618805657 Time: 18.385 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241 [TRT] Tactic: -1218658103698133241 Time: 16.8349 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091 [TRT] Tactic: -836875257600482091 Time: 15.921 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746 [TRT] Tactic: -410470605513481746 Time: 17.3892 [TRT] Fastest Tactic: 7144526460361122478 Time: 15.6117 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: -1 [TRT] *************** Autotuning format combination: Float(207936,1,10944,576) -> Float(207936,1,10944,576) *************** [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/Relu6) (CudnnConvolution) [TRT] CudnnConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/Relu6) (CaskConvolution) [TRT] CaskConvolution has no valid tactics for this config, skipping [TRT] *************** Autotuning format combination: Half(207936,361,19,1) -> Half(207936,361,19,1) *************** [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/Relu6) (CudnnConvolution) [TRT] Tactic: 0 Time: 0.345937 [TRT] Tactic: 1 Time: 0.343386 [TRT] Tactic: 2 Time: 28.2807 [TRT] Tactic: 4 Time: 83.044 [TRT] Tactic: 5 Time: 179.938 [TRT] Tactic: 6 Time: 197.317 [TRT] Fastest Tactic: 1 Time: 0.343386 [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/Relu6) (CaskConvolution) [TRT] CaskConvolution has no valid tactics for this config, skipping [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 1 [TRT] *************** Autotuning format combination: Half(103968,361:2,19,1) -> Half(103968,361:2,19,1) *************** [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/Relu6) (CaskConvolution) [TRT] CaskConvolution has no valid tactics for this config, skipping [TRT] =============== Computing costs for [TRT] *************** Autotuning format combination: Float(207936,361,19,1), Float(34656,361,19,1) -> Float(34656,361,19,1) *************** [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_11/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_11/add (FusedConvActConvolution) [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_11/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_11/add (CudaDepthwiseConvolution) [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_11/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_11/add (CudnnConvolution) [TRT] Tactic: 0 Time: 0.579427 [TRT] Tactic: 1 Time: 0.479688 [TRT] Tactic: 2 Time: 0.717239 [TRT] Tactic: 4 skipped. Scratch requested: 486531072, available: 33554432 [TRT] Tactic: 5 Time: 3.29727 [TRT] Fastest Tactic: 1 Time: 0.479688 [TRT] Setting workspace to 486531072enables more tactics for profiling [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_11/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_11/add (CublasConvolution) [TRT] CublasConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_11/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_11/add (CaskConvolution) [TRT] FeatureExtractor/MobilenetV2/expanded_conv_11/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_11/add Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758 [TRT] Tactic: 1062367460111450758 Time: 0.344791 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_11/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_11/add Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 Tactic: 1698681053543049347 [TRT] Tactic: 1698681053543049347 Time: 0.313359 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_11/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_11/add Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441 [TRT] Tactic: 4501471010995462441 Time: 0.332969 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_11/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_11/add Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826 [TRT] Tactic: 5137655947464784826 Time: 0.332865 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_11/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_11/add Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929 [TRT] Tactic: 5288347012147084929 Time: 0.33651 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_11/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_11/add Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 Tactic: 5326823351883942011 [TRT] Tactic: 5326823351883942011 Time: 0.323281 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_11/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_11/add Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 Tactic: 5500448035057547314 [TRT] Tactic: 5500448035057547314 Time: 0.378594 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_11/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_11/add Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056 [TRT] Tactic: 6645123197870846056 Time: 0.333021 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_11/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_11/add Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478 [TRT] Tactic: 7144526460361122478 Time: 0.329558 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_11/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_11/add Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730 [TRT] Tactic: -8262349710178828730 Time: 0.340286 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_11/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_11/add Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 Tactic: -6576203419454146580 [TRT] Tactic: -6576203419454146580 Time: 0.30987 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_11/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_11/add Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159 [TRT] Tactic: -4787320710726427159 Time: 0.342709 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_11/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_11/add Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839 [TRT] Tactic: -3456450830548107839 Time: 0.321484 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_11/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_11/add Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241 [TRT] Tactic: -1218658103698133241 Time: 0.393412 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_11/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_11/add Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091 [TRT] Tactic: -836875257600482091 Time: 0.388256 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_11/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_11/add Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746 [TRT] Tactic: -410470605513481746 Time: 0.328933 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_11/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_11/add Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 Tactic: -377491875521947884 [TRT] Tactic: -377491875521947884 Time: 0.336172 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_11/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_11/add Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 Tactic: -37215280111360163 [TRT] Tactic: -37215280111360163 Time: 0.324843 [TRT] Fastest Tactic: -6576203419454146580 Time: 0.30987 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -6576203419454146580 [TRT] *************** Autotuning format combination: Float(207936,1,10944,576), Float(34656,1,1824,96) -> Float(34656,1,1824,96) *************** [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_11/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_11/add (CudnnConvolution) [TRT] CudnnConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_11/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_11/add (CublasConvolution) [TRT] CublasConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_11/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_11/add (CaskConvolution) [TRT] FeatureExtractor/MobilenetV2/expanded_conv_11/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_11/add Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 3886731678879822788 [TRT] Tactic: 3886731678879822788 Time: 0.326328 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_11/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_11/add Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 6629944304117643200 [TRT] Tactic: 6629944304117643200 Time: 0.474115 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_11/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_11/add Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -9153228964338181824 [TRT] Tactic: -9153228964338181824 Time: 0.457734 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_11/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_11/add Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -7394439838318485025 [TRT] Tactic: -7394439838318485025 Time: 0.328541 [TRT] Fastest Tactic: 3886731678879822788 Time: 0.326328 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3886731678879822788 [TRT] *************** Autotuning format combination: Half(207936,361,19,1), Half(34656,361,19,1) -> Half(34656,361,19,1) *************** [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_11/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_11/add (CudnnConvolution) [TRT] Tactic: 0 Time: 0.638699 [TRT] Tactic: 1 Time: 0.494089 [TRT] Tactic: 2 Time: 0.68586 [TRT] Tactic: 4 skipped. Scratch requested: 486531072, available: 33554432 [TRT] Tactic: 5 Time: 3.18268 [TRT] Fastest Tactic: 1 Time: 0.494089 [TRT] Setting workspace to 486531072enables more tactics for profiling [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_11/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_11/add (CublasConvolution) [TRT] CublasConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_11/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_11/add (CaskConvolution) [TRT] CaskConvolution has no valid tactics for this config, skipping [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 1 [TRT] *************** Autotuning format combination: Half(103968,361:2,19,1), Half(17328,361:2,19,1) -> Half(17328,361:2,19,1) *************** [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_11/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_11/add (FusedConvActConvolution) [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_11/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_11/add (CudnnConvolution) [TRT] CudnnConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_11/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_11/add (CublasConvolution) [TRT] CublasConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_11/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_11/add (CaskConvolution) [TRT] FeatureExtractor/MobilenetV2/expanded_conv_11/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_11/add Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 3066127711859985668 [TRT] Tactic: 3066127711859985668 Time: 0.159557 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_11/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_11/add Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 3564772625446233998 [TRT] Tactic: 3564772625446233998 Time: 0.182499 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_11/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_11/add Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: 5319956359050645452 [TRT] Tactic: 5319956359050645452 Time: 0.170182 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_11/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_11/add Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 7205456024582378848 [TRT] Tactic: 7205456024582378848 Time: 0.17513 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_11/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_11/add Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 8163473458334948789 [TRT] Tactic: 8163473458334948789 Time: 0.166041 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_11/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_11/add Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -4212163711445252890 [TRT] Tactic: -4212163711445252890 Time: 0.174271 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_11/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_11/add Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: -3898373634979201110 [TRT] Tactic: -3898373634979201110 Time: 0.17151 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_11/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_11/add Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: -2409163523992614473 [TRT] Tactic: -2409163523992614473 Time: 0.173021 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_11/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_11/add Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: -1716393687483585322 [TRT] Tactic: -1716393687483585322 Time: 0.164115 [TRT] Fastest Tactic: 3066127711859985668 Time: 0.159557 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3066127711859985668 [TRT] =============== Computing costs for [TRT] *************** Autotuning format combination: Float(34656,361,19,1) -> Float(207936,361,19,1) *************** [TRT] *************** Autotuning format combination: Float(34656,1,1824,96) -> Float(207936,1,10944,576) *************** [TRT] *************** Autotuning format combination: Half(34656,361,19,1) -> Half(207936,361,19,1) *************** [TRT] *************** Autotuning format combination: Half(17328,361:2,19,1) -> Half(207936,361,19,1) *************** [TRT] *************** Autotuning format combination: Half(17328,361:2,19,1) -> Half(103968,361:2,19,1) *************** [TRT] =============== Computing costs for [TRT] *************** Autotuning format combination: Float(207936,361,19,1) -> Float(207936,361,19,1) *************** [TRT] *************** Autotuning format combination: Float(207936,1,10944,576) -> Float(207936,1,10944,576) *************** [TRT] *************** Autotuning format combination: Half(207936,361,19,1) -> Half(207936,361,19,1) *************** [TRT] *************** Autotuning format combination: Half(103968,361:2,19,1) -> Half(103968,361:2,19,1) *************** [TRT] =============== Computing costs for [TRT] *************** Autotuning format combination: Float(207936,361,19,1), Float(34656,361,19,1) -> Float(34656,361,19,1) *************** [TRT] *************** Autotuning format combination: Float(207936,1,10944,576), Float(34656,1,1824,96) -> Float(34656,1,1824,96) *************** [TRT] *************** Autotuning format combination: Half(207936,361,19,1), Half(34656,361,19,1) -> Half(34656,361,19,1) *************** [TRT] *************** Autotuning format combination: Half(103968,361:2,19,1), Half(17328,361:2,19,1) -> Half(17328,361:2,19,1) *************** [TRT] =============== Computing costs for [TRT] *************** Autotuning format combination: Float(34656,361,19,1) -> Float(207936,361,19,1) *************** [TRT] *************** Autotuning format combination: Float(34656,1,1824,96) -> Float(207936,1,10944,576) *************** [TRT] *************** Autotuning format combination: Half(34656,361,19,1) -> Half(207936,361,19,1) *************** [TRT] *************** Autotuning format combination: Half(17328,361:2,19,1) -> Half(207936,361,19,1) *************** [TRT] *************** Autotuning format combination: Half(17328,361:2,19,1) -> Half(103968,361:2,19,1) *************** [TRT] =============== Computing costs for [TRT] *************** Autotuning format combination: Float(207936,361,19,1) -> Float(102885,361,19,1) *************** [TRT] --------------- Timing Runner: BoxPredictor_0/BoxEncodingPredictor/Conv2D || BoxPredictor_0/ClassPredictor/Conv2D (FusedConvActConvolution) [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: BoxPredictor_0/BoxEncodingPredictor/Conv2D || BoxPredictor_0/ClassPredictor/Conv2D (CudaDepthwiseConvolution) [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: BoxPredictor_0/BoxEncodingPredictor/Conv2D || BoxPredictor_0/ClassPredictor/Conv2D (CudnnConvolution) [TRT] Tactic: 0 Time: 13.2155 [TRT] Tactic: 1 Time: 6.81362 [TRT] Tactic: 2 Time: 11.3905 [TRT] Tactic: 4 skipped. Scratch requested: 1439772160, available: 33554432 [TRT] Tactic: 5 skipped. Scratch requested: 718171648, available: 33554432 [TRT] Tactic: 6 Time: 7.06685 [TRT] Fastest Tactic: 1 Time: 6.81362 [TRT] Setting workspace to 718171648enables more tactics for profiling [TRT] --------------- Timing Runner: BoxPredictor_0/BoxEncodingPredictor/Conv2D || BoxPredictor_0/ClassPredictor/Conv2D (CaskConvolution) [TRT] BoxPredictor_0/BoxEncodingPredictor/Conv2D || BoxPredictor_0/ClassPredictor/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758 [TRT] Tactic: 1062367460111450758 Time: 7.61901 [TRT] BoxPredictor_0/BoxEncodingPredictor/Conv2D || BoxPredictor_0/ClassPredictor/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v0 Tactic: 1754984623894446479 [TRT] Tactic: 1754984623894446479 Time: 9.04201 [TRT] BoxPredictor_0/BoxEncodingPredictor/Conv2D || BoxPredictor_0/ClassPredictor/Conv2D Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v0 Tactic: 3611739942397549984 [TRT] Tactic: 3611739942397549984 Time: 7.81565 [TRT] BoxPredictor_0/BoxEncodingPredictor/Conv2D || BoxPredictor_0/ClassPredictor/Conv2D Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v1 Tactic: 3827454225649558724 [TRT] Tactic: 3827454225649558724 Time: 8.07529 [TRT] BoxPredictor_0/BoxEncodingPredictor/Conv2D || BoxPredictor_0/ClassPredictor/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 Tactic: 4337000649858996379 [TRT] Tactic: 4337000649858996379 Time: 6.74891 [TRT] BoxPredictor_0/BoxEncodingPredictor/Conv2D || BoxPredictor_0/ClassPredictor/Conv2D Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441 [TRT] Tactic: 4501471010995462441 Time: 7.83872 [TRT] BoxPredictor_0/BoxEncodingPredictor/Conv2D || BoxPredictor_0/ClassPredictor/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826 [TRT] Tactic: 5137655947464784826 Time: 6.32185 [TRT] BoxPredictor_0/BoxEncodingPredictor/Conv2D || BoxPredictor_0/ClassPredictor/Conv2D Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929 [TRT] Tactic: 5288347012147084929 Time: 7.59039 [TRT] BoxPredictor_0/BoxEncodingPredictor/Conv2D || BoxPredictor_0/ClassPredictor/Conv2D Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148m_nt_v1 Tactic: 5921334924264294896 [TRT] Tactic: 5921334924264294896 Time: 6.30107 [TRT] BoxPredictor_0/BoxEncodingPredictor/Conv2D || BoxPredictor_0/ClassPredictor/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056 [TRT] Tactic: 6645123197870846056 Time: 6.57568 [TRT] BoxPredictor_0/BoxEncodingPredictor/Conv2D || BoxPredictor_0/ClassPredictor/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478 [TRT] Tactic: 7144526460361122478 Time: 7.86469 [TRT] BoxPredictor_0/BoxEncodingPredictor/Conv2D || BoxPredictor_0/ClassPredictor/Conv2D Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 Tactic: 7852627285308570038 [TRT] Tactic: 7852627285308570038 Time: 8.5219 [TRT] BoxPredictor_0/BoxEncodingPredictor/Conv2D || BoxPredictor_0/ClassPredictor/Conv2D Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 Tactic: -9137461792520977713 [TRT] Tactic: -9137461792520977713 Time: 7.98846 [TRT] BoxPredictor_0/BoxEncodingPredictor/Conv2D || BoxPredictor_0/ClassPredictor/Conv2D Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v0 Tactic: -8776506421218919509 [TRT] Tactic: -8776506421218919509 Time: 8.0338 [TRT] BoxPredictor_0/BoxEncodingPredictor/Conv2D || BoxPredictor_0/ClassPredictor/Conv2D Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730 [TRT] Tactic: -8262349710178828730 Time: 7.83122 [TRT] BoxPredictor_0/BoxEncodingPredictor/Conv2D || BoxPredictor_0/ClassPredictor/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v0 Tactic: -8133971918129952780 [TRT] Tactic: -8133971918129952780 Time: 7.47695 [TRT] BoxPredictor_0/BoxEncodingPredictor/Conv2D || BoxPredictor_0/ClassPredictor/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 Tactic: -6092040395344634144 [TRT] Tactic: -6092040395344634144 Time: 7.93232 [TRT] BoxPredictor_0/BoxEncodingPredictor/Conv2D || BoxPredictor_0/ClassPredictor/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159 [TRT] Tactic: -4787320710726427159 Time: 9.0007 [TRT] BoxPredictor_0/BoxEncodingPredictor/Conv2D || BoxPredictor_0/ClassPredictor/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839 [TRT] Tactic: -3456450830548107839 Time: 6.75539 [TRT] BoxPredictor_0/BoxEncodingPredictor/Conv2D || BoxPredictor_0/ClassPredictor/Conv2D Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v0 Tactic: -2318106587342035239 [TRT] Tactic: -2318106587342035239 Time: 8.30039 [TRT] BoxPredictor_0/BoxEncodingPredictor/Conv2D || BoxPredictor_0/ClassPredictor/Conv2D Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_mobile_relu_tile148t_nt_v0 Tactic: -1343271414618805657 [TRT] Tactic: -1343271414618805657 Time: 5.96276 [TRT] BoxPredictor_0/BoxEncodingPredictor/Conv2D || BoxPredictor_0/ClassPredictor/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241 [TRT] Tactic: -1218658103698133241 Time: 7.45815 [TRT] BoxPredictor_0/BoxEncodingPredictor/Conv2D || BoxPredictor_0/ClassPredictor/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091 [TRT] Tactic: -836875257600482091 Time: 7.04227 [TRT] BoxPredictor_0/BoxEncodingPredictor/Conv2D || BoxPredictor_0/ClassPredictor/Conv2D Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746 [TRT] Tactic: -410470605513481746 Time: 7.51393 [TRT] Fastest Tactic: -1343271414618805657 Time: 5.96276 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -1343271414618805657 [TRT] *************** Autotuning format combination: Float(207936,1,10944,576) -> Float(102885,1,5415,285) *************** [TRT] --------------- Timing Runner: BoxPredictor_0/BoxEncodingPredictor/Conv2D || BoxPredictor_0/ClassPredictor/Conv2D (CudnnConvolution) [TRT] CudnnConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: BoxPredictor_0/BoxEncodingPredictor/Conv2D || BoxPredictor_0/ClassPredictor/Conv2D (CaskConvolution) [TRT] CaskConvolution has no valid tactics for this config, skipping [TRT] *************** Autotuning format combination: Half(207936,361,19,1) -> Half(102885,361,19,1) *************** [TRT] --------------- Timing Runner: BoxPredictor_0/BoxEncodingPredictor/Conv2D || BoxPredictor_0/ClassPredictor/Conv2D (CudnnConvolution) [TRT] Tactic: 0 Time: 13.4185 [TRT] Tactic: 1 Time: 16.3679 [TRT] Tactic: 2 Time: 11.0449 [TRT] Tactic: 4 skipped. Scratch requested: 1439772160, available: 33554432 [TRT] Tactic: 5 skipped. Scratch requested: 718171648, available: 33554432 [TRT] Tactic: 6 Time: 8.59117 [TRT] Fastest Tactic: 6 Time: 8.59117 [TRT] Setting workspace to 718171648enables more tactics for profiling [TRT] --------------- Timing Runner: BoxPredictor_0/BoxEncodingPredictor/Conv2D || BoxPredictor_0/ClassPredictor/Conv2D (CaskConvolution) [TRT] CaskConvolution has no valid tactics for this config, skipping [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 6 [TRT] *************** Autotuning format combination: Half(103968,361:2,19,1) -> Half(51623,361:2,19,1) *************** [TRT] --------------- Timing Runner: BoxPredictor_0/BoxEncodingPredictor/Conv2D || BoxPredictor_0/ClassPredictor/Conv2D (FusedConvActConvolution) [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: BoxPredictor_0/BoxEncodingPredictor/Conv2D || BoxPredictor_0/ClassPredictor/Conv2D (CudnnConvolution) [TRT] CudnnConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: BoxPredictor_0/BoxEncodingPredictor/Conv2D || BoxPredictor_0/ClassPredictor/Conv2D (CaskConvolution) [TRT] BoxPredictor_0/BoxEncodingPredictor/Conv2D || BoxPredictor_0/ClassPredictor/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 3564772625446233998 [TRT] Tactic: 3564772625446233998 Time: 3.84659 [TRT] BoxPredictor_0/BoxEncodingPredictor/Conv2D || BoxPredictor_0/ClassPredictor/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 Tactic: 3650389455493082349 [TRT] Tactic: 3650389455493082349 Time: 3.9887 [TRT] BoxPredictor_0/BoxEncodingPredictor/Conv2D || BoxPredictor_0/ClassPredictor/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148m_nt_v1 Tactic: 4772821744921268633 [TRT] Tactic: 4772821744921268633 Time: 3.23227 [TRT] BoxPredictor_0/BoxEncodingPredictor/Conv2D || BoxPredictor_0/ClassPredictor/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: 5319956359050645452 [TRT] Tactic: 5319956359050645452 Time: 3.38005 [TRT] BoxPredictor_0/BoxEncodingPredictor/Conv2D || BoxPredictor_0/ClassPredictor/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 7205456024582378848 [TRT] Tactic: 7205456024582378848 Time: 3.287 [TRT] BoxPredictor_0/BoxEncodingPredictor/Conv2D || BoxPredictor_0/ClassPredictor/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 Tactic: -6490690591794140522 [TRT] Tactic: -6490690591794140522 Time: 3.37167 [TRT] BoxPredictor_0/BoxEncodingPredictor/Conv2D || BoxPredictor_0/ClassPredictor/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 Tactic: -4686027666808657977 [TRT] Tactic: -4686027666808657977 Time: 3.95508 [TRT] BoxPredictor_0/BoxEncodingPredictor/Conv2D || BoxPredictor_0/ClassPredictor/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -4212163711445252890 [TRT] Tactic: -4212163711445252890 Time: 3.71674 [TRT] BoxPredictor_0/BoxEncodingPredictor/Conv2D || BoxPredictor_0/ClassPredictor/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: -3898373634979201110 [TRT] Tactic: -3898373634979201110 Time: 3.84656 [TRT] BoxPredictor_0/BoxEncodingPredictor/Conv2D || BoxPredictor_0/ClassPredictor/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: -2409163523992614473 [TRT] Tactic: -2409163523992614473 Time: 3.20112 [TRT] Fastest Tactic: -2409163523992614473 Time: 3.20112 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -2409163523992614473 [TRT] =============== Computing costs for [TRT] *************** Autotuning format combination: Float(102885,361,19,1) -> Float(98553,91,1,1) *************** [TRT] --------------- Timing Runner: (Unnamed Layer* 404) [Shuffle] + BoxPredictor_0/Reshape_1 (Shuffle) [TRT] Tactic: 0 Time: 0.146016 [TRT] Fastest Tactic: 0 Time: 0.146016 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TRT] *************** Autotuning format combination: Float(102885,1,5415,285) -> Float(98553,1,1083,1083) *************** [TRT] --------------- Timing Runner: (Unnamed Layer* 404) [Shuffle] + BoxPredictor_0/Reshape_1 (Shuffle) [TRT] Tactic: 0 Time: 0.23 [TRT] Fastest Tactic: 0 Time: 0.23 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TRT] *************** Autotuning format combination: Float(3249,361:32,19,1) -> Float(3094,91:32,1,1) *************** [TRT] --------------- Timing Runner: (Unnamed Layer* 404) [Shuffle] + BoxPredictor_0/Reshape_1 (Shuffle) [TRT] Tactic: 0 Time: 0.234557 [TRT] Fastest Tactic: 0 Time: 0.234557 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TRT] *************** Autotuning format combination: Half(102885,361,19,1) -> Half(98553,91,1,1) *************** [TRT] --------------- Timing Runner: (Unnamed Layer* 404) [Shuffle] + BoxPredictor_0/Reshape_1 (Shuffle) [TRT] Tactic: 0 Time: 0.13 [TRT] Fastest Tactic: 0 Time: 0.13 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TRT] *************** Autotuning format combination: Half(51623,361:2,19,1) -> Half(49322,91:2,1,1) *************** [TRT] --------------- Timing Runner: (Unnamed Layer* 404) [Shuffle] + BoxPredictor_0/Reshape_1 (Shuffle) [TRT] Tactic: 0 Time: 0.185729 [TRT] Fastest Tactic: 0 Time: 0.185729 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TRT] =============== Computing costs for [TRT] *************** Autotuning format combination: Float(207936,361,19,1) -> Float(57600,100,10,1) *************** [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/Relu6) (CudaDepthwiseConvolution) [TRT] Tactic: -1 Time: 0.292292 [TRT] Fastest Tactic: -1 Time: 0.292292 [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/Relu6) (CudnnConvolution) [TRT] Tactic: 0 Time: 0.309636 [TRT] Tactic: 1 Time: 0.307292 [TRT] Tactic: 2 Time: 0.309922 [TRT] Tactic: 5 Time: 179.017 [TRT] Fastest Tactic: 1 Time: 0.307292 [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/Relu6) (CaskConvolution) [TRT] FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758 [TRT] Tactic: 1062367460111450758 Time: 16.0607 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v0 Tactic: 1754984623894446479 [TRT] Tactic: 1754984623894446479 Time: 17.5689 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v0 Tactic: 3611739942397549984 [TRT] Tactic: 3611739942397549984 Time: 17.3979 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 Tactic: 4337000649858996379 [TRT] Tactic: 4337000649858996379 Time: 17.4668 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441 [TRT] Tactic: 4501471010995462441 Time: 16.1172 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826 [TRT] Tactic: 5137655947464784826 Time: 16.2805 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929 [TRT] Tactic: 5288347012147084929 Time: 15.5675 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056 [TRT] Tactic: 6645123197870846056 Time: 16.794 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478 [TRT] Tactic: 7144526460361122478 Time: 16.0055 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 Tactic: -9137461792520977713 [TRT] Tactic: -9137461792520977713 Time: 17.6908 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730 [TRT] Tactic: -8262349710178828730 Time: 16.4635 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v0 Tactic: -8133971918129952780 [TRT] Tactic: -8133971918129952780 Time: 17.5793 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 Tactic: -6092040395344634144 [TRT] Tactic: -6092040395344634144 Time: 17.569 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159 [TRT] Tactic: -4787320710726427159 Time: 17.1556 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839 [TRT] Tactic: -3456450830548107839 Time: 16.5023 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241 [TRT] Tactic: -1218658103698133241 Time: 28.2962 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091 [TRT] Tactic: -836875257600482091 Time: 25.2102 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746 [TRT] Tactic: -410470605513481746 Time: 16.2922 [TRT] Fastest Tactic: 5288347012147084929 Time: 15.5675 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: -1 [TRT] *************** Autotuning format combination: Float(207936,1,10944,576) -> Float(57600,1,5760,576) *************** [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/Relu6) (CudnnConvolution) [TRT] CudnnConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/Relu6) (CaskConvolution) [TRT] CaskConvolution has no valid tactics for this config, skipping [TRT] *************** Autotuning format combination: Half(207936,361,19,1) -> Half(57600,100,10,1) *************** [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/Relu6) (CudnnConvolution) [TRT] Tactic: 0 Time: 0.244505 [TRT] Tactic: 1 Time: 0.243828 [TRT] Tactic: 2 Time: 27.9598 [TRT] Tactic: 5 Time: 179.218 [TRT] Fastest Tactic: 1 Time: 0.243828 [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/Relu6) (CaskConvolution) [TRT] CaskConvolution has no valid tactics for this config, skipping [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 1 [TRT] *************** Autotuning format combination: Half(103968,361:2,19,1) -> Half(28800,100:2,10,1) *************** [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/Relu6) (CaskConvolution) [TRT] CaskConvolution has no valid tactics for this config, skipping [TRT] =============== Computing costs for [TRT] *************** Autotuning format combination: Float(57600,100,10,1) -> Float(16000,100,10,1) *************** [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_13/project/Conv2D (FusedConvActConvolution) [TRT] Tactic: 589823 Time: 0.507292 [TRT] Tactic: 655359 Time: 0.398959 [TRT] Tactic: 786431 Time: 0.242448 [TRT] Tactic: 851967 Time: 0.408255 [TRT] Tactic: 1179647 Time: 0.467396 [TRT] Tactic: 1310719 Time: 1.01419 [TRT] Tactic: 1376255 Time: 0.471094 [TRT] Tactic: 1441791 Time: 0.333697 [TRT] Tactic: 1507327 Time: 0.395729 [TRT] Tactic: 1638399 Time: 0.330912 [TRT] Tactic: 1835007 Time: 0.328282 [TRT] Tactic: 1900543 Time: 0.48026 [TRT] Tactic: 2097151 Time: 0.438881 [TRT] Tactic: 2162687 Time: 0.274323 [TRT] Tactic: 2293759 Time: 0.476146 [TRT] Tactic: 2359295 Time: 0.297943 [TRT] Tactic: 2686975 Time: 0.253646 [TRT] Tactic: 3080191 Time: 0.47276 [TRT] Tactic: 3342335 Time: 0.38987 [TRT] Tactic: 3407871 Time: 0.402604 [TRT] Tactic: 3538943 Time: 0.395417 [TRT] Tactic: 3670015 Time: 0.243359 [TRT] Tactic: 3932159 Time: 0.413567 [TRT] Tactic: 3997695 Time: 0.249844 [TRT] Tactic: 4063231 Time: 0.552917 [TRT] Tactic: 4194303 Time: 0.376171 [TRT] Tactic: 4259839 Time: 0.467526 [TRT] Tactic: 4325375 Time: 0.297734 [TRT] Tactic: 4521983 Time: 0.285131 [TRT] Tactic: 4587519 Time: 0.485417 [TRT] Tactic: 4653055 Time: 0.532812 [TRT] Tactic: 4915199 Time: 0.381406 [TRT] Tactic: 4980735 Time: 0.356198 [TRT] Tactic: 5177343 Time: 0.432317 [TRT] Tactic: 5242879 Time: 0.321068 [TRT] Tactic: 5373951 Time: 0.473828 [TRT] Tactic: 5439487 Time: 0.336433 [TRT] Tactic: 5570559 Time: 0.392761 [TRT] Tactic: 5636095 Time: 0.550964 [TRT] Tactic: 5701631 Time: 0.453333 [TRT] Tactic: 5767167 Time: 0.57651 [TRT] Tactic: 5832703 Time: 0.398334 [TRT] Tactic: 5898239 Time: 0.359506 [TRT] Tactic: 6029311 Time: 0.449089 [TRT] Tactic: 6225919 Time: 0.336198 [TRT] Tactic: 6291455 Time: 0.461979 [TRT] Tactic: 6422527 Time: 0.441536 [TRT] Tactic: 6750207 Time: 0.343463 [TRT] Tactic: 6815743 Time: 0.322995 [TRT] Tactic: 6946815 Time: 0.505885 [TRT] Tactic: 7012351 Time: 0.440521 [TRT] Tactic: 7077887 Time: 0.38875 [TRT] Tactic: 7143423 Time: 0.646771 [TRT] Tactic: 7208959 Time: 0.331172 [TRT] Tactic: 7340031 Time: 0.372553 [TRT] Tactic: 7405567 Time: 0.44138 [TRT] Tactic: 7536639 Time: 0.375574 [TRT] Tactic: 7602175 Time: 0.492343 [TRT] Tactic: 7733247 Time: 0.383385 [TRT] Tactic: 7798783 Time: 0.241329 [TRT] Tactic: 8191999 Time: 0.532239 [TRT] Tactic: 8257535 Time: 0.380755 [TRT] Tactic: 8323071 Time: 0.334037 [TRT] Tactic: 8650751 Time: 0.417994 [TRT] Tactic: 8716287 Time: 0.33862 [TRT] Tactic: 9109503 Time: 0.456224 [TRT] Tactic: 9568255 Time: 0.378828 [TRT] Tactic: 9895935 Time: 0.375156 [TRT] Tactic: 10223615 Time: 0.25224 [TRT] Tactic: 10354687 Time: 0.478229 [TRT] Tactic: 10551295 Time: 0.341954 [TRT] Tactic: 10747903 Time: 0.378619 [TRT] Tactic: 10944511 Time: 0.356927 [TRT] Fastest Tactic: 7798783 Time: 0.241329 [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_13/project/Conv2D (CudaDepthwiseConvolution) [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_13/project/Conv2D (CudnnConvolution) [TRT] Tactic: 0 Time: 0.354948 [TRT] Tactic: 1 Time: 0.291276 [TRT] Tactic: 2 Time: 0.536901 [TRT] Tactic: 4 skipped. Scratch requested: 214032384, available: 33554432 [TRT] Tactic: 5 Time: 6.36794 [TRT] Fastest Tactic: 1 Time: 0.291276 [TRT] Setting workspace to 214032384enables more tactics for profiling [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_13/project/Conv2D (CublasConvolution) [TRT] CublasConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_13/project/Conv2D (CaskConvolution) [TRT] FeatureExtractor/MobilenetV2/expanded_conv_13/project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758 [TRT] Tactic: 1062367460111450758 Time: 0.203438 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_13/project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 Tactic: 1698681053543049347 [TRT] Tactic: 1698681053543049347 Time: 0.169062 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_13/project/Conv2D Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441 [TRT] Tactic: 4501471010995462441 Time: 0.211562 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_13/project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826 [TRT] Tactic: 5137655947464784826 Time: 0.173542 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_13/project/Conv2D Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929 [TRT] Tactic: 5288347012147084929 Time: 0.208933 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_13/project/Conv2D Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 Tactic: 5326823351883942011 [TRT] Tactic: 5326823351883942011 Time: 0.203177 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_13/project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 Tactic: 5500448035057547314 [TRT] Tactic: 5500448035057547314 Time: 0.191198 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_13/project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056 [TRT] Tactic: 6645123197870846056 Time: 0.179271 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_13/project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478 [TRT] Tactic: 7144526460361122478 Time: 0.177422 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_13/project/Conv2D Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730 [TRT] Tactic: -8262349710178828730 Time: 0.214011 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_13/project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 Tactic: -6576203419454146580 [TRT] Tactic: -6576203419454146580 Time: 0.183307 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_13/project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159 [TRT] Tactic: -4787320710726427159 Time: 0.185625 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_13/project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839 [TRT] Tactic: -3456450830548107839 Time: 0.200911 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_13/project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241 [TRT] Tactic: -1218658103698133241 Time: 0.194739 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_13/project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091 [TRT] Tactic: -836875257600482091 Time: 0.190077 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_13/project/Conv2D Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746 [TRT] Tactic: -410470605513481746 Time: 0.204792 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_13/project/Conv2D Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 Tactic: -377491875521947884 [TRT] Tactic: -377491875521947884 Time: 0.202292 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_13/project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 Tactic: -37215280111360163 [TRT] Tactic: -37215280111360163 Time: 0.171172 [TRT] Fastest Tactic: 1698681053543049347 Time: 0.169062 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 1698681053543049347 [TRT] *************** Autotuning format combination: Float(57600,1,5760,576) -> Float(16000,1,1600,160) *************** [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_13/project/Conv2D (CudnnConvolution) [TRT] CudnnConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_13/project/Conv2D (CublasConvolution) [TRT] CublasConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_13/project/Conv2D (CaskConvolution) [TRT] FeatureExtractor/MobilenetV2/expanded_conv_13/project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 3886731678879822788 [TRT] Tactic: 3886731678879822788 Time: 0.170676 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_13/project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 6629944304117643200 [TRT] Tactic: 6629944304117643200 Time: 0.225469 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_13/project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -9153228964338181824 [TRT] Tactic: -9153228964338181824 Time: 0.230599 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_13/project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -7394439838318485025 [TRT] Tactic: -7394439838318485025 Time: 0.173255 [TRT] Fastest Tactic: 3886731678879822788 Time: 0.170676 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3886731678879822788 [TRT] *************** Autotuning format combination: Half(57600,100,10,1) -> Half(16000,100,10,1) *************** [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_13/project/Conv2D (CudnnConvolution) [TRT] Tactic: 0 Time: 0.363515 [TRT] Tactic: 1 Time: 0.298542 [TRT] Tactic: 2 Time: 0.523828 [TRT] Tactic: 4 skipped. Scratch requested: 214032384, available: 33554432 [TRT] Tactic: 5 Time: 6.27276 [TRT] Fastest Tactic: 1 Time: 0.298542 [TRT] Setting workspace to 214032384enables more tactics for profiling [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_13/project/Conv2D (CublasConvolution) [TRT] CublasConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_13/project/Conv2D (CaskConvolution) [TRT] CaskConvolution has no valid tactics for this config, skipping [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 1 [TRT] *************** Autotuning format combination: Half(28800,100:2,10,1) -> Half(16000,100,10,1) *************** [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_13/project/Conv2D (CaskConvolution) [TRT] CaskConvolution has no valid tactics for this config, skipping [TRT] *************** Autotuning format combination: Half(28800,100:2,10,1) -> Half(8000,100:2,10,1) *************** [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_13/project/Conv2D (FusedConvActConvolution) [TRT] Tactic: 589823 Time: 0.238958 [TRT] Tactic: 655359 Time: 0.262605 [TRT] Tactic: 786431 Time: 0.169583 [TRT] Tactic: 851967 Time: 0.220702 [TRT] Tactic: 1179647 Time: 0.197787 [TRT] Tactic: 1310719 Time: 0.541667 [TRT] Tactic: 1376255 Time: 0.236068 [TRT] Tactic: 1441791 Time: 0.162943 [TRT] Tactic: 1507327 Time: 0.207969 [TRT] Tactic: 1638399 Time: 0.169349 [TRT] Tactic: 1835007 Time: 0.173855 [TRT] Tactic: 1900543 Time: 0.25651 [TRT] Tactic: 2097151 Time: 0.303098 [TRT] Tactic: 2162687 Time: 0.138568 [TRT] Tactic: 2293759 Time: 0.234661 [TRT] Tactic: 2359295 Time: 0.153802 [TRT] Tactic: 2686975 Time: 0.223125 [TRT] Tactic: 3080191 Time: 0.259843 [TRT] Tactic: 3342335 Time: 0.211979 [TRT] Tactic: 3407871 Time: 0.192708 [TRT] Tactic: 3538943 Time: 0.193359 [TRT] Tactic: 3670015 Time: 0.264609 [TRT] Tactic: 3932159 Time: 0.146771 [TRT] Tactic: 3997695 Time: 0.154635 [TRT] Tactic: 4063231 Time: 0.288698 [TRT] Tactic: 4194303 Time: 0.217969 [TRT] Tactic: 4259839 Time: 0.308698 [TRT] Tactic: 4325375 Time: 0.149271 [TRT] Tactic: 4521983 Time: 0.151823 [TRT] Tactic: 4587519 Time: 0.279454 [TRT] Tactic: 4653055 Time: 0.275156 [TRT] Tactic: 4915199 Time: 0.221979 [TRT] Tactic: 4980735 Time: 0.166692 [TRT] Tactic: 5177343 Time: 0.187083 [TRT] Tactic: 5242879 Time: 0.169531 [TRT] Tactic: 5373951 Time: 0.208255 [TRT] Tactic: 5439487 Time: 0.20151 [TRT] Tactic: 5570559 Time: 0.275052 [TRT] Tactic: 5636095 Time: 0.288984 [TRT] Tactic: 5701631 Time: 0.211849 [TRT] Tactic: 5767167 Time: 0.288151 [TRT] Tactic: 5832703 Time: 0.182865 [TRT] Tactic: 5898239 Time: 0.217422 [TRT] Tactic: 6029311 Time: 0.217032 [TRT] Tactic: 6225919 Time: 0.164036 [TRT] Tactic: 6291455 Time: 0.197786 [TRT] Tactic: 6422527 Time: 0.233568 [TRT] Tactic: 6750207 Time: 0.207239 [TRT] Tactic: 6815743 Time: 0.175052 [TRT] Tactic: 6946815 Time: 0.230651 [TRT] Tactic: 7012351 Time: 0.305261 [TRT] Tactic: 7077887 Time: 0.181458 [TRT] Tactic: 7143423 Time: 0.320417 [TRT] Tactic: 7208959 Time: 0.180079 [TRT] Tactic: 7340031 Time: 0.228593 [TRT] Tactic: 7405567 Time: 0.223411 [TRT] Tactic: 7536639 Time: 0.223854 [TRT] Tactic: 7602175 Time: 0.224375 [TRT] Tactic: 7733247 Time: 0.221198 [TRT] Tactic: 7798783 Time: 0.1694 [TRT] Tactic: 8191999 Time: 0.27961 [TRT] Tactic: 8257535 Time: 0.224349 [TRT] Tactic: 8323071 Time: 0.197552 [TRT] Tactic: 8650751 Time: 0.202994 [TRT] Tactic: 8716287 Time: 0.169114 [TRT] Tactic: 9109503 Time: 0.313985 [TRT] Tactic: 9568255 Time: 0.223932 [TRT] Tactic: 9895935 Time: 0.217292 [TRT] Tactic: 10223615 Time: 0.225729 [TRT] Tactic: 10354687 Time: 0.303984 [TRT] Tactic: 10551295 Time: 0.182265 [TRT] Tactic: 10747903 Time: 0.19638 [TRT] Tactic: 10944511 Time: 0.16711 [TRT] Fastest Tactic: 2162687 Time: 0.138568 [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_13/project/Conv2D (CudnnConvolution) [TRT] CudnnConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_13/project/Conv2D (CublasConvolution) [TRT] CublasConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_13/project/Conv2D (CaskConvolution) [TRT] FeatureExtractor/MobilenetV2/expanded_conv_13/project/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 3066127711859985668 [TRT] Tactic: 3066127711859985668 Time: 0.099661 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_13/project/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 3564772625446233998 [TRT] Tactic: 3564772625446233998 Time: 0.111484 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_13/project/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: 5319956359050645452 [TRT] Tactic: 5319956359050645452 Time: 0.101354 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_13/project/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 7205456024582378848 [TRT] Tactic: 7205456024582378848 Time: 0.097864 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_13/project/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 8163473458334948789 [TRT] Tactic: 8163473458334948789 Time: 0.088516 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_13/project/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -4212163711445252890 [TRT] Tactic: -4212163711445252890 Time: 0.108359 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_13/project/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: -3898373634979201110 [TRT] Tactic: -3898373634979201110 Time: 0.112838 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_13/project/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: -2409163523992614473 [TRT] Tactic: -2409163523992614473 Time: 0.094427 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_13/project/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: -1716393687483585322 [TRT] Tactic: -1716393687483585322 Time: 0.109063 [TRT] Fastest Tactic: 8163473458334948789 Time: 0.088516 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 8163473458334948789 [TRT] =============== Computing costs for [TRT] *************** Autotuning format combination: Float(16000,100,10,1) -> Float(96000,100,10,1) *************** [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Relu6) (FusedConvActConvolution) [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Relu6) (CudaDepthwiseConvolution) [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Relu6) (CudnnConvolution) [TRT] Tactic: 0 Time: 0.719141 [TRT] Tactic: 1 Time: 0.629843 [TRT] Tactic: 2 Time: 0.712031 [TRT] Tactic: 4 skipped. Scratch requested: 354877440, available: 33554432 [TRT] Tactic: 5 Time: 12.6868 [TRT] Fastest Tactic: 1 Time: 0.629843 [TRT] Setting workspace to 354877440enables more tactics for profiling [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Relu6) (CublasConvolution) [TRT] CublasConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Relu6) (CaskConvolution) [TRT] FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758 [TRT] Tactic: 1062367460111450758 Time: 0.321485 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 Tactic: 1698681053543049347 [TRT] Tactic: 1698681053543049347 Time: 0.28289 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441 [TRT] Tactic: 4501471010995462441 Time: 0.265468 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826 [TRT] Tactic: 5137655947464784826 Time: 0.248411 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929 [TRT] Tactic: 5288347012147084929 Time: 0.264089 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 Tactic: 5326823351883942011 [TRT] Tactic: 5326823351883942011 Time: 0.259141 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 Tactic: 5500448035057547314 [TRT] Tactic: 5500448035057547314 Time: 0.266537 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056 [TRT] Tactic: 6645123197870846056 Time: 0.257396 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478 [TRT] Tactic: 7144526460361122478 Time: 0.312005 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730 [TRT] Tactic: -8262349710178828730 Time: 0.269895 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 Tactic: -6576203419454146580 [TRT] Tactic: -6576203419454146580 Time: 0.280156 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159 [TRT] Tactic: -4787320710726427159 Time: 0.325157 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839 [TRT] Tactic: -3456450830548107839 Time: 0.307865 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241 [TRT] Tactic: -1218658103698133241 Time: 0.279974 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091 [TRT] Tactic: -836875257600482091 Time: 0.274218 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746 [TRT] Tactic: -410470605513481746 Time: 0.263516 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 Tactic: -377491875521947884 [TRT] Tactic: -377491875521947884 Time: 0.265573 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 Tactic: -37215280111360163 [TRT] Tactic: -37215280111360163 Time: 0.24362 [TRT] Fastest Tactic: -37215280111360163 Time: 0.24362 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -37215280111360163 [TRT] *************** Autotuning format combination: Float(16000,1,1600,160) -> Float(96000,1,9600,960) *************** [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Relu6) (CudnnConvolution) [TRT] CudnnConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Relu6) (CublasConvolution) [TRT] CublasConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Relu6) (CaskConvolution) [TRT] FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Relu6) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 3886731678879822788 [TRT] Tactic: 3886731678879822788 Time: 0.253776 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Relu6) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 6629944304117643200 [TRT] Tactic: 6629944304117643200 Time: 0.460286 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Relu6) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -9153228964338181824 [TRT] Tactic: -9153228964338181824 Time: 0.460573 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Relu6) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -7394439838318485025 [TRT] Tactic: -7394439838318485025 Time: 0.259948 [TRT] Fastest Tactic: 3886731678879822788 Time: 0.253776 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3886731678879822788 [TRT] *************** Autotuning format combination: Half(16000,100,10,1) -> Half(96000,100,10,1) *************** [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Relu6) (CudnnConvolution) [TRT] Tactic: 0 Time: 0.775234 [TRT] Tactic: 1 Time: 0.650391 [TRT] Tactic: 2 Time: 0.708932 [TRT] Tactic: 4 skipped. Scratch requested: 354877440, available: 33554432 [TRT] Tactic: 5 Time: 12.7817 [TRT] Fastest Tactic: 1 Time: 0.650391 [TRT] Setting workspace to 354877440enables more tactics for profiling [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Relu6) (CublasConvolution) [TRT] CublasConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Relu6) (CaskConvolution) [TRT] CaskConvolution has no valid tactics for this config, skipping [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 1 [TRT] *************** Autotuning format combination: Half(8000,100:2,10,1) -> Half(96000,100,10,1) *************** [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Relu6) (CaskConvolution) [TRT] CaskConvolution has no valid tactics for this config, skipping [TRT] *************** Autotuning format combination: Half(8000,100:2,10,1) -> Half(48000,100:2,10,1) *************** [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Relu6) (FusedConvActConvolution) [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Relu6) (CudnnConvolution) [TRT] CudnnConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Relu6) (CublasConvolution) [TRT] CublasConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Relu6) (CaskConvolution) [TRT] FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Relu6) Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 3066127711859985668 [TRT] Tactic: 3066127711859985668 Time: 0.160573 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Relu6) Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 3564772625446233998 [TRT] Tactic: 3564772625446233998 Time: 0.176276 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Relu6) Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: 5319956359050645452 [TRT] Tactic: 5319956359050645452 Time: 0.16539 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Relu6) Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 7205456024582378848 [TRT] Tactic: 7205456024582378848 Time: 0.141536 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Relu6) Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 8163473458334948789 [TRT] Tactic: 8163473458334948789 Time: 0.135573 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Relu6) Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -4212163711445252890 [TRT] Tactic: -4212163711445252890 Time: 0.140208 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Relu6) Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: -3898373634979201110 [TRT] Tactic: -3898373634979201110 Time: 0.145234 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Relu6) Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: -2409163523992614473 [TRT] Tactic: -2409163523992614473 Time: 0.138333 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Relu6) Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: -1716393687483585322 [TRT] Tactic: -1716393687483585322 Time: 0.140912 [TRT] Fastest Tactic: 8163473458334948789 Time: 0.135573 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 8163473458334948789 [TRT] =============== Computing costs for [TRT] *************** Autotuning format combination: Float(96000,100,10,1) -> Float(96000,100,10,1) *************** [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/Relu6) (CudaDepthwiseConvolution) [TRT] Tactic: -1 Time: 0.403073 [TRT] Fastest Tactic: -1 Time: 0.403073 [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/Relu6) (CudnnConvolution) [TRT] Tactic: 0 Time: 0.462812 [TRT] Tactic: 1 Time: 0.464323 [TRT] Tactic: 2 Time: 0.463177 [TRT] Tactic: 4 Time: 180.579 [TRT] Tactic: 5 Time: 301.482 [TRT] Tactic: 6 Time: 50.711 [TRT] Fastest Tactic: 0 Time: 0.462812 [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/Relu6) (CaskConvolution) [TRT] FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758 [TRT] Tactic: 1062367460111450758 Time: 27.5595 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v0 Tactic: 1754984623894446479 [TRT] Tactic: 1754984623894446479 Time: 29.8188 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v0 Tactic: 3611739942397549984 [TRT] Tactic: 3611739942397549984 Time: 29.6294 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/Relu6) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v1 Tactic: 3827454225649558724 [TRT] Tactic: 3827454225649558724 Time: 23.228 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 Tactic: 4337000649858996379 [TRT] Tactic: 4337000649858996379 Time: 29.5822 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441 [TRT] Tactic: 4501471010995462441 Time: 27.2446 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826 [TRT] Tactic: 5137655947464784826 Time: 27.2375 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929 [TRT] Tactic: 5288347012147084929 Time: 26.2659 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/Relu6) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148m_nt_v1 Tactic: 5921334924264294896 [TRT] Tactic: 5921334924264294896 Time: 23.322 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056 [TRT] Tactic: 6645123197870846056 Time: 28.6234 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478 [TRT] Tactic: 7144526460361122478 Time: 27.5845 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/Relu6) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 Tactic: 7852627285308570038 [TRT] Tactic: 7852627285308570038 Time: 23.2098 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 Tactic: -9137461792520977713 [TRT] Tactic: -9137461792520977713 Time: 30.1681 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/Relu6) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v0 Tactic: -8776506421218919509 [TRT] Tactic: -8776506421218919509 Time: 23.4565 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730 [TRT] Tactic: -8262349710178828730 Time: 27.551 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v0 Tactic: -8133971918129952780 [TRT] Tactic: -8133971918129952780 Time: 29.0309 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 Tactic: -6092040395344634144 [TRT] Tactic: -6092040395344634144 Time: 28.9557 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159 [TRT] Tactic: -4787320710726427159 Time: 28.6331 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839 [TRT] Tactic: -3456450830548107839 Time: 27.7369 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/Relu6) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v0 Tactic: -2318106587342035239 [TRT] Tactic: -2318106587342035239 Time: 23.0868 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/Relu6) Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_mobile_relu_tile148t_nt_v0 Tactic: -1343271414618805657 [TRT] Tactic: -1343271414618805657 Time: 23.3931 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241 [TRT] Tactic: -1218658103698133241 Time: 27.7177 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091 [TRT] Tactic: -836875257600482091 Time: 47.9286 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746 [TRT] Tactic: -410470605513481746 Time: 27.4511 [TRT] Fastest Tactic: -2318106587342035239 Time: 23.0868 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: -1 [TRT] *************** Autotuning format combination: Float(96000,1,9600,960) -> Float(96000,1,9600,960) *************** [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/Relu6) (CudnnConvolution) [TRT] CudnnConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/Relu6) (CaskConvolution) [TRT] CaskConvolution has no valid tactics for this config, skipping [TRT] *************** Autotuning format combination: Half(96000,100,10,1) -> Half(96000,100,10,1) *************** [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/Relu6) (CudnnConvolution) [TRT] Tactic: 0 Time: 0.328828 [TRT] Tactic: 1 Time: 0.328828 [TRT] Tactic: 2 Time: 0.483855 [TRT] Tactic: 4 Time: 136.44 [TRT] Tactic: 5 Time: 301.182 [TRT] Tactic: 6 Time: 293.221 [TRT] Fastest Tactic: 0 Time: 0.328828 [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/Relu6) (CaskConvolution) [TRT] CaskConvolution has no valid tactics for this config, skipping [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 0 [TRT] *************** Autotuning format combination: Half(48000,100:2,10,1) -> Half(48000,100:2,10,1) *************** [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/Relu6) (CaskConvolution) [TRT] CaskConvolution has no valid tactics for this config, skipping [TRT] =============== Computing costs for [TRT] *************** Autotuning format combination: Float(96000,100,10,1), Float(16000,100,10,1) -> Float(16000,100,10,1) *************** [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_14/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_14/add (FusedConvActConvolution) [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_14/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_14/add (CudaDepthwiseConvolution) [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_14/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_14/add (CudnnConvolution) [TRT] Tactic: 0 Time: 0.581927 [TRT] Tactic: 1 Time: 0.476927 [TRT] Tactic: 2 Time: 0.89138 [TRT] Tactic: 4 skipped. Scratch requested: 356720640, available: 33554432 [TRT] Tactic: 5 Time: 10.5809 [TRT] Fastest Tactic: 1 Time: 0.476927 [TRT] Setting workspace to 356720640enables more tactics for profiling [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_14/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_14/add (CublasConvolution) [TRT] CublasConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_14/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_14/add (CaskConvolution) [TRT] FeatureExtractor/MobilenetV2/expanded_conv_14/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_14/add Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758 [TRT] Tactic: 1062367460111450758 Time: 0.30875 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_14/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_14/add Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 Tactic: 1698681053543049347 [TRT] Tactic: 1698681053543049347 Time: 0.265755 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_14/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_14/add Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441 [TRT] Tactic: 4501471010995462441 Time: 0.335912 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_14/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_14/add Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826 [TRT] Tactic: 5137655947464784826 Time: 0.259687 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_14/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_14/add Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929 [TRT] Tactic: 5288347012147084929 Time: 0.330756 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_14/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_14/add Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 Tactic: 5326823351883942011 [TRT] Tactic: 5326823351883942011 Time: 0.323516 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_14/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_14/add Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 Tactic: 5500448035057547314 [TRT] Tactic: 5500448035057547314 Time: 0.293776 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_14/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_14/add Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056 [TRT] Tactic: 6645123197870846056 Time: 0.271848 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_14/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_14/add Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478 [TRT] Tactic: 7144526460361122478 Time: 0.277891 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_14/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_14/add Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730 [TRT] Tactic: -8262349710178828730 Time: 0.343333 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_14/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_14/add Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 Tactic: -6576203419454146580 [TRT] Tactic: -6576203419454146580 Time: 0.275599 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_14/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_14/add Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159 [TRT] Tactic: -4787320710726427159 Time: 0.290365 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_14/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_14/add Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839 [TRT] Tactic: -3456450830548107839 Time: 0.295287 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_14/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_14/add Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241 [TRT] Tactic: -1218658103698133241 Time: 0.311511 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_14/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_14/add Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091 [TRT] Tactic: -836875257600482091 Time: 0.301432 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_14/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_14/add Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746 [TRT] Tactic: -410470605513481746 Time: 0.332916 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_14/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_14/add Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 Tactic: -377491875521947884 [TRT] Tactic: -377491875521947884 Time: 0.337891 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_14/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_14/add Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 Tactic: -37215280111360163 [TRT] Tactic: -37215280111360163 Time: 0.258516 [TRT] Fastest Tactic: -37215280111360163 Time: 0.258516 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -37215280111360163 [TRT] *************** Autotuning format combination: Float(96000,1,9600,960), Float(16000,1,1600,160) -> Float(16000,1,1600,160) *************** [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_14/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_14/add (CudnnConvolution) [TRT] CudnnConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_14/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_14/add (CublasConvolution) [TRT] CublasConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_14/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_14/add (CaskConvolution) [TRT] FeatureExtractor/MobilenetV2/expanded_conv_14/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_14/add Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 3886731678879822788 [TRT] Tactic: 3886731678879822788 Time: 0.283724 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_14/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_14/add Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 6629944304117643200 [TRT] Tactic: 6629944304117643200 Time: 0.359583 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_14/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_14/add Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -9153228964338181824 [TRT] Tactic: -9153228964338181824 Time: 0.364114 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_14/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_14/add Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -7394439838318485025 [TRT] Tactic: -7394439838318485025 Time: 0.283463 [TRT] Fastest Tactic: -7394439838318485025 Time: 0.283463 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7394439838318485025 [TRT] *************** Autotuning format combination: Half(96000,100,10,1), Half(16000,100,10,1) -> Half(16000,100,10,1) *************** [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_14/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_14/add (CudnnConvolution) [TRT] Tactic: 0 Time: 0.611771 [TRT] Tactic: 1 Time: 0.499557 [TRT] Tactic: 2 Time: 0.898646 [TRT] Tactic: 4 skipped. Scratch requested: 356720640, available: 33554432 [TRT] Tactic: 5 Time: 10.4634 [TRT] Fastest Tactic: 1 Time: 0.499557 [TRT] Setting workspace to 356720640enables more tactics for profiling [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_14/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_14/add (CublasConvolution) [TRT] CublasConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_14/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_14/add (CaskConvolution) [TRT] CaskConvolution has no valid tactics for this config, skipping [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 1 [TRT] *************** Autotuning format combination: Half(48000,100:2,10,1), Half(8000,100:2,10,1) -> Half(8000,100:2,10,1) *************** [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_14/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_14/add (FusedConvActConvolution) [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_14/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_14/add (CudnnConvolution) [TRT] CudnnConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_14/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_14/add (CublasConvolution) [TRT] CublasConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_14/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_14/add (CaskConvolution) [TRT] FeatureExtractor/MobilenetV2/expanded_conv_14/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_14/add Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 3066127711859985668 [TRT] Tactic: 3066127711859985668 Time: 0.150182 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_14/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_14/add Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 3564772625446233998 [TRT] Tactic: 3564772625446233998 Time: 0.171276 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_14/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_14/add Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: 5319956359050645452 [TRT] Tactic: 5319956359050645452 Time: 0.159297 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_14/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_14/add Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 7205456024582378848 [TRT] Tactic: 7205456024582378848 Time: 0.145547 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_14/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_14/add Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 8163473458334948789 [TRT] Tactic: 8163473458334948789 Time: 0.140208 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_14/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_14/add Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -4212163711445252890 [TRT] Tactic: -4212163711445252890 Time: 0.171693 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_14/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_14/add Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: -3898373634979201110 [TRT] Tactic: -3898373634979201110 Time: 0.171641 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_14/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_14/add Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: -2409163523992614473 [TRT] Tactic: -2409163523992614473 Time: 0.14375 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_14/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_14/add Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: -1716393687483585322 [TRT] Tactic: -1716393687483585322 Time: 0.16961 [TRT] Fastest Tactic: 8163473458334948789 Time: 0.140208 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 8163473458334948789 [TRT] =============== Computing costs for [TRT] *************** Autotuning format combination: Float(16000,100,10,1) -> Float(96000,100,10,1) *************** [TRT] *************** Autotuning format combination: Float(16000,1,1600,160) -> Float(96000,1,9600,960) *************** [TRT] *************** Autotuning format combination: Half(16000,100,10,1) -> Half(96000,100,10,1) *************** [TRT] *************** Autotuning format combination: Half(8000,100:2,10,1) -> Half(96000,100,10,1) *************** [TRT] *************** Autotuning format combination: Half(8000,100:2,10,1) -> Half(48000,100:2,10,1) *************** [TRT] =============== Computing costs for [TRT] *************** Autotuning format combination: Float(96000,100,10,1) -> Float(96000,100,10,1) *************** [TRT] *************** Autotuning format combination: Float(96000,1,9600,960) -> Float(96000,1,9600,960) *************** [TRT] *************** Autotuning format combination: Half(96000,100,10,1) -> Half(96000,100,10,1) *************** [TRT] *************** Autotuning format combination: Half(48000,100:2,10,1) -> Half(48000,100:2,10,1) *************** [TRT] =============== Computing costs for [TRT] *************** Autotuning format combination: Float(96000,100,10,1), Float(16000,100,10,1) -> Float(16000,100,10,1) *************** [TRT] *************** Autotuning format combination: Float(96000,1,9600,960), Float(16000,1,1600,160) -> Float(16000,1,1600,160) *************** [TRT] *************** Autotuning format combination: Half(96000,100,10,1), Half(16000,100,10,1) -> Half(16000,100,10,1) *************** [TRT] *************** Autotuning format combination: Half(48000,100:2,10,1), Half(8000,100:2,10,1) -> Half(8000,100:2,10,1) *************** [TRT] =============== Computing costs for [TRT] *************** Autotuning format combination: Float(16000,100,10,1) -> Float(96000,100,10,1) *************** [TRT] *************** Autotuning format combination: Float(16000,1,1600,160) -> Float(96000,1,9600,960) *************** [TRT] *************** Autotuning format combination: Half(16000,100,10,1) -> Half(96000,100,10,1) *************** [TRT] *************** Autotuning format combination: Half(8000,100:2,10,1) -> Half(96000,100,10,1) *************** [TRT] *************** Autotuning format combination: Half(8000,100:2,10,1) -> Half(48000,100:2,10,1) *************** [TRT] =============== Computing costs for [TRT] *************** Autotuning format combination: Float(96000,100,10,1) -> Float(96000,100,10,1) *************** [TRT] *************** Autotuning format combination: Float(96000,1,9600,960) -> Float(96000,1,9600,960) *************** [TRT] *************** Autotuning format combination: Half(96000,100,10,1) -> Half(96000,100,10,1) *************** [TRT] *************** Autotuning format combination: Half(48000,100:2,10,1) -> Half(48000,100:2,10,1) *************** [TRT] =============== Computing costs for [TRT] *************** Autotuning format combination: Float(96000,100,10,1) -> Float(32000,100,10,1) *************** [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_16/project/Conv2D (FusedConvActConvolution) [TRT] Tactic: 589823 Time: 1.35141 [TRT] Tactic: 655359 Time: 0.965912 [TRT] Tactic: 786431 Time: 0.74737 [TRT] Tactic: 851967 Time: 1.01268 [TRT] Tactic: 1179647 Time: 1.21133 [TRT] Tactic: 1310719 Time: 2.90841 [TRT] Tactic: 1376255 Time: 0.970989 [TRT] Tactic: 1441791 Time: 0.869141 [TRT] Tactic: 1507327 Time: 0.883152 [TRT] Tactic: 1638399 Time: 1.02263 [TRT] Tactic: 1835007 Time: 0.925443 [TRT] Tactic: 1900543 Time: 0.831224 [TRT] Tactic: 2097151 Time: 1.36292 [TRT] Tactic: 2162687 Time: 0.529401 [TRT] Tactic: 2293759 Time: 1.03318 [TRT] Tactic: 2359295 Time: 0.748151 [TRT] Tactic: 2686975 Time: 0.784584 [TRT] Tactic: 3080191 Time: 1.15331 [TRT] Tactic: 3342335 Time: 0.892239 [TRT] Tactic: 3407871 Time: 1.03656 [TRT] Tactic: 3538943 Time: 1.16659 [TRT] Tactic: 3670015 Time: 0.501224 [TRT] Tactic: 3932159 Time: 0.755703 [TRT] Tactic: 3997695 Time: 0.754376 [TRT] Tactic: 4063231 Time: 1.36198 [TRT] Tactic: 4194303 Time: 1.17458 [TRT] Tactic: 4259839 Time: 1.44422 [TRT] Tactic: 4325375 Time: 0.868176 [TRT] Tactic: 4521983 Time: 0.956041 [TRT] Tactic: 4587519 Time: 1.52729 [TRT] Tactic: 4653055 Time: 1.42859 [TRT] Tactic: 4915199 Time: 1.17206 [TRT] Tactic: 4980735 Time: 0.920313 [TRT] Tactic: 5177343 Time: 1.18409 [TRT] Tactic: 5242879 Time: 0.993593 [TRT] Tactic: 5373951 Time: 1.32521 [TRT] Tactic: 5439487 Time: 1.07888 [TRT] Tactic: 5570559 Time: 0.958646 [TRT] Tactic: 5636095 Time: 1.35557 [TRT] Tactic: 5701631 Time: 0.933411 [TRT] Tactic: 5767167 Time: 1.76529 [TRT] Tactic: 5832703 Time: 1.03622 [TRT] Tactic: 5898239 Time: 0.952786 [TRT] Tactic: 6029311 Time: 0.953099 [TRT] Tactic: 6225919 Time: 1.06878 [TRT] Tactic: 6291455 Time: 1.23083 [TRT] Tactic: 6422527 Time: 1.00938 [TRT] Tactic: 6750207 Time: 1.14008 [TRT] Tactic: 6815743 Time: 1.00641 [TRT] Tactic: 6946815 Time: 1.53078 [TRT] Tactic: 7012351 Time: 1.3651 [TRT] Tactic: 7077887 Time: 1.16977 [TRT] Tactic: 7143423 Time: 1.93917 [TRT] Tactic: 7208959 Time: 1.00281 [TRT] Tactic: 7340031 Time: 0.984844 [TRT] Tactic: 7405567 Time: 1.23479 [TRT] Tactic: 7536639 Time: 1.32693 [TRT] Tactic: 7602175 Time: 1.4925 [TRT] Tactic: 7733247 Time: 1.02451 [TRT] Tactic: 7798783 Time: 0.750365 [TRT] Tactic: 8191999 Time: 1.74854 [TRT] Tactic: 8257535 Time: 1.17794 [TRT] Tactic: 8323071 Time: 1.06565 [TRT] Tactic: 8650751 Time: 1.35651 [TRT] Tactic: 8716287 Time: 1.10292 [TRT] Tactic: 9109503 Time: 1.3874 [TRT] Tactic: 9568255 Time: 1.17336 [TRT] Tactic: 9895935 Time: 1.17542 [TRT] Tactic: 10223615 Time: 0.790234 [TRT] Tactic: 10354687 Time: 1.4976 [TRT] Tactic: 10551295 Time: 1.09349 [TRT] Tactic: 10747903 Time: 1.00547 [TRT] Tactic: 10944511 Time: 0.921198 [TRT] Fastest Tactic: 3670015 Time: 0.501224 [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_16/project/Conv2D (CudaDepthwiseConvolution) [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_16/project/Conv2D (CudnnConvolution) [TRT] Tactic: 0 Time: 0.967083 [TRT] Tactic: 1 Time: 0.8175 [TRT] Tactic: 2 Time: 1.06797 [TRT] Tactic: 4 skipped. Scratch requested: 711229440, available: 33554432 [TRT] Tactic: 5 skipped. Scratch requested: 43520000, available: 33554432 [TRT] Fastest Tactic: 1 Time: 0.8175 [TRT] Setting workspace to 43520000enables more tactics for profiling [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_16/project/Conv2D (CublasConvolution) [TRT] CublasConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_16/project/Conv2D (CaskConvolution) [TRT] FeatureExtractor/MobilenetV2/expanded_conv_16/project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758 [TRT] Tactic: 1062367460111450758 Time: 0.542917 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_16/project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 Tactic: 1698681053543049347 [TRT] Tactic: 1698681053543049347 Time: 0.511536 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_16/project/Conv2D Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441 [TRT] Tactic: 4501471010995462441 Time: 0.519166 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_16/project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826 [TRT] Tactic: 5137655947464784826 Time: 0.485729 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_16/project/Conv2D Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929 [TRT] Tactic: 5288347012147084929 Time: 0.5225 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_16/project/Conv2D Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 Tactic: 5326823351883942011 [TRT] Tactic: 5326823351883942011 Time: 0.503828 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_16/project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 Tactic: 5500448035057547314 [TRT] Tactic: 5500448035057547314 Time: 0.5975 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_16/project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056 [TRT] Tactic: 6645123197870846056 Time: 0.501796 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_16/project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478 [TRT] Tactic: 7144526460361122478 Time: 0.535365 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_16/project/Conv2D Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730 [TRT] Tactic: -8262349710178828730 Time: 0.538777 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_16/project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 Tactic: -6576203419454146580 [TRT] Tactic: -6576203419454146580 Time: 0.475286 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_16/project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159 [TRT] Tactic: -4787320710726427159 Time: 0.567943 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_16/project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839 [TRT] Tactic: -3456450830548107839 Time: 0.500286 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_16/project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241 [TRT] Tactic: -1218658103698133241 Time: 0.629531 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_16/project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091 [TRT] Tactic: -836875257600482091 Time: 0.598619 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_16/project/Conv2D Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746 [TRT] Tactic: -410470605513481746 Time: 0.514557 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_16/project/Conv2D Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 Tactic: -377491875521947884 [TRT] Tactic: -377491875521947884 Time: 0.518984 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_16/project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 Tactic: -37215280111360163 [TRT] Tactic: -37215280111360163 Time: 0.475886 [TRT] Fastest Tactic: -6576203419454146580 Time: 0.475286 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -6576203419454146580 [TRT] *************** Autotuning format combination: Float(96000,1,9600,960) -> Float(32000,1,3200,320) *************** [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_16/project/Conv2D (CudnnConvolution) [TRT] CudnnConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_16/project/Conv2D (CublasConvolution) [TRT] CublasConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_16/project/Conv2D (CaskConvolution) [TRT] FeatureExtractor/MobilenetV2/expanded_conv_16/project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 3886731678879822788 [TRT] Tactic: 3886731678879822788 Time: 0.44427 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_16/project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 6629944304117643200 [TRT] Tactic: 6629944304117643200 Time: 0.66039 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_16/project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -9153228964338181824 [TRT] Tactic: -9153228964338181824 Time: 0.66164 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_16/project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -7394439838318485025 [TRT] Tactic: -7394439838318485025 Time: 0.441198 [TRT] Fastest Tactic: -7394439838318485025 Time: 0.441198 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7394439838318485025 [TRT] *************** Autotuning format combination: Half(96000,100,10,1) -> Half(32000,100,10,1) *************** [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_16/project/Conv2D (CudnnConvolution) [TRT] Tactic: 0 Time: 1.05904 [TRT] Tactic: 1 Time: 0.888646 [TRT] Tactic: 2 Time: 1.05474 [TRT] Tactic: 4 skipped. Scratch requested: 711229440, available: 33554432 [TRT] Tactic: 5 skipped. Scratch requested: 43520000, available: 33554432 [TRT] Fastest Tactic: 1 Time: 0.888646 [TRT] Setting workspace to 43520000enables more tactics for profiling [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_16/project/Conv2D (CublasConvolution) [TRT] CublasConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_16/project/Conv2D (CaskConvolution) [TRT] CaskConvolution has no valid tactics for this config, skipping [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 1 [TRT] *************** Autotuning format combination: Half(48000,100:2,10,1) -> Half(32000,100,10,1) *************** [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_16/project/Conv2D (CaskConvolution) [TRT] CaskConvolution has no valid tactics for this config, skipping [TRT] *************** Autotuning format combination: Half(48000,100:2,10,1) -> Half(16000,100:2,10,1) *************** [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_16/project/Conv2D (FusedConvActConvolution) [TRT] Tactic: 589823 Time: 0.623151 [TRT] Tactic: 655359 Time: 0.648906 [TRT] Tactic: 786431 Time: 0.464974 [TRT] Tactic: 851967 Time: 0.551328 [TRT] Tactic: 1179647 Time: 0.594479 [TRT] Tactic: 1310719 Time: 1.51029 [TRT] Tactic: 1376255 Time: 0.497526 [TRT] Tactic: 1441791 Time: 0.424766 [TRT] Tactic: 1507327 Time: 0.464011 [TRT] Tactic: 1638399 Time: 0.540157 [TRT] Tactic: 1835007 Time: 0.551276 [TRT] Tactic: 1900543 Time: 0.440833 [TRT] Tactic: 2097151 Time: 0.952605 [TRT] Tactic: 2162687 Time: 0.417682 [TRT] Tactic: 2293759 Time: 0.614427 [TRT] Tactic: 2359295 Time: 0.372891 [TRT] Tactic: 2686975 Time: 0.677474 [TRT] Tactic: 3080191 Time: 0.665339 [TRT] Tactic: 3342335 Time: 0.468177 [TRT] Tactic: 3407871 Time: 0.553177 [TRT] Tactic: 3538943 Time: 0.566745 [TRT] Tactic: 3670015 Time: 0.432786 [TRT] Tactic: 3932159 Time: 0.400807 [TRT] Tactic: 3997695 Time: 0.482709 [TRT] Tactic: 4063231 Time: 0.746511 [TRT] Tactic: 4194303 Time: 0.67487 [TRT] Tactic: 4259839 Time: 0.965886 [TRT] Tactic: 4325375 Time: 0.444453 [TRT] Tactic: 4521983 Time: 0.456329 [TRT] Tactic: 4587519 Time: 0.873568 [TRT] Tactic: 4653055 Time: 0.741276 [TRT] Tactic: 4915199 Time: 0.678308 [TRT] Tactic: 4980735 Time: 0.437578 [TRT] Tactic: 5177343 Time: 0.570235 [TRT] Tactic: 5242879 Time: 0.495 [TRT] Tactic: 5373951 Time: 0.629089 [TRT] Tactic: 5439487 Time: 0.660182 [TRT] Tactic: 5570559 Time: 0.681198 [TRT] Tactic: 5636095 Time: 0.743203 [TRT] Tactic: 5701631 Time: 0.466536 [TRT] Tactic: 5767167 Time: 0.865287 [TRT] Tactic: 5832703 Time: 0.544322 [TRT] Tactic: 5898239 Time: 0.578776 [TRT] Tactic: 6029311 Time: 0.563775 [TRT] Tactic: 6225919 Time: 0.520521 [TRT] Tactic: 6291455 Time: 0.59513 [TRT] Tactic: 6422527 Time: 0.568906 [TRT] Tactic: 6750207 Time: 0.67026 [TRT] Tactic: 6815743 Time: 0.497657 [TRT] Tactic: 6946815 Time: 0.745703 [TRT] Tactic: 7012351 Time: 0.949688 [TRT] Tactic: 7077887 Time: 0.560964 [TRT] Tactic: 7143423 Time: 0.975729 [TRT] Tactic: 7208959 Time: 0.488334 [TRT] Tactic: 7340031 Time: 0.618255 [TRT] Tactic: 7405567 Time: 0.643568 [TRT] Tactic: 7536639 Time: 0.704791 [TRT] Tactic: 7602175 Time: 0.720026 [TRT] Tactic: 7733247 Time: 0.592552 [TRT] Tactic: 7798783 Time: 0.463853 [TRT] Tactic: 8191999 Time: 0.888489 [TRT] Tactic: 8257535 Time: 0.683177 [TRT] Tactic: 8323071 Time: 0.64461 [TRT] Tactic: 8650751 Time: 0.653411 [TRT] Tactic: 8716287 Time: 0.53362 [TRT] Tactic: 9109503 Time: 0.996614 [TRT] Tactic: 9568255 Time: 0.675833 [TRT] Tactic: 9895935 Time: 0.680313 [TRT] Tactic: 10223615 Time: 0.674713 [TRT] Tactic: 10354687 Time: 0.963906 [TRT] Tactic: 10551295 Time: 0.5594 [TRT] Tactic: 10747903 Time: 0.521875 [TRT] Tactic: 10944511 Time: 0.436042 [TRT] Fastest Tactic: 2359295 Time: 0.372891 [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_16/project/Conv2D (CudnnConvolution) [TRT] CudnnConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_16/project/Conv2D (CublasConvolution) [TRT] CublasConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/expanded_conv_16/project/Conv2D (CaskConvolution) [TRT] FeatureExtractor/MobilenetV2/expanded_conv_16/project/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 3066127711859985668 [TRT] Tactic: 3066127711859985668 Time: 0.258359 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_16/project/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 3564772625446233998 [TRT] Tactic: 3564772625446233998 Time: 0.294245 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_16/project/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: 5319956359050645452 [TRT] Tactic: 5319956359050645452 Time: 0.270339 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_16/project/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 7205456024582378848 [TRT] Tactic: 7205456024582378848 Time: 0.245885 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_16/project/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 8163473458334948789 [TRT] Tactic: 8163473458334948789 Time: 0.233724 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_16/project/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -4212163711445252890 [TRT] Tactic: -4212163711445252890 Time: 0.261874 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_16/project/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: -3898373634979201110 [TRT] Tactic: -3898373634979201110 Time: 0.266068 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_16/project/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: -2409163523992614473 [TRT] Tactic: -2409163523992614473 Time: 0.239635 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_16/project/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: -1716393687483585322 [TRT] Tactic: -1716393687483585322 Time: 0.261224 [TRT] Fastest Tactic: 8163473458334948789 Time: 0.233724 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 8163473458334948789 [TRT] =============== Computing costs for [TRT] *************** Autotuning format combination: Float(32000,100,10,1) -> Float(128000,100,10,1) *************** [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/Conv_1/Conv2D + PWN(FeatureExtractor/MobilenetV2/Conv_1/Relu6) (FusedConvActConvolution) [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/Conv_1/Conv2D + PWN(FeatureExtractor/MobilenetV2/Conv_1/Relu6) (CudaDepthwiseConvolution) [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/Conv_1/Conv2D + PWN(FeatureExtractor/MobilenetV2/Conv_1/Relu6) (CudnnConvolution) [TRT] Tactic: 0 Time: 1.50146 [TRT] Tactic: 1 Time: 1.28997 [TRT] Tactic: 2 Time: 1.30635 [TRT] Tactic: 4 skipped. Scratch requested: 946094080, available: 33554432 [TRT] Tactic: 5 skipped. Scratch requested: 57881600, available: 33554432 [TRT] Fastest Tactic: 1 Time: 1.28997 [TRT] Setting workspace to 57881600enables more tactics for profiling [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/Conv_1/Conv2D + PWN(FeatureExtractor/MobilenetV2/Conv_1/Relu6) (CublasConvolution) [TRT] CublasConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/Conv_1/Conv2D + PWN(FeatureExtractor/MobilenetV2/Conv_1/Relu6) (CaskConvolution) [TRT] FeatureExtractor/MobilenetV2/Conv_1/Conv2D + PWN(FeatureExtractor/MobilenetV2/Conv_1/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758 [TRT] Tactic: 1062367460111450758 Time: 0.744506 [TRT] FeatureExtractor/MobilenetV2/Conv_1/Conv2D + PWN(FeatureExtractor/MobilenetV2/Conv_1/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 Tactic: 1698681053543049347 [TRT] Tactic: 1698681053543049347 Time: 0.675182 [TRT] FeatureExtractor/MobilenetV2/Conv_1/Conv2D + PWN(FeatureExtractor/MobilenetV2/Conv_1/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441 [TRT] Tactic: 4501471010995462441 Time: 0.603281 [TRT] FeatureExtractor/MobilenetV2/Conv_1/Conv2D + PWN(FeatureExtractor/MobilenetV2/Conv_1/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826 [TRT] Tactic: 5137655947464784826 Time: 0.582605 [TRT] FeatureExtractor/MobilenetV2/Conv_1/Conv2D + PWN(FeatureExtractor/MobilenetV2/Conv_1/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929 [TRT] Tactic: 5288347012147084929 Time: 0.589479 [TRT] FeatureExtractor/MobilenetV2/Conv_1/Conv2D + PWN(FeatureExtractor/MobilenetV2/Conv_1/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 Tactic: 5326823351883942011 [TRT] Tactic: 5326823351883942011 Time: 0.570026 [TRT] FeatureExtractor/MobilenetV2/Conv_1/Conv2D + PWN(FeatureExtractor/MobilenetV2/Conv_1/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 Tactic: 5500448035057547314 [TRT] Tactic: 5500448035057547314 Time: 0.651224 [TRT] FeatureExtractor/MobilenetV2/Conv_1/Conv2D + PWN(FeatureExtractor/MobilenetV2/Conv_1/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056 [TRT] Tactic: 6645123197870846056 Time: 0.598593 [TRT] FeatureExtractor/MobilenetV2/Conv_1/Conv2D + PWN(FeatureExtractor/MobilenetV2/Conv_1/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478 [TRT] Tactic: 7144526460361122478 Time: 0.766979 [TRT] FeatureExtractor/MobilenetV2/Conv_1/Conv2D + PWN(FeatureExtractor/MobilenetV2/Conv_1/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730 [TRT] Tactic: -8262349710178828730 Time: 0.601562 [TRT] FeatureExtractor/MobilenetV2/Conv_1/Conv2D + PWN(FeatureExtractor/MobilenetV2/Conv_1/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 Tactic: -6576203419454146580 [TRT] Tactic: -6576203419454146580 Time: 0.649427 [TRT] FeatureExtractor/MobilenetV2/Conv_1/Conv2D + PWN(FeatureExtractor/MobilenetV2/Conv_1/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159 [TRT] Tactic: -4787320710726427159 Time: 0.801042 [TRT] FeatureExtractor/MobilenetV2/Conv_1/Conv2D + PWN(FeatureExtractor/MobilenetV2/Conv_1/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839 [TRT] Tactic: -3456450830548107839 Time: 0.689922 [TRT] FeatureExtractor/MobilenetV2/Conv_1/Conv2D + PWN(FeatureExtractor/MobilenetV2/Conv_1/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241 [TRT] Tactic: -1218658103698133241 Time: 0.67112 [TRT] FeatureExtractor/MobilenetV2/Conv_1/Conv2D + PWN(FeatureExtractor/MobilenetV2/Conv_1/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091 [TRT] Tactic: -836875257600482091 Time: 0.687995 [TRT] FeatureExtractor/MobilenetV2/Conv_1/Conv2D + PWN(FeatureExtractor/MobilenetV2/Conv_1/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746 [TRT] Tactic: -410470605513481746 Time: 0.576303 [TRT] FeatureExtractor/MobilenetV2/Conv_1/Conv2D + PWN(FeatureExtractor/MobilenetV2/Conv_1/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 Tactic: -377491875521947884 [TRT] Tactic: -377491875521947884 Time: 0.586459 [TRT] FeatureExtractor/MobilenetV2/Conv_1/Conv2D + PWN(FeatureExtractor/MobilenetV2/Conv_1/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 Tactic: -37215280111360163 [TRT] Tactic: -37215280111360163 Time: 0.570807 [TRT] Fastest Tactic: 5326823351883942011 Time: 0.570026 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5326823351883942011 [TRT] *************** Autotuning format combination: Float(32000,1,3200,320) -> Float(128000,1,12800,1280) *************** [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/Conv_1/Conv2D + PWN(FeatureExtractor/MobilenetV2/Conv_1/Relu6) (CudnnConvolution) [TRT] CudnnConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/Conv_1/Conv2D + PWN(FeatureExtractor/MobilenetV2/Conv_1/Relu6) (CublasConvolution) [TRT] CublasConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/Conv_1/Conv2D + PWN(FeatureExtractor/MobilenetV2/Conv_1/Relu6) (CaskConvolution) [TRT] FeatureExtractor/MobilenetV2/Conv_1/Conv2D + PWN(FeatureExtractor/MobilenetV2/Conv_1/Relu6) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 3886731678879822788 [TRT] Tactic: 3886731678879822788 Time: 0.602292 [TRT] FeatureExtractor/MobilenetV2/Conv_1/Conv2D + PWN(FeatureExtractor/MobilenetV2/Conv_1/Relu6) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 6629944304117643200 [TRT] Tactic: 6629944304117643200 Time: 0.900365 [TRT] FeatureExtractor/MobilenetV2/Conv_1/Conv2D + PWN(FeatureExtractor/MobilenetV2/Conv_1/Relu6) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -9153228964338181824 [TRT] Tactic: -9153228964338181824 Time: 0.900339 [TRT] FeatureExtractor/MobilenetV2/Conv_1/Conv2D + PWN(FeatureExtractor/MobilenetV2/Conv_1/Relu6) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -7394439838318485025 [TRT] Tactic: -7394439838318485025 Time: 0.600495 [TRT] Fastest Tactic: -7394439838318485025 Time: 0.600495 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7394439838318485025 [TRT] *************** Autotuning format combination: Half(32000,100,10,1) -> Half(128000,100,10,1) *************** [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/Conv_1/Conv2D + PWN(FeatureExtractor/MobilenetV2/Conv_1/Relu6) (CudnnConvolution) [TRT] Tactic: 0 Time: 1.6437 [TRT] Tactic: 1 Time: 1.33284 [TRT] Tactic: 2 Time: 1.29721 [TRT] Tactic: 4 skipped. Scratch requested: 946094080, available: 33554432 [TRT] Tactic: 5 skipped. Scratch requested: 57881600, available: 33554432 [TRT] Fastest Tactic: 2 Time: 1.29721 [TRT] Setting workspace to 57881600enables more tactics for profiling [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/Conv_1/Conv2D + PWN(FeatureExtractor/MobilenetV2/Conv_1/Relu6) (CublasConvolution) [TRT] CublasConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/Conv_1/Conv2D + PWN(FeatureExtractor/MobilenetV2/Conv_1/Relu6) (CaskConvolution) [TRT] CaskConvolution has no valid tactics for this config, skipping [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 2 [TRT] *************** Autotuning format combination: Half(16000,100:2,10,1) -> Half(128000,100,10,1) *************** [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/Conv_1/Conv2D + PWN(FeatureExtractor/MobilenetV2/Conv_1/Relu6) (CaskConvolution) [TRT] CaskConvolution has no valid tactics for this config, skipping [TRT] *************** Autotuning format combination: Half(16000,100:2,10,1) -> Half(64000,100:2,10,1) *************** [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/Conv_1/Conv2D + PWN(FeatureExtractor/MobilenetV2/Conv_1/Relu6) (FusedConvActConvolution) [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/Conv_1/Conv2D + PWN(FeatureExtractor/MobilenetV2/Conv_1/Relu6) (CudnnConvolution) [TRT] CudnnConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/Conv_1/Conv2D + PWN(FeatureExtractor/MobilenetV2/Conv_1/Relu6) (CublasConvolution) [TRT] CublasConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/Conv_1/Conv2D + PWN(FeatureExtractor/MobilenetV2/Conv_1/Relu6) (CaskConvolution) [TRT] FeatureExtractor/MobilenetV2/Conv_1/Conv2D + PWN(FeatureExtractor/MobilenetV2/Conv_1/Relu6) Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 3066127711859985668 [TRT] Tactic: 3066127711859985668 Time: 0.345235 [TRT] FeatureExtractor/MobilenetV2/Conv_1/Conv2D + PWN(FeatureExtractor/MobilenetV2/Conv_1/Relu6) Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 3564772625446233998 [TRT] Tactic: 3564772625446233998 Time: 0.399531 [TRT] FeatureExtractor/MobilenetV2/Conv_1/Conv2D + PWN(FeatureExtractor/MobilenetV2/Conv_1/Relu6) Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: 5319956359050645452 [TRT] Tactic: 5319956359050645452 Time: 0.362787 [TRT] FeatureExtractor/MobilenetV2/Conv_1/Conv2D + PWN(FeatureExtractor/MobilenetV2/Conv_1/Relu6) Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 7205456024582378848 [TRT] Tactic: 7205456024582378848 Time: 0.317317 [TRT] FeatureExtractor/MobilenetV2/Conv_1/Conv2D + PWN(FeatureExtractor/MobilenetV2/Conv_1/Relu6) Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 8163473458334948789 [TRT] Tactic: 8163473458334948789 Time: 0.30487 [TRT] FeatureExtractor/MobilenetV2/Conv_1/Conv2D + PWN(FeatureExtractor/MobilenetV2/Conv_1/Relu6) Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -4212163711445252890 [TRT] Tactic: -4212163711445252890 Time: 0.305546 [TRT] FeatureExtractor/MobilenetV2/Conv_1/Conv2D + PWN(FeatureExtractor/MobilenetV2/Conv_1/Relu6) Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: -3898373634979201110 [TRT] Tactic: -3898373634979201110 Time: 0.314948 [TRT] FeatureExtractor/MobilenetV2/Conv_1/Conv2D + PWN(FeatureExtractor/MobilenetV2/Conv_1/Relu6) Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: -2409163523992614473 [TRT] Tactic: -2409163523992614473 Time: 0.310728 [TRT] FeatureExtractor/MobilenetV2/Conv_1/Conv2D + PWN(FeatureExtractor/MobilenetV2/Conv_1/Relu6) Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: -1716393687483585322 [TRT] Tactic: -1716393687483585322 Time: 0.300912 [TRT] Fastest Tactic: -1716393687483585322 Time: 0.300912 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -1716393687483585322 [TRT] =============== Computing costs for [TRT] *************** Autotuning format combination: Float(128000,100,10,1) -> Float(57000,100,10,1) *************** [TRT] --------------- Timing Runner: BoxPredictor_1/BoxEncodingPredictor/Conv2D || BoxPredictor_1/ClassPredictor/Conv2D (FusedConvActConvolution) [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: BoxPredictor_1/BoxEncodingPredictor/Conv2D || BoxPredictor_1/ClassPredictor/Conv2D (CudaDepthwiseConvolution) [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: BoxPredictor_1/BoxEncodingPredictor/Conv2D || BoxPredictor_1/ClassPredictor/Conv2D (CudnnConvolution) [TRT] Tactic: 0 Time: 19.0951 [TRT] Tactic: 1 Time: 10.2048 [TRT] Tactic: 2 Time: 14.3017 [TRT] Tactic: 4 skipped. Scratch requested: 1710213120, available: 33554432 [TRT] Tactic: 6 skipped. Scratch requested: 73457152, available: 33554432 [TRT] Fastest Tactic: 1 Time: 10.2048 [TRT] Setting workspace to 73457152enables more tactics for profiling [TRT] --------------- Timing Runner: BoxPredictor_1/BoxEncodingPredictor/Conv2D || BoxPredictor_1/ClassPredictor/Conv2D (CaskConvolution) [TRT] BoxPredictor_1/BoxEncodingPredictor/Conv2D || BoxPredictor_1/ClassPredictor/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758 [TRT] Tactic: 1062367460111450758 Time: 11.4025 [TRT] BoxPredictor_1/BoxEncodingPredictor/Conv2D || BoxPredictor_1/ClassPredictor/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v0 Tactic: 1754984623894446479 [TRT] Tactic: 1754984623894446479 Time: 14.7766 [TRT] BoxPredictor_1/BoxEncodingPredictor/Conv2D || BoxPredictor_1/ClassPredictor/Conv2D Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v0 Tactic: 3611739942397549984 [TRT] Tactic: 3611739942397549984 Time: 10.2235 [TRT] BoxPredictor_1/BoxEncodingPredictor/Conv2D || BoxPredictor_1/ClassPredictor/Conv2D Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v1 Tactic: 3827454225649558724 [TRT] Tactic Device request: 70MB Available: 48MB. Device memory is insufficient to use tactic. [TRT] Skipping tactic 3 due to insuficient memory on requested size of 70 detected for tactic 3827454225649558724. [TRT] BoxPredictor_1/BoxEncodingPredictor/Conv2D || BoxPredictor_1/ClassPredictor/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 Tactic: 4337000649858996379 [TRT] Tactic: 4337000649858996379 Time: 12.4643 [TRT] BoxPredictor_1/BoxEncodingPredictor/Conv2D || BoxPredictor_1/ClassPredictor/Conv2D Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441 [TRT] Tactic: 4501471010995462441 Time: 10.2435 [TRT] BoxPredictor_1/BoxEncodingPredictor/Conv2D || BoxPredictor_1/ClassPredictor/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826 [TRT] Tactic: 5137655947464784826 Time: 10.0833 [TRT] BoxPredictor_1/BoxEncodingPredictor/Conv2D || BoxPredictor_1/ClassPredictor/Conv2D Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929 [TRT] Tactic: 5288347012147084929 Time: 10.2012 [TRT] BoxPredictor_1/BoxEncodingPredictor/Conv2D || BoxPredictor_1/ClassPredictor/Conv2D Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148m_nt_v1 Tactic: 5921334924264294896 [TRT] Tactic Device request: 70MB Available: 51MB. Device memory is insufficient to use tactic. [TRT] Skipping tactic 8 due to insuficient memory on requested size of 70 detected for tactic 5921334924264294896. [TRT] BoxPredictor_1/BoxEncodingPredictor/Conv2D || BoxPredictor_1/ClassPredictor/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056 [TRT] Tactic: 6645123197870846056 Time: 10.0463 [TRT] BoxPredictor_1/BoxEncodingPredictor/Conv2D || BoxPredictor_1/ClassPredictor/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478 [TRT] Tactic: 7144526460361122478 Time: 12.4627 [TRT] BoxPredictor_1/BoxEncodingPredictor/Conv2D || BoxPredictor_1/ClassPredictor/Conv2D Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 Tactic: 7852627285308570038 [TRT] Tactic Device request: 70MB Available: 50MB. Device memory is insufficient to use tactic. [TRT] Skipping tactic 11 due to insuficient memory on requested size of 70 detected for tactic 7852627285308570038. [TRT] BoxPredictor_1/BoxEncodingPredictor/Conv2D || BoxPredictor_1/ClassPredictor/Conv2D Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 Tactic: -9137461792520977713 [TRT] Tactic: -9137461792520977713 Time: 10.4729 [TRT] BoxPredictor_1/BoxEncodingPredictor/Conv2D || BoxPredictor_1/ClassPredictor/Conv2D Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v0 Tactic: -8776506421218919509 [TRT] Tactic Device request: 70MB Available: 50MB. Device memory is insufficient to use tactic. [TRT] Skipping tactic 13 due to insuficient memory on requested size of 70 detected for tactic -8776506421218919509. [TRT] BoxPredictor_1/BoxEncodingPredictor/Conv2D || BoxPredictor_1/ClassPredictor/Conv2D Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730 [TRT] Tactic: -8262349710178828730 Time: 10.2429 [TRT] BoxPredictor_1/BoxEncodingPredictor/Conv2D || BoxPredictor_1/ClassPredictor/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v0 Tactic: -8133971918129952780 [TRT] Tactic: -8133971918129952780 Time: 12.3926 [TRT] BoxPredictor_1/BoxEncodingPredictor/Conv2D || BoxPredictor_1/ClassPredictor/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 Tactic: -6092040395344634144 [TRT] Tactic: -6092040395344634144 Time: 11.9088 [TRT] BoxPredictor_1/BoxEncodingPredictor/Conv2D || BoxPredictor_1/ClassPredictor/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159 [TRT] Tactic: -4787320710726427159 Time: 14.7639 [TRT] BoxPredictor_1/BoxEncodingPredictor/Conv2D || BoxPredictor_1/ClassPredictor/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839 [TRT] Tactic: -3456450830548107839 Time: 9.78526 [TRT] BoxPredictor_1/BoxEncodingPredictor/Conv2D || BoxPredictor_1/ClassPredictor/Conv2D Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v0 Tactic: -2318106587342035239 [TRT] Tactic Device request: 70MB Available: 50MB. Device memory is insufficient to use tactic. [TRT] Skipping tactic 19 due to insuficient memory on requested size of 70 detected for tactic -2318106587342035239. [TRT] BoxPredictor_1/BoxEncodingPredictor/Conv2D || BoxPredictor_1/ClassPredictor/Conv2D Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_mobile_relu_tile148t_nt_v0 Tactic: -1343271414618805657 [TRT] Tactic Device request: 70MB Available: 49MB. Device memory is insufficient to use tactic. [TRT] Skipping tactic 20 due to insuficient memory on requested size of 70 detected for tactic -1343271414618805657. [TRT] BoxPredictor_1/BoxEncodingPredictor/Conv2D || BoxPredictor_1/ClassPredictor/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241 [TRT] Tactic: -1218658103698133241 Time: 12.6533 [TRT] BoxPredictor_1/BoxEncodingPredictor/Conv2D || BoxPredictor_1/ClassPredictor/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091 [TRT] Tactic: -836875257600482091 Time: 11.8816 [TRT] BoxPredictor_1/BoxEncodingPredictor/Conv2D || BoxPredictor_1/ClassPredictor/Conv2D Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746 [TRT] Tactic: -410470605513481746 Time: 9.81622 [TRT] Fastest Tactic: -3456450830548107839 Time: 9.78526 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -3456450830548107839 [TRT] *************** Autotuning format combination: Float(128000,1,12800,1280) -> Float(57000,1,5700,570) *************** [TRT] --------------- Timing Runner: BoxPredictor_1/BoxEncodingPredictor/Conv2D || BoxPredictor_1/ClassPredictor/Conv2D (CudnnConvolution) [TRT] CudnnConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: BoxPredictor_1/BoxEncodingPredictor/Conv2D || BoxPredictor_1/ClassPredictor/Conv2D (CaskConvolution) [TRT] CaskConvolution has no valid tactics for this config, skipping [TRT] *************** Autotuning format combination: Half(128000,100,10,1) -> Half(57000,100,10,1) *************** [TRT] --------------- Timing Runner: BoxPredictor_1/BoxEncodingPredictor/Conv2D || BoxPredictor_1/ClassPredictor/Conv2D (CudnnConvolution) [TRT] Tactic: 0 Time: 20.3841 [TRT] Tactic: 1 Time: 20.4104 [TRT] Tactic: 2 Time: 14.2059 [TRT] Tactic: 4 skipped. Scratch requested: 1710213120, available: 33554432 [TRT] Tactic: 6 skipped. Scratch requested: 100462592, available: 33554432 [TRT] Fastest Tactic: 2 Time: 14.2059 [TRT] Setting workspace to 100462592enables more tactics for profiling [TRT] --------------- Timing Runner: BoxPredictor_1/BoxEncodingPredictor/Conv2D || BoxPredictor_1/ClassPredictor/Conv2D (CaskConvolution) [TRT] CaskConvolution has no valid tactics for this config, skipping [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 2 [TRT] *************** Autotuning format combination: Half(64000,100:2,10,1) -> Half(28500,100:2,10,1) *************** [TRT] --------------- Timing Runner: BoxPredictor_1/BoxEncodingPredictor/Conv2D || BoxPredictor_1/ClassPredictor/Conv2D (FusedConvActConvolution) [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: BoxPredictor_1/BoxEncodingPredictor/Conv2D || BoxPredictor_1/ClassPredictor/Conv2D (CudnnConvolution) [TRT] CudnnConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: BoxPredictor_1/BoxEncodingPredictor/Conv2D || BoxPredictor_1/ClassPredictor/Conv2D (CaskConvolution) [TRT] BoxPredictor_1/BoxEncodingPredictor/Conv2D || BoxPredictor_1/ClassPredictor/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 3564772625446233998 [TRT] Tactic: 3564772625446233998 Time: 5.73779 [TRT] BoxPredictor_1/BoxEncodingPredictor/Conv2D || BoxPredictor_1/ClassPredictor/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 Tactic: 3650389455493082349 [TRT] Tactic: 3650389455493082349 Time: 5.92451 [TRT] BoxPredictor_1/BoxEncodingPredictor/Conv2D || BoxPredictor_1/ClassPredictor/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148m_nt_v1 Tactic: 4772821744921268633 [TRT] Tactic: 4772821744921268633 Time: 4.61987 [TRT] BoxPredictor_1/BoxEncodingPredictor/Conv2D || BoxPredictor_1/ClassPredictor/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: 5319956359050645452 [TRT] Tactic: 5319956359050645452 Time: 4.83409 [TRT] BoxPredictor_1/BoxEncodingPredictor/Conv2D || BoxPredictor_1/ClassPredictor/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 7205456024582378848 [TRT] Tactic: 7205456024582378848 Time: 4.95766 [TRT] BoxPredictor_1/BoxEncodingPredictor/Conv2D || BoxPredictor_1/ClassPredictor/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 Tactic: -6490690591794140522 [TRT] Tactic: -6490690591794140522 Time: 5.54214 [TRT] BoxPredictor_1/BoxEncodingPredictor/Conv2D || BoxPredictor_1/ClassPredictor/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 Tactic: -4686027666808657977 [TRT] Tactic: -4686027666808657977 Time: 5.11633 [TRT] BoxPredictor_1/BoxEncodingPredictor/Conv2D || BoxPredictor_1/ClassPredictor/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -4212163711445252890 [TRT] Tactic: -4212163711445252890 Time: 4.71359 [TRT] BoxPredictor_1/BoxEncodingPredictor/Conv2D || BoxPredictor_1/ClassPredictor/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: -3898373634979201110 [TRT] Tactic: -3898373634979201110 Time: 4.89083 [TRT] BoxPredictor_1/BoxEncodingPredictor/Conv2D || BoxPredictor_1/ClassPredictor/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: -2409163523992614473 [TRT] Tactic: -2409163523992614473 Time: 4.63216 [TRT] Fastest Tactic: 4772821744921268633 Time: 4.61987 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 4772821744921268633 [TRT] =============== Computing costs for [TRT] *************** Autotuning format combination: Float(57000,100,10,1) -> Float(54600,91,1,1) *************** [TRT] --------------- Timing Runner: (Unnamed Layer* 533) [Shuffle] + BoxPredictor_1/Reshape_1 (Shuffle) [TRT] Tactic: 0 Time: 0.087682 [TRT] Fastest Tactic: 0 Time: 0.087682 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TRT] *************** Autotuning format combination: Float(57000,1,5700,570) -> Float(54600,1,600,600) *************** [TRT] --------------- Timing Runner: (Unnamed Layer* 533) [Shuffle] + BoxPredictor_1/Reshape_1 (Shuffle) [TRT] Tactic: 0 Time: 0.131614 [TRT] Fastest Tactic: 0 Time: 0.131614 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TRT] *************** Autotuning format combination: Float(1800,100:32,10,1) -> Float(1729,91:32,1,1) *************** [TRT] --------------- Timing Runner: (Unnamed Layer* 533) [Shuffle] + BoxPredictor_1/Reshape_1 (Shuffle) [TRT] Tactic: 0 Time: 0.134975 [TRT] Fastest Tactic: 0 Time: 0.134975 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TRT] *************** Autotuning format combination: Half(57000,100,10,1) -> Half(54600,91,1,1) *************** [TRT] --------------- Timing Runner: (Unnamed Layer* 533) [Shuffle] + BoxPredictor_1/Reshape_1 (Shuffle) [TRT] Tactic: 0 Time: 0.074974 [TRT] Fastest Tactic: 0 Time: 0.074974 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TRT] *************** Autotuning format combination: Half(28500,100:2,10,1) -> Half(27300,91:2,1,1) *************** [TRT] --------------- Timing Runner: (Unnamed Layer* 533) [Shuffle] + BoxPredictor_1/Reshape_1 (Shuffle) [TRT] Tactic: 0 Time: 0.105338 [TRT] Fastest Tactic: 0 Time: 0.105338 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TRT] =============== Computing costs for [TRT] *************** Autotuning format combination: Float(128000,100,10,1) -> Float(25600,100,10,1) *************** [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Relu6) (FusedConvActConvolution) [TRT] Tactic: 589823 Time: 1.22453 [TRT] Tactic: 655359 Time: 0.930547 [TRT] Tactic: 786431 Time: 0.873776 [TRT] Tactic: 851967 Time: 0.893073 [TRT] Tactic: 1179647 Time: 1.32672 [TRT] Tactic: 1310719 Time: 2.82198 [TRT] Tactic: 1376255 Time: 1.11247 [TRT] Tactic: 1441791 Time: 0.892578 [TRT] Tactic: 1507327 Time: 0.846198 [TRT] Tactic: 1638399 Time: 1.05513 [TRT] Tactic: 1835007 Time: 0.96013 [TRT] Tactic: 1900543 Time: 1.04477 [TRT] Tactic: 2097151 Time: 1.41865 [TRT] Tactic: 2162687 Time: 0.613855 [TRT] Tactic: 2293759 Time: 1.15107 [TRT] Tactic: 2359295 Time: 0.684427 [TRT] Tactic: 2686975 Time: 0.60013 [TRT] Tactic: 3080191 Time: 1.05187 [TRT] Tactic: 3342335 Time: 0.853829 [TRT] Tactic: 3407871 Time: 1.13602 [TRT] Tactic: 3538943 Time: 1.21271 [TRT] Tactic: 3670015 Time: 0.511302 [TRT] Tactic: 3932159 Time: 0.932891 [TRT] Tactic: 3997695 Time: 0.81914 [TRT] Tactic: 4063231 Time: 1.20708 [TRT] Tactic: 4194303 Time: 1.22773 [TRT] Tactic: 4259839 Time: 1.50685 [TRT] Tactic: 4325375 Time: 0.902708 [TRT] Tactic: 4521983 Time: 1.20583 [TRT] Tactic: 4587519 Time: 1.59716 [TRT] Tactic: 4653055 Time: 1.4594 [TRT] Tactic: 4915199 Time: 1.24013 [TRT] Tactic: 4980735 Time: 0.901693 [TRT] Tactic: 5177343 Time: 1.24276 [TRT] Tactic: 5242879 Time: 0.983802 [TRT] Tactic: 5373951 Time: 1.35068 [TRT] Tactic: 5439487 Time: 1.13701 [TRT] Tactic: 5570559 Time: 0.81039 [TRT] Tactic: 5636095 Time: 1.20883 [TRT] Tactic: 5701631 Time: 1.06911 [TRT] Tactic: 5767167 Time: 1.72474 [TRT] Tactic: 5832703 Time: 1.16279 [TRT] Tactic: 5898239 Time: 0.984062 [TRT] Tactic: 6029311 Time: 1.07586 [TRT] Tactic: 6225919 Time: 1.0688 [TRT] Tactic: 6291455 Time: 1.32229 [TRT] Tactic: 6422527 Time: 0.986902 [TRT] Tactic: 6750207 Time: 1.17878 [TRT] Tactic: 6815743 Time: 0.984792 [TRT] Tactic: 6946815 Time: 1.55214 [TRT] Tactic: 7012351 Time: 1.41193 [TRT] Tactic: 7077887 Time: 1.21284 [TRT] Tactic: 7143423 Time: 1.93721 [TRT] Tactic: 7208959 Time: 1.06766 [TRT] Tactic: 7340031 Time: 1.00714 [TRT] Tactic: 7405567 Time: 1.28133 [TRT] Tactic: 7536639 Time: 1.28409 [TRT] Tactic: 7602175 Time: 1.51758 [TRT] Tactic: 7733247 Time: 1.02474 [TRT] Tactic: 7798783 Time: 0.862864 [TRT] Tactic: 8191999 Time: 1.80839 [TRT] Tactic: 8257535 Time: 1.24888 [TRT] Tactic: 8323071 Time: 1.12268 [TRT] Tactic: 8650751 Time: 1.35023 [TRT] Tactic: 8716287 Time: 1.10823 [TRT] Tactic: 9109503 Time: 1.44122 [TRT] Tactic: 9568255 Time: 1.23885 [TRT] Tactic: 9895935 Time: 1.22927 [TRT] Tactic: 10223615 Time: 0.594037 [TRT] Tactic: 10354687 Time: 1.55818 [TRT] Tactic: 10551295 Time: 1.10682 [TRT] Tactic: 10747903 Time: 1.00721 [TRT] Tactic: 10944511 Time: 0.903255 [TRT] Fastest Tactic: 3670015 Time: 0.511302 [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Relu6) (CudaDepthwiseConvolution) [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Relu6) (CudnnConvolution) [TRT] Tactic: 0 Time: 1.08484 [TRT] Tactic: 1 Time: 0.908698 [TRT] Tactic: 2 Time: 1.13263 [TRT] Tactic: 4 skipped. Scratch requested: 759234560, available: 33554432 [TRT] Tactic: 5 skipped. Scratch requested: 46653440, available: 33554432 [TRT] Fastest Tactic: 1 Time: 0.908698 [TRT] Setting workspace to 46653440enables more tactics for profiling [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Relu6) (CublasConvolution) [TRT] CublasConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Relu6) (CaskConvolution) [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758 [TRT] Tactic: 1062367460111450758 Time: 0.65763 [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 Tactic: 1698681053543049347 [TRT] Tactic: 1698681053543049347 Time: 0.632526 [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441 [TRT] Tactic: 4501471010995462441 Time: 0.439219 [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826 [TRT] Tactic: 5137655947464784826 Time: 0.440755 [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929 [TRT] Tactic: 5288347012147084929 Time: 0.436068 [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 Tactic: 5326823351883942011 [TRT] Tactic: 5326823351883942011 Time: 0.427005 [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 Tactic: 5500448035057547314 [TRT] Tactic: 5500448035057547314 Time: 0.469714 [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056 [TRT] Tactic: 6645123197870846056 Time: 0.44901 [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478 [TRT] Tactic: 7144526460361122478 Time: 0.643959 [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730 [TRT] Tactic: -8262349710178828730 Time: 0.445704 [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 Tactic: -6576203419454146580 [TRT] Tactic: -6576203419454146580 Time: 0.561068 [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159 [TRT] Tactic: -4787320710726427159 Time: 0.689792 [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839 [TRT] Tactic: -3456450830548107839 Time: 0.600052 [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241 [TRT] Tactic: -1218658103698133241 Time: 0.489011 [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091 [TRT] Tactic: -836875257600482091 Time: 0.486537 [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746 [TRT] Tactic: -410470605513481746 Time: 0.432474 [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 Tactic: -377491875521947884 [TRT] Tactic: -377491875521947884 Time: 0.434427 [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 Tactic: -37215280111360163 [TRT] Tactic: -37215280111360163 Time: 0.429479 [TRT] Fastest Tactic: 5326823351883942011 Time: 0.427005 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5326823351883942011 [TRT] *************** Autotuning format combination: Float(128000,1,12800,1280) -> Float(25600,1,2560,256) *************** [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Relu6) (CudnnConvolution) [TRT] CudnnConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Relu6) (CublasConvolution) [TRT] CublasConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Relu6) (CaskConvolution) [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Relu6) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 3886731678879822788 [TRT] Tactic: 3886731678879822788 Time: 0.437916 [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Relu6) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 6629944304117643200 [TRT] Tactic: 6629944304117643200 Time: 0.698282 [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Relu6) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -9153228964338181824 [TRT] Tactic: -9153228964338181824 Time: 0.697266 [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Relu6) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -7394439838318485025 [TRT] Tactic: -7394439838318485025 Time: 0.429453 [TRT] Fastest Tactic: -7394439838318485025 Time: 0.429453 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7394439838318485025 [TRT] *************** Autotuning format combination: Half(128000,100,10,1) -> Half(25600,100,10,1) *************** [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Relu6) (CudnnConvolution) [TRT] Tactic: 0 Time: 1.22813 [TRT] Tactic: 1 Time: 0.92625 [TRT] Tactic: 2 Time: 1.12341 [TRT] Tactic: 4 skipped. Scratch requested: 759234560, available: 33554432 [TRT] Tactic: 5 skipped. Scratch requested: 46653440, available: 33554432 [TRT] Fastest Tactic: 1 Time: 0.92625 [TRT] Setting workspace to 46653440enables more tactics for profiling [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Relu6) (CublasConvolution) [TRT] CublasConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Relu6) (CaskConvolution) [TRT] CaskConvolution has no valid tactics for this config, skipping [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 1 [TRT] *************** Autotuning format combination: Half(64000,100:2,10,1) -> Half(25600,100,10,1) *************** [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Relu6) (CaskConvolution) [TRT] CaskConvolution has no valid tactics for this config, skipping [TRT] *************** Autotuning format combination: Half(64000,100:2,10,1) -> Half(12800,100:2,10,1) *************** [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Relu6) (FusedConvActConvolution) [TRT] Tactic: 589823 Time: 0.607526 [TRT] Tactic: 655359 Time: 0.561484 [TRT] Tactic: 786431 Time: 0.480599 [TRT] Tactic: 851967 Time: 0.487761 [TRT] Tactic: 1179647 Time: 0.646901 [TRT] Tactic: 1310719 Time: 1.41315 [TRT] Tactic: 1376255 Time: 0.564662 [TRT] Tactic: 1441791 Time: 0.43888 [TRT] Tactic: 1507327 Time: 0.44375 [TRT] Tactic: 1638399 Time: 0.561015 [TRT] Tactic: 1835007 Time: 0.569921 [TRT] Tactic: 1900543 Time: 0.548906 [TRT] Tactic: 2097151 Time: 0.990885 [TRT] Tactic: 2162687 Time: 0.307396 [TRT] Tactic: 2293759 Time: 0.572031 [TRT] Tactic: 2359295 Time: 0.348854 [TRT] Tactic: 2686975 Time: 0.526197 [TRT] Tactic: 3080191 Time: 0.56362 [TRT] Tactic: 3342335 Time: 0.449818 [TRT] Tactic: 3407871 Time: 0.574896 [TRT] Tactic: 3538943 Time: 0.604297 [TRT] Tactic: 3670015 Time: 0.584635 [TRT] Tactic: 3932159 Time: 0.348333 [TRT] Tactic: 3997695 Time: 0.495703 [TRT] Tactic: 4063231 Time: 0.654922 [TRT] Tactic: 4194303 Time: 0.678047 [TRT] Tactic: 4259839 Time: 1.00159 [TRT] Tactic: 4325375 Time: 0.465391 [TRT] Tactic: 4521983 Time: 0.561484 [TRT] Tactic: 4587519 Time: 0.904844 [TRT] Tactic: 4653055 Time: 0.761771 [TRT] Tactic: 4915199 Time: 0.703984 [TRT] Tactic: 4980735 Time: 0.50737 [TRT] Tactic: 5177343 Time: 0.606667 [TRT] Tactic: 5242879 Time: 0.531536 [TRT] Tactic: 5373951 Time: 0.681145 [TRT] Tactic: 5439487 Time: 0.655287 [TRT] Tactic: 5570559 Time: 0.588933 [TRT] Tactic: 5636095 Time: 0.653489 [TRT] Tactic: 5701631 Time: 0.486979 [TRT] Tactic: 5767167 Time: 0.853907 [TRT] Tactic: 5832703 Time: 0.565989 [TRT] Tactic: 5898239 Time: 0.595234 [TRT] Tactic: 6029311 Time: 0.505859 [TRT] Tactic: 6225919 Time: 0.559114 [TRT] Tactic: 6291455 Time: 0.642552 [TRT] Tactic: 6422527 Time: 0.536277 [TRT] Tactic: 6750207 Time: 0.701926 [TRT] Tactic: 6815743 Time: 0.536067 [TRT] Tactic: 6946815 Time: 0.756615 [TRT] Tactic: 7012351 Time: 0.995495 [TRT] Tactic: 7077887 Time: 0.591458 [TRT] Tactic: 7143423 Time: 0.971042 [TRT] Tactic: 7208959 Time: 0.497005 [TRT] Tactic: 7340031 Time: 0.625573 [TRT] Tactic: 7405567 Time: 0.671224 [TRT] Tactic: 7536639 Time: 0.679479 [TRT] Tactic: 7602175 Time: 0.74 [TRT] Tactic: 7733247 Time: 0.59612 [TRT] Tactic: 7798783 Time: 0.476667 [TRT] Tactic: 8191999 Time: 0.924765 [TRT] Tactic: 8257535 Time: 0.703099 [TRT] Tactic: 8323071 Time: 0.644505 [TRT] Tactic: 8650751 Time: 0.656693 [TRT] Tactic: 8716287 Time: 0.569375 [TRT] Tactic: 9109503 Time: 1.02948 [TRT] Tactic: 9568255 Time: 0.707995 [TRT] Tactic: 9895935 Time: 0.678412 [TRT] Tactic: 10223615 Time: 0.529088 [TRT] Tactic: 10354687 Time: 1.01633 [TRT] Tactic: 10551295 Time: 0.573411 [TRT] Tactic: 10747903 Time: 0.536954 [TRT] Tactic: 10944511 Time: 0.508412 [TRT] Fastest Tactic: 2162687 Time: 0.307396 [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Relu6) (CudnnConvolution) [TRT] CudnnConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Relu6) (CublasConvolution) [TRT] CublasConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Relu6) (CaskConvolution) [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Relu6) Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 3066127711859985668 [TRT] Tactic: 3066127711859985668 Time: 0.285 [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Relu6) Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 3564772625446233998 [TRT] Tactic: 3564772625446233998 Time: 0.339375 [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Relu6) Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: 5319956359050645452 [TRT] Tactic: 5319956359050645452 Time: 0.305182 [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Relu6) Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 7205456024582378848 [TRT] Tactic: 7205456024582378848 Time: 0.234609 [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Relu6) Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 8163473458334948789 [TRT] Tactic: 8163473458334948789 Time: 0.227709 [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Relu6) Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -4212163711445252890 [TRT] Tactic: -4212163711445252890 Time: 0.221823 [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Relu6) Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: -3898373634979201110 [TRT] Tactic: -3898373634979201110 Time: 0.2275 [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Relu6) Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: -2409163523992614473 [TRT] Tactic: -2409163523992614473 Time: 0.234609 [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Relu6) Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: -1716393687483585322 [TRT] Tactic: -1716393687483585322 Time: 0.22013 [TRT] Fastest Tactic: -1716393687483585322 Time: 0.22013 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -1716393687483585322 [TRT] =============== Computing costs for [TRT] *************** Autotuning format combination: Float(25600,100,10,1) -> Float(6400,25,5,1) *************** [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/Relu6) (CudaDepthwiseConvolution) [TRT] Tactic: -1 Time: 0.0889065 [TRT] Fastest Tactic: -1 Time: 0.0889065 [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/Relu6) (CudnnConvolution) [TRT] Tactic: 0 Time: 0.129218 [TRT] Tactic: 1 Time: 0.128151 [TRT] Tactic: 2 Time: 0.128672 [TRT] Tactic: 5 Time: 79.3827 [TRT] Fastest Tactic: 1 Time: 0.128151 [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/Relu6) (CaskConvolution) [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758 [TRT] Tactic: 1062367460111450758 Time: 6.88573 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v0 Tactic: 1754984623894446479 [TRT] Tactic: 1754984623894446479 Time: 7.5276 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v0 Tactic: 3611739942397549984 [TRT] Tactic: 3611739942397549984 Time: 7.30279 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 Tactic: 4337000649858996379 [TRT] Tactic: 4337000649858996379 Time: 7.35427 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441 [TRT] Tactic: 4501471010995462441 Time: 7.09672 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826 [TRT] Tactic: 5137655947464784826 Time: 6.9495 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929 [TRT] Tactic: 5288347012147084929 Time: 6.63938 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056 [TRT] Tactic: 6645123197870846056 Time: 7.29299 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478 [TRT] Tactic: 7144526460361122478 Time: 7.17081 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 Tactic: -9137461792520977713 [TRT] Tactic: -9137461792520977713 Time: 7.57622 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730 [TRT] Tactic: -8262349710178828730 Time: 7.12602 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v0 Tactic: -8133971918129952780 [TRT] Tactic: -8133971918129952780 Time: 7.47148 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 Tactic: -6092040395344634144 [TRT] Tactic: -6092040395344634144 Time: 7.47982 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159 [TRT] Tactic: -4787320710726427159 Time: 7.22375 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839 [TRT] Tactic: -3456450830548107839 Time: 6.79026 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241 [TRT] Tactic: -1218658103698133241 Time: 7.24773 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091 [TRT] Tactic: -836875257600482091 Time: 6.86523 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746 [TRT] Tactic: -410470605513481746 Time: 7.0263 [TRT] Fastest Tactic: 5288347012147084929 Time: 6.63938 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: -1 [TRT] *************** Autotuning format combination: Float(25600,1,2560,256) -> Float(6400,1,1280,256) *************** [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/Relu6) (CudnnConvolution) [TRT] CudnnConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/Relu6) (CaskConvolution) [TRT] CaskConvolution has no valid tactics for this config, skipping [TRT] *************** Autotuning format combination: Half(25600,100,10,1) -> Half(6400,25,5,1) *************** [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/Relu6) (CudnnConvolution) [TRT] Tactic: 0 Time: 0.127422 [TRT] Tactic: 1 Time: 0.12677 [TRT] Tactic: 2 Time: 0.117396 [TRT] Tactic: 5 Time: 79.3717 [TRT] Fastest Tactic: 2 Time: 0.117396 [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/Relu6) (CaskConvolution) [TRT] CaskConvolution has no valid tactics for this config, skipping [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 2 [TRT] *************** Autotuning format combination: Half(12800,100:2,10,1) -> Half(3200,25:2,5,1) *************** [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/Relu6) (CaskConvolution) [TRT] CaskConvolution has no valid tactics for this config, skipping [TRT] =============== Computing costs for [TRT] *************** Autotuning format combination: Float(6400,25,5,1) -> Float(12800,25,5,1) *************** [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Relu6) (FusedConvActConvolution) [TRT] Tactic: 589823 Time: 0.23448 [TRT] Tactic: 655359 Time: 0.133985 [TRT] Tactic: 786431 Time: 0.114297 [TRT] Tactic: 851967 Time: 0.149166 [TRT] Tactic: 1179647 Time: 0.177448 [TRT] Tactic: 1310719 Time: 0.471797 [TRT] Tactic: 1376255 Time: 0.140755 [TRT] Tactic: 1441791 Time: 0.213776 [TRT] Tactic: 1507327 Time: 0.197578 [TRT] Tactic: 1638399 Time: 0.243437 [TRT] Tactic: 1835007 Time: 0.167812 [TRT] Tactic: 1900543 Time: 0.137526 [TRT] Tactic: 2097151 Time: 0.234063 [TRT] Tactic: 2162687 Time: 0.139037 [TRT] Tactic: 2293759 Time: 0.150886 [TRT] Tactic: 2359295 Time: 0.172422 [TRT] Tactic: 2686975 Time: 0.168124 [TRT] Tactic: 3080191 Time: 0.148803 [TRT] Tactic: 3342335 Time: 0.136901 [TRT] Tactic: 3407871 Time: 0.161353 [TRT] Tactic: 3538943 Time: 0.169557 [TRT] Tactic: 3670015 Time: 0.119063 [TRT] Tactic: 3932159 Time: 0.212135 [TRT] Tactic: 3997695 Time: 0.11612 [TRT] Tactic: 4063231 Time: 0.152317 [TRT] Tactic: 4194303 Time: 0.218828 [TRT] Tactic: 4259839 Time: 0.249323 [TRT] Tactic: 4325375 Time: 0.210027 [TRT] Tactic: 4521983 Time: 0.252786 [TRT] Tactic: 4587519 Time: 0.196745 [TRT] Tactic: 4653055 Time: 0.184348 [TRT] Tactic: 4915199 Time: 0.206953 [TRT] Tactic: 4980735 Time: 0.213255 [TRT] Tactic: 5177343 Time: 0.23427 [TRT] Tactic: 5242879 Time: 0.154401 [TRT] Tactic: 5373951 Time: 0.179922 [TRT] Tactic: 5439487 Time: 0.172448 [TRT] Tactic: 5570559 Time: 0.153906 [TRT] Tactic: 5636095 Time: 0.155313 [TRT] Tactic: 5701631 Time: 0.236484 [TRT] Tactic: 5767167 Time: 0.228151 [TRT] Tactic: 5832703 Time: 0.161094 [TRT] Tactic: 5898239 Time: 0.158489 [TRT] Tactic: 6029311 Time: 0.138151 [TRT] Tactic: 6225919 Time: 0.157813 [TRT] Tactic: 6291455 Time: 0.177839 [TRT] Tactic: 6422527 Time: 0.14375 [TRT] Tactic: 6750207 Time: 0.176197 [TRT] Tactic: 6815743 Time: 0.15336 [TRT] Tactic: 6946815 Time: 0.220104 [TRT] Tactic: 7012351 Time: 0.234271 [TRT] Tactic: 7077887 Time: 0.169479 [TRT] Tactic: 7143423 Time: 0.236458 [TRT] Tactic: 7208959 Time: 0.215 [TRT] Tactic: 7340031 Time: 0.163359 [TRT] Tactic: 7405567 Time: 0.158073 [TRT] Tactic: 7536639 Time: 0.164479 [TRT] Tactic: 7602175 Time: 0.219297 [TRT] Tactic: 7733247 Time: 0.168724 [TRT] Tactic: 7798783 Time: 0.113881 [TRT] Tactic: 8191999 Time: 0.23 [TRT] Tactic: 8257535 Time: 0.202708 [TRT] Tactic: 8323071 Time: 0.172709 [TRT] Tactic: 8650751 Time: 0.30039 [TRT] Tactic: 8716287 Time: 0.154818 [TRT] Tactic: 9109503 Time: 0.234375 [TRT] Tactic: 9568255 Time: 0.205391 [TRT] Tactic: 9895935 Time: 0.219661 [TRT] Tactic: 10223615 Time: 0.166771 [TRT] Tactic: 10354687 Time: 0.244531 [TRT] Tactic: 10551295 Time: 0.168568 [TRT] Tactic: 10747903 Time: 0.169922 [TRT] Tactic: 10944511 Time: 0.211641 [TRT] Fastest Tactic: 7798783 Time: 0.113881 [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Relu6) (CudaDepthwiseConvolution) [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Relu6) (CudnnConvolution) [TRT] Tactic: 0 Time: 0.223464 [TRT] Tactic: 1 Time: 0.214271 [TRT] Tactic: 2 Time: 0.412578 [TRT] Tactic: 4 skipped. Scratch requested: 303104000, available: 33554432 [TRT] Tactic: 5 Time: 9.34661 [TRT] Fastest Tactic: 1 Time: 0.214271 [TRT] Setting workspace to 303104000enables more tactics for profiling [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Relu6) (CublasConvolution) [TRT] CublasConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Relu6) (CaskConvolution) [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758 [TRT] Tactic: 1062367460111450758 Time: 0.261302 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 Tactic: 1698681053543049347 [TRT] Tactic: 1698681053543049347 Time: 0.233308 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441 [TRT] Tactic: 4501471010995462441 Time: 0.198255 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826 [TRT] Tactic: 5137655947464784826 Time: 0.202343 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929 [TRT] Tactic: 5288347012147084929 Time: 0.208933 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 Tactic: 5326823351883942011 [TRT] Tactic: 5326823351883942011 Time: 0.195052 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 Tactic: 5500448035057547314 [TRT] Tactic: 5500448035057547314 Time: 0.210339 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056 [TRT] Tactic: 6645123197870846056 Time: 0.209348 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478 [TRT] Tactic: 7144526460361122478 Time: 0.266407 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730 [TRT] Tactic: -8262349710178828730 Time: 0.209635 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 Tactic: -6576203419454146580 [TRT] Tactic: -6576203419454146580 Time: 0.234401 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159 [TRT] Tactic: -4787320710726427159 Time: 0.287318 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839 [TRT] Tactic: -3456450830548107839 Time: 0.243437 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241 [TRT] Tactic: -1218658103698133241 Time: 0.221354 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091 [TRT] Tactic: -836875257600482091 Time: 0.226562 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746 [TRT] Tactic: -410470605513481746 Time: 0.195652 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 Tactic: -377491875521947884 [TRT] Tactic: -377491875521947884 Time: 0.200312 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 Tactic: -37215280111360163 [TRT] Tactic: -37215280111360163 Time: 0.199219 [TRT] Fastest Tactic: 5326823351883942011 Time: 0.195052 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 7798783 [TRT] *************** Autotuning format combination: Float(6400,1,1280,256) -> Float(12800,1,2560,512) *************** [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Relu6) (CudnnConvolution) [TRT] CudnnConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Relu6) (CublasConvolution) [TRT] CublasConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Relu6) (CaskConvolution) [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Relu6) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 3886731678879822788 [TRT] Tactic: 3886731678879822788 Time: 0.199427 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Relu6) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 6629944304117643200 [TRT] Tactic: 6629944304117643200 Time: 0.309088 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Relu6) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -9153228964338181824 [TRT] Tactic: -9153228964338181824 Time: 0.311172 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Relu6) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -7394439838318485025 [TRT] Tactic: -7394439838318485025 Time: 0.205807 [TRT] Fastest Tactic: 3886731678879822788 Time: 0.199427 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3886731678879822788 [TRT] *************** Autotuning format combination: Half(6400,25,5,1) -> Half(12800,25,5,1) *************** [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Relu6) (CudnnConvolution) [TRT] Tactic: 0 Time: 0.232735 [TRT] Tactic: 1 Time: 0.22211 [TRT] Tactic: 2 Time: 0.408125 [TRT] Tactic: 4 skipped. Scratch requested: 303104000, available: 33554432 [TRT] Tactic: 5 Time: 9.49318 [TRT] Fastest Tactic: 1 Time: 0.22211 [TRT] Setting workspace to 303104000enables more tactics for profiling [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Relu6) (CublasConvolution) [TRT] CublasConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Relu6) (CaskConvolution) [TRT] CaskConvolution has no valid tactics for this config, skipping [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 1 [TRT] *************** Autotuning format combination: Half(3200,25:2,5,1) -> Half(12800,25,5,1) *************** [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Relu6) (CaskConvolution) [TRT] CaskConvolution has no valid tactics for this config, skipping [TRT] *************** Autotuning format combination: Half(3200,25:2,5,1) -> Half(6400,25:2,5,1) *************** [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Relu6) (FusedConvActConvolution) [TRT] Tactic: 589823 Time: 0.110938 [TRT] Tactic: 655359 Time: 0.0791925 [TRT] Tactic: 786431 Time: 0.067839 [TRT] Tactic: 851967 Time: 0.085469 [TRT] Tactic: 1179647 Time: 0.0923435 [TRT] Tactic: 1310719 Time: 0.25974 [TRT] Tactic: 1376255 Time: 0.074974 [TRT] Tactic: 1441791 Time: 0.124167 [TRT] Tactic: 1507327 Time: 0.108099 [TRT] Tactic: 1638399 Time: 0.144193 [TRT] Tactic: 1835007 Time: 0.107969 [TRT] Tactic: 1900543 Time: 0.0769005 [TRT] Tactic: 2097151 Time: 0.188412 [TRT] Tactic: 2162687 Time: 0.069114 [TRT] Tactic: 2293759 Time: 0.0836195 [TRT] Tactic: 2359295 Time: 0.093672 [TRT] Tactic: 2686975 Time: 0.132239 [TRT] Tactic: 3080191 Time: 0.0815885 [TRT] Tactic: 3342335 Time: 0.0753125 [TRT] Tactic: 3407871 Time: 0.085313 [TRT] Tactic: 3538943 Time: 0.0886715 [TRT] Tactic: 3670015 Time: 0.119297 [TRT] Tactic: 3932159 Time: 0.0845315 [TRT] Tactic: 3997695 Time: 0.070156 [TRT] Tactic: 4063231 Time: 0.08599 [TRT] Tactic: 4194303 Time: 0.123177 [TRT] Tactic: 4259839 Time: 0.184505 [TRT] Tactic: 4325375 Time: 0.118125 [TRT] Tactic: 4521983 Time: 0.120963 [TRT] Tactic: 4587519 Time: 0.127865 [TRT] Tactic: 4653055 Time: 0.111068 [TRT] Tactic: 4915199 Time: 0.129557 [TRT] Tactic: 4980735 Time: 0.127136 [TRT] Tactic: 5177343 Time: 0.120442 [TRT] Tactic: 5242879 Time: 0.074271 [TRT] Tactic: 5373951 Time: 0.0946355 [TRT] Tactic: 5439487 Time: 0.102291 [TRT] Tactic: 5570559 Time: 0.100703 [TRT] Tactic: 5636095 Time: 0.089297 [TRT] Tactic: 5701631 Time: 0.107761 [TRT] Tactic: 5767167 Time: 0.117683 [TRT] Tactic: 5832703 Time: 0.080599 [TRT] Tactic: 5898239 Time: 0.118646 [TRT] Tactic: 6029311 Time: 0.074271 [TRT] Tactic: 6225919 Time: 0.074635 [TRT] Tactic: 6291455 Time: 0.0916665 [TRT] Tactic: 6422527 Time: 0.078594 [TRT] Tactic: 6750207 Time: 0.104791 [TRT] Tactic: 6815743 Time: 0.074531 [TRT] Tactic: 6946815 Time: 0.108256 [TRT] Tactic: 7012351 Time: 0.188698 [TRT] Tactic: 7077887 Time: 0.0821355 [TRT] Tactic: 7143423 Time: 0.125625 [TRT] Tactic: 7208959 Time: 0.108229 [TRT] Tactic: 7340031 Time: 0.116536 [TRT] Tactic: 7405567 Time: 0.0870575 [TRT] Tactic: 7536639 Time: 0.106119 [TRT] Tactic: 7602175 Time: 0.108047 [TRT] Tactic: 7733247 Time: 0.0994535 [TRT] Tactic: 7798783 Time: 0.067266 [TRT] Tactic: 8191999 Time: 0.122578 [TRT] Tactic: 8257535 Time: 0.127109 [TRT] Tactic: 8323071 Time: 0.102865 [TRT] Tactic: 8650751 Time: 0.148151 [TRT] Tactic: 8716287 Time: 0.073073 [TRT] Tactic: 9109503 Time: 0.186667 [TRT] Tactic: 9568255 Time: 0.129531 [TRT] Tactic: 9895935 Time: 0.12336 [TRT] Tactic: 10223615 Time: 0.132865 [TRT] Tactic: 10354687 Time: 0.184584 [TRT] Tactic: 10551295 Time: 0.090703 [TRT] Tactic: 10747903 Time: 0.0959375 [TRT] Tactic: 10944511 Time: 0.127135 [TRT] Fastest Tactic: 7798783 Time: 0.067266 [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Relu6) (CudnnConvolution) [TRT] CudnnConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Relu6) (CublasConvolution) [TRT] CublasConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Relu6) (CaskConvolution) [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Relu6) Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 3066127711859985668 [TRT] Tactic: 3066127711859985668 Time: 0.131277 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Relu6) Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 3564772625446233998 [TRT] Tactic: 3564772625446233998 Time: 0.137343 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Relu6) Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: 5319956359050645452 [TRT] Tactic: 5319956359050645452 Time: 0.131745 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Relu6) Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 7205456024582378848 [TRT] Tactic: 7205456024582378848 Time: 0.114271 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Relu6) Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 8163473458334948789 [TRT] Tactic: 8163473458334948789 Time: 0.108828 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Relu6) Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -4212163711445252890 [TRT] Tactic: -4212163711445252890 Time: 0.106016 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Relu6) Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: -3898373634979201110 [TRT] Tactic: -3898373634979201110 Time: 0.107787 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Relu6) Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: -2409163523992614473 [TRT] Tactic: -2409163523992614473 Time: 0.112708 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Relu6) Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: -1716393687483585322 [TRT] Tactic: -1716393687483585322 Time: 0.103906 [TRT] Fastest Tactic: -1716393687483585322 Time: 0.103906 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 7798783 [TRT] =============== Computing costs for [TRT] *************** Autotuning format combination: Float(12800,25,5,1) -> Float(14250,25,5,1) *************** [TRT] --------------- Timing Runner: BoxPredictor_2/BoxEncodingPredictor/Conv2D || BoxPredictor_2/ClassPredictor/Conv2D (FusedConvActConvolution) [TRT] Tactic: 524287 Time: 2.01518 [TRT] Tactic: 720895 Time: 1.06583 [TRT] Tactic: 983039 Time: 1.63781 [TRT] Tactic: 1048575 Time: 1.30448 [TRT] Tactic: 1703935 Time: 1.19794 [TRT] Tactic: 1769471 Time: 1.07039 [TRT] Tactic: 1966079 Time: 2.17586 [TRT] Tactic: 2031615 Time: 1.03039 [TRT] Tactic: 2228223 Time: 1.78307 [TRT] Tactic: 2424831 Time: 1.54549 [TRT] Tactic: 2621439 Time: 1.33693 [TRT] Tactic: 2752511 Time: 1.25753 [TRT] Tactic: 3014655 Time: 1.62346 [TRT] Tactic: 3145727 Time: 1.07742 [TRT] Tactic: 3604479 Time: 1.59549 [TRT] Tactic: 4390911 Time: 1.36102 [TRT] Tactic: 5046271 Time: 1.78695 [TRT] Tactic: 5963775 Time: 2.02331 [TRT] Tactic: 6160383 Time: 1.80987 [TRT] Tactic: 6488063 Time: 1.60401 [TRT] Tactic: 6881279 Time: 1.35732 [TRT] Tactic: 7274495 Time: 1.64089 [TRT] Tactic: 7864319 Time: 1.39688 [TRT] Tactic: 7995391 Time: 1.98175 [TRT] Tactic: 8585215 Time: 1.16211 [TRT] Tactic: 8847359 Time: 1.52323 [TRT] Tactic: 8978431 Time: 2.05648 [TRT] Tactic: 9043967 Time: 1.47932 [TRT] Tactic: 9175039 Time: 1.59758 [TRT] Tactic: 9502719 Time: 1.42315 [TRT] Tactic: 9961471 Time: 1.68154 [TRT] Tactic: 10027007 Time: 1.08307 [TRT] Tactic: 10092543 Time: 1.35424 [TRT] Tactic: 10289151 Time: 2.1701 [TRT] Tactic: 10485759 Time: 1.05518 [TRT] Tactic: 10682367 Time: 1.36708 [TRT] Tactic: 10813439 Time: 1.8768 [TRT] Fastest Tactic: 2031615 Time: 1.03039 [TRT] --------------- Timing Runner: BoxPredictor_2/BoxEncodingPredictor/Conv2D || BoxPredictor_2/ClassPredictor/Conv2D (CudaDepthwiseConvolution) [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: BoxPredictor_2/BoxEncodingPredictor/Conv2D || BoxPredictor_2/ClassPredictor/Conv2D (CudnnConvolution) [TRT] Tactic: 0 Time: 3.87831 [TRT] Tactic: 1 Time: 3.90081 [TRT] Tactic: 2 Time: 3.15078 [TRT] Tactic: 4 skipped. Scratch requested: 684085248, available: 33554432 [TRT] Tactic: 5 skipped. Scratch requested: 1274796544, available: 33554432 [TRT] Tactic: 6 Time: 3.71833 [TRT] Fastest Tactic: 2 Time: 3.15078 [TRT] Setting workspace to 684085248enables more tactics for profiling [TRT] --------------- Timing Runner: BoxPredictor_2/BoxEncodingPredictor/Conv2D || BoxPredictor_2/ClassPredictor/Conv2D (CaskConvolution) [TRT] BoxPredictor_2/BoxEncodingPredictor/Conv2D || BoxPredictor_2/ClassPredictor/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758 [TRT] Tactic: 1062367460111450758 Time: 4.56135 [TRT] BoxPredictor_2/BoxEncodingPredictor/Conv2D || BoxPredictor_2/ClassPredictor/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v0 Tactic: 1754984623894446479 [TRT] Tactic: 1754984623894446479 Time: 5.53331 [TRT] BoxPredictor_2/BoxEncodingPredictor/Conv2D || BoxPredictor_2/ClassPredictor/Conv2D Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v0 Tactic: 3611739942397549984 [TRT] Tactic: 3611739942397549984 Time: 4.06859 [TRT] BoxPredictor_2/BoxEncodingPredictor/Conv2D || BoxPredictor_2/ClassPredictor/Conv2D Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v1 Tactic: 3827454225649558724 [TRT] Tactic: 3827454225649558724 Time: 2.34641 [TRT] BoxPredictor_2/BoxEncodingPredictor/Conv2D || BoxPredictor_2/ClassPredictor/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 Tactic: 4337000649858996379 [TRT] Tactic: 4337000649858996379 Time: 4.04281 [TRT] BoxPredictor_2/BoxEncodingPredictor/Conv2D || BoxPredictor_2/ClassPredictor/Conv2D Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441 [TRT] Tactic: 4501471010995462441 Time: 3.92531 [TRT] BoxPredictor_2/BoxEncodingPredictor/Conv2D || BoxPredictor_2/ClassPredictor/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826 [TRT] Tactic: 5137655947464784826 Time: 3.65979 [TRT] BoxPredictor_2/BoxEncodingPredictor/Conv2D || BoxPredictor_2/ClassPredictor/Conv2D Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929 [TRT] Tactic: 5288347012147084929 Time: 3.87034 [TRT] BoxPredictor_2/BoxEncodingPredictor/Conv2D || BoxPredictor_2/ClassPredictor/Conv2D Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148m_nt_v1 Tactic: 5921334924264294896 [TRT] Tactic: 5921334924264294896 Time: 1.93479 [TRT] BoxPredictor_2/BoxEncodingPredictor/Conv2D || BoxPredictor_2/ClassPredictor/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056 [TRT] Tactic: 6645123197870846056 Time: 3.9543 [TRT] BoxPredictor_2/BoxEncodingPredictor/Conv2D || BoxPredictor_2/ClassPredictor/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478 [TRT] Tactic: 7144526460361122478 Time: 4.82581 [TRT] BoxPredictor_2/BoxEncodingPredictor/Conv2D || BoxPredictor_2/ClassPredictor/Conv2D Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 Tactic: 7852627285308570038 [TRT] Tactic: 7852627285308570038 Time: 2.51039 [TRT] BoxPredictor_2/BoxEncodingPredictor/Conv2D || BoxPredictor_2/ClassPredictor/Conv2D Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 Tactic: -9137461792520977713 [TRT] Tactic: -9137461792520977713 Time: 4.04089 [TRT] BoxPredictor_2/BoxEncodingPredictor/Conv2D || BoxPredictor_2/ClassPredictor/Conv2D Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v0 Tactic: -8776506421218919509 [TRT] Tactic: -8776506421218919509 Time: 2.44031 [TRT] BoxPredictor_2/BoxEncodingPredictor/Conv2D || BoxPredictor_2/ClassPredictor/Conv2D Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730 [TRT] Tactic: -8262349710178828730 Time: 4.07661 [TRT] BoxPredictor_2/BoxEncodingPredictor/Conv2D || BoxPredictor_2/ClassPredictor/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v0 Tactic: -8133971918129952780 [TRT] Tactic: -8133971918129952780 Time: 4.78036 [TRT] BoxPredictor_2/BoxEncodingPredictor/Conv2D || BoxPredictor_2/ClassPredictor/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 Tactic: -6092040395344634144 [TRT] Tactic: -6092040395344634144 Time: 4.69826 [TRT] BoxPredictor_2/BoxEncodingPredictor/Conv2D || BoxPredictor_2/ClassPredictor/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159 [TRT] Tactic: -4787320710726427159 Time: 5.48328 [TRT] BoxPredictor_2/BoxEncodingPredictor/Conv2D || BoxPredictor_2/ClassPredictor/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839 [TRT] Tactic: -3456450830548107839 Time: 3.85925 [TRT] BoxPredictor_2/BoxEncodingPredictor/Conv2D || BoxPredictor_2/ClassPredictor/Conv2D Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v0 Tactic: -2318106587342035239 [TRT] Tactic: -2318106587342035239 Time: 2.365 [TRT] BoxPredictor_2/BoxEncodingPredictor/Conv2D || BoxPredictor_2/ClassPredictor/Conv2D Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_mobile_relu_tile148t_nt_v0 Tactic: -1343271414618805657 [TRT] Tactic: -1343271414618805657 Time: 1.77474 [TRT] BoxPredictor_2/BoxEncodingPredictor/Conv2D || BoxPredictor_2/ClassPredictor/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241 [TRT] Tactic: -1218658103698133241 Time: 4.75044 [TRT] BoxPredictor_2/BoxEncodingPredictor/Conv2D || BoxPredictor_2/ClassPredictor/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091 [TRT] Tactic: -836875257600482091 Time: 4.42831 [TRT] BoxPredictor_2/BoxEncodingPredictor/Conv2D || BoxPredictor_2/ClassPredictor/Conv2D Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746 [TRT] Tactic: -410470605513481746 Time: 3.79437 [TRT] Fastest Tactic: -1343271414618805657 Time: 1.77474 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 2031615 [TRT] *************** Autotuning format combination: Float(12800,1,2560,512) -> Float(14250,1,2850,570) *************** [TRT] --------------- Timing Runner: BoxPredictor_2/BoxEncodingPredictor/Conv2D || BoxPredictor_2/ClassPredictor/Conv2D (CudnnConvolution) [TRT] CudnnConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: BoxPredictor_2/BoxEncodingPredictor/Conv2D || BoxPredictor_2/ClassPredictor/Conv2D (CaskConvolution) [TRT] CaskConvolution has no valid tactics for this config, skipping [TRT] *************** Autotuning format combination: Half(12800,25,5,1) -> Half(14250,25,5,1) *************** [TRT] --------------- Timing Runner: BoxPredictor_2/BoxEncodingPredictor/Conv2D || BoxPredictor_2/ClassPredictor/Conv2D (CudnnConvolution) [TRT] Tactic: 0 Time: 2.70555 [TRT] Tactic: 1 Time: 2.70714 [TRT] Tactic: 2 Time: 3.05732 [TRT] Tactic: 4 skipped. Scratch requested: 684085248, available: 33554432 [TRT] Tactic: 5 skipped. Scratch requested: 1274796544, available: 33554432 [TRT] Tactic: 6 skipped. Scratch requested: 40000512, available: 33554432 [TRT] Fastest Tactic: 0 Time: 2.70555 [TRT] Setting workspace to 40000512enables more tactics for profiling [TRT] --------------- Timing Runner: BoxPredictor_2/BoxEncodingPredictor/Conv2D || BoxPredictor_2/ClassPredictor/Conv2D (CaskConvolution) [TRT] CaskConvolution has no valid tactics for this config, skipping [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 0 [TRT] *************** Autotuning format combination: Half(6400,25:2,5,1) -> Half(7125,25:2,5,1) *************** [TRT] --------------- Timing Runner: BoxPredictor_2/BoxEncodingPredictor/Conv2D || BoxPredictor_2/ClassPredictor/Conv2D (FusedConvActConvolution) [TRT] Tactic: 524287 Time: 0.989323 [TRT] Tactic: 720895 Time: 0.546355 [TRT] Tactic: 983039 Time: 0.905599 [TRT] Tactic: 1048575 Time: 0.641354 [TRT] Tactic: 1703935 Time: 0.675443 [TRT] Tactic: 1769471 Time: 4.00896 [TRT] Tactic: 1966079 Time: 1.22716 [TRT] Tactic: 2031615 Time: 0.547969 [TRT] Tactic: 2228223 Time: 0.947786 [TRT] Tactic: 2424831 Time: 1.16724 [TRT] Tactic: 2621439 Time: 0.703933 [TRT] Tactic: 2752511 Time: 0.62112 [TRT] Tactic: 3014655 Time: 0.899714 [TRT] Tactic: 3145727 Time: 0.54763 [TRT] Tactic: 3604479 Time: 0.897161 [TRT] Tactic: 4390911 Time: 0.72664 [TRT] Tactic: 5046271 Time: 0.924323 [TRT] Tactic: 5963775 Time: 1.04255 [TRT] Tactic: 6160383 Time: 0.997213 [TRT] Tactic: 6488063 Time: 0.856719 [TRT] Tactic: 6881279 Time: 0.710182 [TRT] Tactic: 7274495 Time: 0.938281 [TRT] Tactic: 7864319 Time: 0.764192 [TRT] Tactic: 7995391 Time: 1.04055 [TRT] Tactic: 8585215 Time: 0.635859 [TRT] Tactic: 8847359 Time: 0.811771 [TRT] Tactic: 8978431 Time: 1.02172 [TRT] Tactic: 9043967 Time: 0.794558 [TRT] Tactic: 9175039 Time: 0.909765 [TRT] Tactic: 9502719 Time: 0.705338 [TRT] Tactic: 9961471 Time: 0.934792 [TRT] Tactic: 10027007 Time: 0.58125 [TRT] Tactic: 10092543 Time: 0.729532 [TRT] Tactic: 10289151 Time: 1.22706 [TRT] Tactic: 10485759 Time: 0.570156 [TRT] Tactic: 10682367 Time: 0.703177 [TRT] Tactic: 10813439 Time: 1.0595 [TRT] Fastest Tactic: 720895 Time: 0.546355 [TRT] --------------- Timing Runner: BoxPredictor_2/BoxEncodingPredictor/Conv2D || BoxPredictor_2/ClassPredictor/Conv2D (CudnnConvolution) [TRT] CudnnConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: BoxPredictor_2/BoxEncodingPredictor/Conv2D || BoxPredictor_2/ClassPredictor/Conv2D (CaskConvolution) [TRT] BoxPredictor_2/BoxEncodingPredictor/Conv2D || BoxPredictor_2/ClassPredictor/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 3564772625446233998 [TRT] Tactic: 3564772625446233998 Time: 2.27281 [TRT] BoxPredictor_2/BoxEncodingPredictor/Conv2D || BoxPredictor_2/ClassPredictor/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 Tactic: 3650389455493082349 [TRT] Tactic: 3650389455493082349 Time: 2.35883 [TRT] BoxPredictor_2/BoxEncodingPredictor/Conv2D || BoxPredictor_2/ClassPredictor/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148m_nt_v1 Tactic: 4772821744921268633 [TRT] Tactic: 4772821744921268633 Time: 0.958307 [TRT] BoxPredictor_2/BoxEncodingPredictor/Conv2D || BoxPredictor_2/ClassPredictor/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: 5319956359050645452 [TRT] Tactic: 5319956359050645452 Time: 1.96008 [TRT] BoxPredictor_2/BoxEncodingPredictor/Conv2D || BoxPredictor_2/ClassPredictor/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 7205456024582378848 [TRT] Tactic: 7205456024582378848 Time: 1.96357 [TRT] BoxPredictor_2/BoxEncodingPredictor/Conv2D || BoxPredictor_2/ClassPredictor/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 Tactic: -6490690591794140522 [TRT] Tactic: -6490690591794140522 Time: 2.02107 [TRT] BoxPredictor_2/BoxEncodingPredictor/Conv2D || BoxPredictor_2/ClassPredictor/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 Tactic: -4686027666808657977 [TRT] Tactic: -4686027666808657977 Time: 2.00568 [TRT] BoxPredictor_2/BoxEncodingPredictor/Conv2D || BoxPredictor_2/ClassPredictor/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -4212163711445252890 [TRT] Tactic: -4212163711445252890 Time: 1.8675 [TRT] BoxPredictor_2/BoxEncodingPredictor/Conv2D || BoxPredictor_2/ClassPredictor/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: -3898373634979201110 [TRT] Tactic: -3898373634979201110 Time: 1.9431 [TRT] BoxPredictor_2/BoxEncodingPredictor/Conv2D || BoxPredictor_2/ClassPredictor/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: -2409163523992614473 [TRT] Tactic: -2409163523992614473 Time: 1.83461 [TRT] Fastest Tactic: 4772821744921268633 Time: 0.958307 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 720895 [TRT] =============== Computing costs for [TRT] *************** Autotuning format combination: Float(14250,25,5,1) -> Float(13650,91,1,1) *************** [TRT] --------------- Timing Runner: (Unnamed Layer* 574) [Shuffle] + BoxPredictor_2/Reshape_1 (Shuffle) [TRT] Tactic: 0 Time: 0.023281 [TRT] Fastest Tactic: 0 Time: 0.023281 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TRT] *************** Autotuning format combination: Float(14250,1,2850,570) -> Float(13650,1,150,150) *************** [TRT] --------------- Timing Runner: (Unnamed Layer* 574) [Shuffle] + BoxPredictor_2/Reshape_1 (Shuffle) [TRT] Tactic: 0 Time: 0.0370575 [TRT] Fastest Tactic: 0 Time: 0.0370575 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TRT] *************** Autotuning format combination: Float(450,25:32,5,1) -> Float(455,91:32,1,1) *************** [TRT] --------------- Timing Runner: (Unnamed Layer* 574) [Shuffle] + BoxPredictor_2/Reshape_1 (Shuffle) [TRT] Tactic: 0 Time: 0.03888 [TRT] Fastest Tactic: 0 Time: 0.03888 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TRT] *************** Autotuning format combination: Half(14250,25,5,1) -> Half(13650,91,1,1) *************** [TRT] --------------- Timing Runner: (Unnamed Layer* 574) [Shuffle] + BoxPredictor_2/Reshape_1 (Shuffle) [TRT] Tactic: 0 Time: 0.021771 [TRT] Fastest Tactic: 0 Time: 0.021771 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TRT] *************** Autotuning format combination: Half(7125,25:2,5,1) -> Half(6825,91:2,1,1) *************** [TRT] --------------- Timing Runner: (Unnamed Layer* 574) [Shuffle] + BoxPredictor_2/Reshape_1 (Shuffle) [TRT] Tactic: 0 Time: 0.0314325 [TRT] Fastest Tactic: 0 Time: 0.0314325 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TRT] =============== Computing costs for [TRT] *************** Autotuning format combination: Float(12800,25,5,1) -> Float(3200,25,5,1) *************** [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Relu6) (FusedConvActConvolution) [TRT] Tactic: 589823 Time: 0.169479 [TRT] Tactic: 655359 Time: 0.0958075 [TRT] Tactic: 786431 Time: 0.073099 [TRT] Tactic: 851967 Time: 0.062526 [TRT] Tactic: 1179647 Time: 0.0780995 [TRT] Tactic: 1310719 Time: 0.25763 [TRT] Tactic: 1376255 Time: 0.190625 [TRT] Tactic: 1441791 Time: 0.0993485 [TRT] Tactic: 1507327 Time: 0.112916 [TRT] Tactic: 1638399 Time: 0.116927 [TRT] Tactic: 1835007 Time: 0.0776825 [TRT] Tactic: 1900543 Time: 0.196042 [TRT] Tactic: 2097151 Time: 0.106745 [TRT] Tactic: 2162687 Time: 0.20125 [TRT] Tactic: 2293759 Time: 0.193567 [TRT] Tactic: 2359295 Time: 0.124141 [TRT] Tactic: 2686975 Time: 0.185365 [TRT] Tactic: 3080191 Time: 0.0725 [TRT] Tactic: 3342335 Time: 0.110677 [TRT] Tactic: 3407871 Time: 0.110833 [TRT] Tactic: 3538943 Time: 0.07263 [TRT] Tactic: 3670015 Time: 0.175833 [TRT] Tactic: 3932159 Time: 0.178724 [TRT] Tactic: 3997695 Time: 0.0508075 [TRT] Tactic: 4063231 Time: 0.065625 [TRT] Tactic: 4194303 Time: 0.0951045 [TRT] Tactic: 4259839 Time: 0.114245 [TRT] Tactic: 4325375 Time: 0.10086 [TRT] Tactic: 4521983 Time: 0.187526 [TRT] Tactic: 4587519 Time: 0.0994795 [TRT] Tactic: 4653055 Time: 0.0840625 [TRT] Tactic: 4915199 Time: 0.101172 [TRT] Tactic: 4980735 Time: 0.121745 [TRT] Tactic: 5177343 Time: 0.109348 [TRT] Tactic: 5242879 Time: 0.105599 [TRT] Tactic: 5373951 Time: 0.0805205 [TRT] Tactic: 5439487 Time: 0.083229 [TRT] Tactic: 5570559 Time: 0.0765105 [TRT] Tactic: 5636095 Time: 0.065625 [TRT] Tactic: 5701631 Time: 0.194479 [TRT] Tactic: 5767167 Time: 0.110807 [TRT] Tactic: 5832703 Time: 0.110078 [TRT] Tactic: 5898239 Time: 0.0839325 [TRT] Tactic: 6029311 Time: 0.184479 [TRT] Tactic: 6225919 Time: 0.067604 [TRT] Tactic: 6291455 Time: 0.0802605 [TRT] Tactic: 6422527 Time: 0.0991405 [TRT] Tactic: 6750207 Time: 0.0908335 [TRT] Tactic: 6815743 Time: 0.106562 [TRT] Tactic: 6946815 Time: 0.0977605 [TRT] Tactic: 7012351 Time: 0.106068 [TRT] Tactic: 7077887 Time: 0.072786 [TRT] Tactic: 7143423 Time: 0.111407 [TRT] Tactic: 7208959 Time: 0.112135 [TRT] Tactic: 7340031 Time: 0.083776 [TRT] Tactic: 7405567 Time: 0.0677605 [TRT] Tactic: 7536639 Time: 0.107682 [TRT] Tactic: 7602175 Time: 0.096146 [TRT] Tactic: 7733247 Time: 0.073516 [TRT] Tactic: 7798783 Time: 0.073568 [TRT] Tactic: 8191999 Time: 0.102995 [TRT] Tactic: 8257535 Time: 0.0999485 [TRT] Tactic: 8323071 Time: 0.0842965 [TRT] Tactic: 8650751 Time: 0.167812 [TRT] Tactic: 8716287 Time: 0.0656515 [TRT] Tactic: 9109503 Time: 0.105937 [TRT] Tactic: 9568255 Time: 0.100754 [TRT] Tactic: 9895935 Time: 0.0949215 [TRT] Tactic: 10223615 Time: 0.185599 [TRT] Tactic: 10354687 Time: 0.116849 [TRT] Tactic: 10551295 Time: 0.113386 [TRT] Tactic: 10747903 Time: 0.0749475 [TRT] Tactic: 10944511 Time: 0.124114 [TRT] Fastest Tactic: 3997695 Time: 0.0508075 [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Relu6) (CudaDepthwiseConvolution) [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Relu6) (CudnnConvolution) [TRT] Tactic: 0 Time: 0.151406 [TRT] Tactic: 1 Time: 0.123698 [TRT] Tactic: 2 Time: 0.299948 [TRT] Tactic: 4 skipped. Scratch requested: 152436736, available: 33554432 [TRT] Tactic: 5 Time: 4.51578 [TRT] Fastest Tactic: 1 Time: 0.123698 [TRT] Setting workspace to 152436736enables more tactics for profiling [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Relu6) (CublasConvolution) [TRT] CublasConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Relu6) (CaskConvolution) [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758 [TRT] Tactic: 1062367460111450758 Time: 0.13651 [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 Tactic: 1698681053543049347 [TRT] Tactic: 1698681053543049347 Time: 0.127292 [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441 [TRT] Tactic: 4501471010995462441 Time: 0.112422 [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826 [TRT] Tactic: 5137655947464784826 Time: 0.112682 [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929 [TRT] Tactic: 5288347012147084929 Time: 0.111224 [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 Tactic: 5326823351883942011 [TRT] Tactic: 5326823351883942011 Time: 0.108725 [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 Tactic: 5500448035057547314 [TRT] Tactic: 5500448035057547314 Time: 0.135052 [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056 [TRT] Tactic: 6645123197870846056 Time: 0.119062 [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478 [TRT] Tactic: 7144526460361122478 Time: 0.137291 [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730 [TRT] Tactic: -8262349710178828730 Time: 0.113308 [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 Tactic: -6576203419454146580 [TRT] Tactic: -6576203419454146580 Time: 0.119479 [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159 [TRT] Tactic: -4787320710726427159 Time: 0.140964 [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839 [TRT] Tactic: -3456450830548107839 Time: 0.123463 [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241 [TRT] Tactic: -1218658103698133241 Time: 0.167604 [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091 [TRT] Tactic: -836875257600482091 Time: 0.134896 [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746 [TRT] Tactic: -410470605513481746 Time: 0.107969 [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 Tactic: -377491875521947884 [TRT] Tactic: -377491875521947884 Time: 0.109323 [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 Tactic: -37215280111360163 [TRT] Tactic: -37215280111360163 Time: 0.106094 [TRT] Fastest Tactic: -37215280111360163 Time: 0.106094 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 3997695 [TRT] *************** Autotuning format combination: Float(12800,1,2560,512) -> Float(3200,1,640,128) *************** [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Relu6) (CudnnConvolution) [TRT] CudnnConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Relu6) (CublasConvolution) [TRT] CublasConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Relu6) (CaskConvolution) [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Relu6) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 3886731678879822788 [TRT] Tactic: 3886731678879822788 Time: 0.0979435 [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Relu6) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 6629944304117643200 [TRT] Tactic: 6629944304117643200 Time: 0.128099 [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Relu6) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -9153228964338181824 [TRT] Tactic: -9153228964338181824 Time: 0.127057 [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Relu6) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -7394439838318485025 [TRT] Tactic: -7394439838318485025 Time: 0.097969 [TRT] Fastest Tactic: 3886731678879822788 Time: 0.0979435 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3886731678879822788 [TRT] *************** Autotuning format combination: Half(12800,25,5,1) -> Half(3200,25,5,1) *************** [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Relu6) (CudnnConvolution) [TRT] Tactic: 0 Time: 0.13276 [TRT] Tactic: 1 Time: 0.126146 [TRT] Tactic: 2 Time: 0.252057 [TRT] Tactic: 4 skipped. Scratch requested: 152436736, available: 33554432 [TRT] Tactic: 5 Time: 4.47055 [TRT] Fastest Tactic: 1 Time: 0.126146 [TRT] Setting workspace to 152436736enables more tactics for profiling [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Relu6) (CublasConvolution) [TRT] CublasConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Relu6) (CaskConvolution) [TRT] CaskConvolution has no valid tactics for this config, skipping [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 1 [TRT] *************** Autotuning format combination: Half(6400,25:2,5,1) -> Half(3200,25,5,1) *************** [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Relu6) (CaskConvolution) [TRT] CaskConvolution has no valid tactics for this config, skipping [TRT] *************** Autotuning format combination: Half(6400,25:2,5,1) -> Half(1600,25:2,5,1) *************** [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Relu6) (FusedConvActConvolution) [TRT] Tactic: 589823 Time: 0.0628385 [TRT] Tactic: 655359 Time: 0.068047 [TRT] Tactic: 786431 Time: 0.039089 [TRT] Tactic: 851967 Time: 0.0297395 [TRT] Tactic: 1179647 Time: 0.037448 [TRT] Tactic: 1310719 Time: 0.158385 [TRT] Tactic: 1376255 Time: 0.0627085 [TRT] Tactic: 1441791 Time: 0.045677 [TRT] Tactic: 1507327 Time: 0.0489325 [TRT] Tactic: 1638399 Time: 0.0565365 [TRT] Tactic: 1835007 Time: 0.0445575 [TRT] Tactic: 1900543 Time: 0.0724215 [TRT] Tactic: 2097151 Time: 0.0664845 [TRT] Tactic: 2162687 Time: 0.066432 [TRT] Tactic: 2293759 Time: 0.0684115 [TRT] Tactic: 2359295 Time: 0.050547 [TRT] Tactic: 2686975 Time: 0.109792 [TRT] Tactic: 3080191 Time: 0.041771 [TRT] Tactic: 3342335 Time: 0.0392705 [TRT] Tactic: 3407871 Time: 0.0424475 [TRT] Tactic: 3538943 Time: 0.040026 [TRT] Tactic: 3670015 Time: 0.132552 [TRT] Tactic: 3932159 Time: 0.0414585 [TRT] Tactic: 3997695 Time: 0.0278905 [TRT] Tactic: 4063231 Time: 0.030156 [TRT] Tactic: 4194303 Time: 0.052005 [TRT] Tactic: 4259839 Time: 0.0691925 [TRT] Tactic: 4325375 Time: 0.063281 [TRT] Tactic: 4521983 Time: 0.067917 [TRT] Tactic: 4587519 Time: 0.0540365 [TRT] Tactic: 4653055 Time: 0.0400515 [TRT] Tactic: 4915199 Time: 0.054453 [TRT] Tactic: 4980735 Time: 0.0553905 [TRT] Tactic: 5177343 Time: 0.046875 [TRT] Tactic: 5242879 Time: 0.041588 [TRT] Tactic: 5373951 Time: 0.0373695 [TRT] Tactic: 5439487 Time: 0.044922 [TRT] Tactic: 5570559 Time: 0.041927 [TRT] Tactic: 5636095 Time: 0.0297655 [TRT] Tactic: 5701631 Time: 0.062474 [TRT] Tactic: 5767167 Time: 0.049349 [TRT] Tactic: 5832703 Time: 0.0438805 [TRT] Tactic: 5898239 Time: 0.0408075 [TRT] Tactic: 6029311 Time: 0.062864 [TRT] Tactic: 6225919 Time: 0.035234 [TRT] Tactic: 6291455 Time: 0.037578 [TRT] Tactic: 6422527 Time: 0.039323 [TRT] Tactic: 6750207 Time: 0.045 [TRT] Tactic: 6815743 Time: 0.039375 [TRT] Tactic: 6946815 Time: 0.0489845 [TRT] Tactic: 7012351 Time: 0.0658855 [TRT] Tactic: 7077887 Time: 0.0367445 [TRT] Tactic: 7143423 Time: 0.052005 [TRT] Tactic: 7208959 Time: 0.051693 [TRT] Tactic: 7340031 Time: 0.042969 [TRT] Tactic: 7405567 Time: 0.035078 [TRT] Tactic: 7536639 Time: 0.052839 [TRT] Tactic: 7602175 Time: 0.0491145 [TRT] Tactic: 7733247 Time: 0.0415885 [TRT] Tactic: 7798783 Time: 0.0391925 [TRT] Tactic: 8191999 Time: 0.0566145 [TRT] Tactic: 8257535 Time: 0.053854 [TRT] Tactic: 8323071 Time: 0.0446615 [TRT] Tactic: 8650751 Time: 0.070026 [TRT] Tactic: 8716287 Time: 0.0349735 [TRT] Tactic: 9109503 Time: 0.067396 [TRT] Tactic: 9568255 Time: 0.0542705 [TRT] Tactic: 9895935 Time: 0.052474 [TRT] Tactic: 10223615 Time: 0.109817 [TRT] Tactic: 10354687 Time: 0.065 [TRT] Tactic: 10551295 Time: 0.0466405 [TRT] Tactic: 10747903 Time: 0.041016 [TRT] Tactic: 10944511 Time: 0.0553385 [TRT] Fastest Tactic: 3997695 Time: 0.0278905 [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Relu6) (CudnnConvolution) [TRT] CudnnConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Relu6) (CublasConvolution) [TRT] CublasConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Relu6) (CaskConvolution) [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Relu6) Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 3066127711859985668 [TRT] Tactic: 3066127711859985668 Time: 0.061823 [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Relu6) Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 3564772625446233998 [TRT] Tactic: 3564772625446233998 Time: 0.0752605 [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Relu6) Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: 5319956359050645452 [TRT] Tactic: 5319956359050645452 Time: 0.0650525 [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Relu6) Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 7205456024582378848 [TRT] Tactic: 7205456024582378848 Time: 0.0613545 [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Relu6) Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 8163473458334948789 [TRT] Tactic: 8163473458334948789 Time: 0.0549215 [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Relu6) Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -4212163711445252890 [TRT] Tactic: -4212163711445252890 Time: 0.056094 [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Relu6) Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: -3898373634979201110 [TRT] Tactic: -3898373634979201110 Time: 0.058724 [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Relu6) Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: -2409163523992614473 [TRT] Tactic: -2409163523992614473 Time: 0.0597395 [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Relu6) Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: -1716393687483585322 [TRT] Tactic: -1716393687483585322 Time: 0.0568745 [TRT] Fastest Tactic: 8163473458334948789 Time: 0.0549215 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 3997695 [TRT] =============== Computing costs for [TRT] *************** Autotuning format combination: Float(3200,25,5,1) -> Float(1152,9,3,1) *************** [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/Relu6) (CudaDepthwiseConvolution) [TRT] Tactic: -1 Time: 0.046797 [TRT] Fastest Tactic: -1 Time: 0.046797 [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/Relu6) (CudnnConvolution) [TRT] Tactic: 0 Time: 0.048542 [TRT] Tactic: 1 Time: 0.0483335 [TRT] Tactic: 2 Time: 0.0482555 [TRT] Tactic: 5 Time: 39.7094 [TRT] Fastest Tactic: 2 Time: 0.0482555 [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/Relu6) (CaskConvolution) [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758 [TRT] Tactic: 1062367460111450758 Time: 3.41919 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v0 Tactic: 1754984623894446479 [TRT] Tactic: 1754984623894446479 Time: 3.56185 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v0 Tactic: 3611739942397549984 [TRT] Tactic: 3611739942397549984 Time: 3.48112 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 Tactic: 4337000649858996379 [TRT] Tactic: 4337000649858996379 Time: 3.56406 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441 [TRT] Tactic: 4501471010995462441 Time: 3.41279 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826 [TRT] Tactic: 5137655947464784826 Time: 3.40422 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929 [TRT] Tactic: 5288347012147084929 Time: 3.16346 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056 [TRT] Tactic: 6645123197870846056 Time: 3.63182 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478 [TRT] Tactic: 7144526460361122478 Time: 3.41417 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 Tactic: -9137461792520977713 [TRT] Tactic: -9137461792520977713 Time: 3.67802 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730 [TRT] Tactic: -8262349710178828730 Time: 3.16003 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v0 Tactic: -8133971918129952780 [TRT] Tactic: -8133971918129952780 Time: 3.59154 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 Tactic: -6092040395344634144 [TRT] Tactic: -6092040395344634144 Time: 3.53984 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159 [TRT] Tactic: -4787320710726427159 Time: 3.69698 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839 [TRT] Tactic: -3456450830548107839 Time: 3.07977 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241 [TRT] Tactic: -1218658103698133241 Time: 3.53719 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091 [TRT] Tactic: -836875257600482091 Time: 3.33227 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746 [TRT] Tactic: -410470605513481746 Time: 3.45323 [TRT] Fastest Tactic: -3456450830548107839 Time: 3.07977 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: -1 [TRT] *************** Autotuning format combination: Float(3200,1,640,128) -> Float(1152,1,384,128) *************** [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/Relu6) (CudnnConvolution) [TRT] CudnnConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/Relu6) (CaskConvolution) [TRT] CaskConvolution has no valid tactics for this config, skipping [TRT] *************** Autotuning format combination: Half(3200,25,5,1) -> Half(1152,9,3,1) *************** [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/Relu6) (CudnnConvolution) [TRT] Tactic: 0 Time: 0.046927 [TRT] Tactic: 1 Time: 0.047344 [TRT] Tactic: 2 Time: 0.0472135 [TRT] Tactic: 5 Time: 39.293 [TRT] Fastest Tactic: 0 Time: 0.046927 [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/Relu6) (CaskConvolution) [TRT] CaskConvolution has no valid tactics for this config, skipping [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 0 [TRT] *************** Autotuning format combination: Half(1600,25:2,5,1) -> Half(576,9:2,3,1) *************** [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/Relu6) (CaskConvolution) [TRT] CaskConvolution has no valid tactics for this config, skipping [TRT] =============== Computing costs for [TRT] *************** Autotuning format combination: Float(1152,9,3,1) -> Float(2304,9,3,1) *************** [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Relu6) (FusedConvActConvolution) [TRT] Tactic: 589823 Time: 0.0322915 [TRT] Tactic: 655359 Time: 0.024739 [TRT] Tactic: 786431 Time: 0.0299485 [TRT] Tactic: 851967 Time: 0.0205725 [TRT] Tactic: 1179647 Time: 0.029688 [TRT] Tactic: 1310719 Time: 0.0683595 [TRT] Tactic: 1376255 Time: 0.034505 [TRT] Tactic: 1441791 Time: 0.0277865 [TRT] Tactic: 1507327 Time: 0.0275005 [TRT] Tactic: 1638399 Time: 0.0341665 [TRT] Tactic: 1835007 Time: 0.025052 [TRT] Tactic: 1900543 Time: 0.0410935 [TRT] Tactic: 2097151 Time: 0.038386 [TRT] Tactic: 2162687 Time: 0.0391665 [TRT] Tactic: 2293759 Time: 0.0396355 [TRT] Tactic: 2359295 Time: 0.0302345 [TRT] Tactic: 2686975 Time: 0.037448 [TRT] Tactic: 3080191 Time: 0.0205465 [TRT] Tactic: 3342335 Time: 0.027916 [TRT] Tactic: 3407871 Time: 0.0324745 [TRT] Tactic: 3538943 Time: 0.0316145 [TRT] Tactic: 3670015 Time: 0.039401 [TRT] Tactic: 3932159 Time: 0.036614 [TRT] Tactic: 3997695 Time: 0.030026 [TRT] Tactic: 4063231 Time: 0.019739 [TRT] Tactic: 4194303 Time: 0.0322395 [TRT] Tactic: 4259839 Time: 0.0396095 [TRT] Tactic: 4325375 Time: 0.0319015 [TRT] Tactic: 4521983 Time: 0.037552 [TRT] Tactic: 4587519 Time: 0.032031 [TRT] Tactic: 4653055 Time: 0.0265105 [TRT] Tactic: 4915199 Time: 0.0322135 [TRT] Tactic: 4980735 Time: 0.033802 [TRT] Tactic: 5177343 Time: 0.020104 [TRT] Tactic: 5242879 Time: 0.0292445 [TRT] Tactic: 5373951 Time: 0.030391 [TRT] Tactic: 5439487 Time: 0.0328385 [TRT] Tactic: 5570559 Time: 0.0227085 [TRT] Tactic: 5636095 Time: 0.0201825 [TRT] Tactic: 5701631 Time: 0.034271 [TRT] Tactic: 5767167 Time: 0.0324745 [TRT] Tactic: 5832703 Time: 0.0322655 [TRT] Tactic: 5898239 Time: 0.0252085 [TRT] Tactic: 6029311 Time: 0.03474 [TRT] Tactic: 6225919 Time: 0.027448 [TRT] Tactic: 6291455 Time: 0.0301825 [TRT] Tactic: 6422527 Time: 0.026588 [TRT] Tactic: 6750207 Time: 0.0321095 [TRT] Tactic: 6815743 Time: 0.028802 [TRT] Tactic: 6946815 Time: 0.044766 [TRT] Tactic: 7012351 Time: 0.038412 [TRT] Tactic: 7077887 Time: 0.0301825 [TRT] Tactic: 7143423 Time: 0.0337755 [TRT] Tactic: 7208959 Time: 0.024974 [TRT] Tactic: 7340031 Time: 0.025026 [TRT] Tactic: 7405567 Time: 0.0219535 [TRT] Tactic: 7536639 Time: 0.026927 [TRT] Tactic: 7602175 Time: 0.0446095 [TRT] Tactic: 7733247 Time: 0.024583 [TRT] Tactic: 7798783 Time: 0.0293755 [TRT] Tactic: 8191999 Time: 0.041459 [TRT] Tactic: 8257535 Time: 0.032214 [TRT] Tactic: 8323071 Time: 0.03263 [TRT] Tactic: 8650751 Time: 0.0246355 [TRT] Tactic: 8716287 Time: 0.02612 [TRT] Tactic: 9109503 Time: 0.0367185 [TRT] Tactic: 9568255 Time: 0.032083 [TRT] Tactic: 9895935 Time: 0.0322395 [TRT] Tactic: 10223615 Time: 0.036797 [TRT] Tactic: 10354687 Time: 0.0381775 [TRT] Tactic: 10551295 Time: 0.032422 [TRT] Tactic: 10747903 Time: 0.024063 [TRT] Tactic: 10944511 Time: 0.033672 [TRT] Fastest Tactic: 4063231 Time: 0.019739 [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Relu6) (CudaDepthwiseConvolution) [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Relu6) (CudnnConvolution) [TRT] Tactic: 0 Time: 0.099167 [TRT] Tactic: 1 Time: 0.100156 [TRT] Tactic: 2 Time: 0.163411 [TRT] Tactic: 4 skipped. Scratch requested: 75923456, available: 33554432 [TRT] Tactic: 5 Time: 2.33469 [TRT] Fastest Tactic: 0 Time: 0.099167 [TRT] Setting workspace to 75923456enables more tactics for profiling [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Relu6) (CublasConvolution) [TRT] CublasConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Relu6) (CaskConvolution) [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758 [TRT] Tactic: 1062367460111450758 Time: 0.0783595 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 Tactic: 1698681053543049347 [TRT] Tactic: 1698681053543049347 Time: 0.069193 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441 [TRT] Tactic: 4501471010995462441 Time: 0.060104 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826 [TRT] Tactic: 5137655947464784826 Time: 0.0651565 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929 [TRT] Tactic: 5288347012147084929 Time: 0.06039 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 Tactic: 5326823351883942011 [TRT] Tactic: 5326823351883942011 Time: 0.058672 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 Tactic: 5500448035057547314 [TRT] Tactic: 5500448035057547314 Time: 0.0632035 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056 [TRT] Tactic: 6645123197870846056 Time: 0.066823 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478 [TRT] Tactic: 7144526460361122478 Time: 0.0788545 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730 [TRT] Tactic: -8262349710178828730 Time: 0.061172 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 Tactic: -6576203419454146580 [TRT] Tactic: -6576203419454146580 Time: 0.0734115 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159 [TRT] Tactic: -4787320710726427159 Time: 0.0767965 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839 [TRT] Tactic: -3456450830548107839 Time: 0.0737765 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241 [TRT] Tactic: -1218658103698133241 Time: 0.0651305 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091 [TRT] Tactic: -836875257600482091 Time: 0.0651825 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746 [TRT] Tactic: -410470605513481746 Time: 0.05987 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 Tactic: -377491875521947884 [TRT] Tactic: -377491875521947884 Time: 0.059088 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 Tactic: -37215280111360163 [TRT] Tactic: -37215280111360163 Time: 0.074948 [TRT] Fastest Tactic: 5326823351883942011 Time: 0.058672 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 4063231 [TRT] *************** Autotuning format combination: Float(1152,1,384,128) -> Float(2304,1,768,256) *************** [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Relu6) (CudnnConvolution) [TRT] CudnnConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Relu6) (CublasConvolution) [TRT] CublasConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Relu6) (CaskConvolution) [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Relu6) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 3886731678879822788 [TRT] Tactic: 3886731678879822788 Time: 0.0623175 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Relu6) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 6629944304117643200 [TRT] Tactic: 6629944304117643200 Time: 0.108958 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Relu6) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -9153228964338181824 [TRT] Tactic: -9153228964338181824 Time: 0.108854 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Relu6) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -7394439838318485025 [TRT] Tactic: -7394439838318485025 Time: 0.0641925 [TRT] Fastest Tactic: 3886731678879822788 Time: 0.0623175 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3886731678879822788 [TRT] *************** Autotuning format combination: Half(1152,9,3,1) -> Half(2304,9,3,1) *************** [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Relu6) (CudnnConvolution) [TRT] Tactic: 0 Time: 0.102917 [TRT] Tactic: 1 Time: 0.0976565 [TRT] Tactic: 2 Time: 0.162161 [TRT] Tactic: 4 skipped. Scratch requested: 75923456, available: 33554432 [TRT] Tactic: 5 Time: 2.32802 [TRT] Fastest Tactic: 1 Time: 0.0976565 [TRT] Setting workspace to 75923456enables more tactics for profiling [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Relu6) (CublasConvolution) [TRT] CublasConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Relu6) (CaskConvolution) [TRT] CaskConvolution has no valid tactics for this config, skipping [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 1 [TRT] *************** Autotuning format combination: Half(576,9:2,3,1) -> Half(2304,9,3,1) *************** [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Relu6) (CaskConvolution) [TRT] CaskConvolution has no valid tactics for this config, skipping [TRT] *************** Autotuning format combination: Half(576,9:2,3,1) -> Half(1152,9:2,3,1) *************** [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Relu6) (FusedConvActConvolution) [TRT] Tactic: 589823 Time: 0.0219005 [TRT] Tactic: 655359 Time: 0.0247915 [TRT] Tactic: 786431 Time: 0.0211975 [TRT] Tactic: 851967 Time: 0.012891 [TRT] Tactic: 1179647 Time: 0.0198175 [TRT] Tactic: 1310719 Time: 0.0497135 [TRT] Tactic: 1376255 Time: 0.0215365 [TRT] Tactic: 1441791 Time: 0.020104 [TRT] Tactic: 1507327 Time: 0.0201825 [TRT] Tactic: 1638399 Time: 0.022995 [TRT] Tactic: 1835007 Time: 0.0176305 [TRT] Tactic: 1900543 Time: 0.0270055 [TRT] Tactic: 2097151 Time: 0.0297655 [TRT] Tactic: 2162687 Time: 0.024583 [TRT] Tactic: 2293759 Time: 0.024948 [TRT] Tactic: 2359295 Time: 0.0219005 [TRT] Tactic: 2686975 Time: 0.034661 [TRT] Tactic: 3080191 Time: 0.0175785 [TRT] Tactic: 3342335 Time: 0.0200525 [TRT] Tactic: 3407871 Time: 0.0203645 [TRT] Tactic: 3538943 Time: 0.0203125 [TRT] Tactic: 3670015 Time: 0.041094 [TRT] Tactic: 3932159 Time: 0.015443 [TRT] Tactic: 3997695 Time: 0.022292 [TRT] Tactic: 4063231 Time: 0.013125 [TRT] Tactic: 4194303 Time: 0.0217965 [TRT] Tactic: 4259839 Time: 0.031094 [TRT] Tactic: 4325375 Time: 0.025286 [TRT] Tactic: 4521983 Time: 0.0251825 [TRT] Tactic: 4587519 Time: 0.02276 [TRT] Tactic: 4653055 Time: 0.0194535 [TRT] Tactic: 4915199 Time: 0.022838 [TRT] Tactic: 4980735 Time: 0.022761 [TRT] Tactic: 5177343 Time: 0.012604 [TRT] Tactic: 5242879 Time: 0.0177865 [TRT] Tactic: 5373951 Time: 0.020105 [TRT] Tactic: 5439487 Time: 0.025208 [TRT] Tactic: 5570559 Time: 0.018151 [TRT] Tactic: 5636095 Time: 0.014245 [TRT] Tactic: 5701631 Time: 0.020052 [TRT] Tactic: 5767167 Time: 0.017995 [TRT] Tactic: 5832703 Time: 0.0201825 [TRT] Tactic: 5898239 Time: 0.019739 [TRT] Tactic: 6029311 Time: 0.02138 [TRT] Tactic: 6225919 Time: 0.0173175 [TRT] Tactic: 6291455 Time: 0.020339 [TRT] Tactic: 6422527 Time: 0.0178125 [TRT] Tactic: 6750207 Time: 0.0251825 [TRT] Tactic: 6815743 Time: 0.0180215 [TRT] Tactic: 6946815 Time: 0.027422 [TRT] Tactic: 7012351 Time: 0.0297655 [TRT] Tactic: 7077887 Time: 0.0180985 [TRT] Tactic: 7143423 Time: 0.019974 [TRT] Tactic: 7208959 Time: 0.015677 [TRT] Tactic: 7340031 Time: 0.019609 [TRT] Tactic: 7405567 Time: 0.015677 [TRT] Tactic: 7536639 Time: 0.018125 [TRT] Tactic: 7602175 Time: 0.0263285 [TRT] Tactic: 7733247 Time: 0.0168235 [TRT] Tactic: 7798783 Time: 0.020547 [TRT] Tactic: 8191999 Time: 0.0228905 [TRT] Tactic: 8257535 Time: 0.0226565 [TRT] Tactic: 8323071 Time: 0.0251825 [TRT] Tactic: 8650751 Time: 0.0154165 [TRT] Tactic: 8716287 Time: 0.0180205 [TRT] Tactic: 9109503 Time: 0.029271 [TRT] Tactic: 9568255 Time: 0.022708 [TRT] Tactic: 9895935 Time: 0.022604 [TRT] Tactic: 10223615 Time: 0.0346355 [TRT] Tactic: 10354687 Time: 0.028854 [TRT] Tactic: 10551295 Time: 0.0209115 [TRT] Tactic: 10747903 Time: 0.017682 [TRT] Tactic: 10944511 Time: 0.0226825 [TRT] Fastest Tactic: 5177343 Time: 0.012604 [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Relu6) (CudnnConvolution) [TRT] CudnnConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Relu6) (CublasConvolution) [TRT] CublasConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Relu6) (CaskConvolution) [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Relu6) Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 3066127711859985668 [TRT] Tactic: 3066127711859985668 Time: 0.042474 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Relu6) Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 3564772625446233998 [TRT] Tactic: 3564772625446233998 Time: 0.0475785 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Relu6) Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: 5319956359050645452 [TRT] Tactic: 5319956359050645452 Time: 0.0435675 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Relu6) Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 7205456024582378848 [TRT] Tactic: 7205456024582378848 Time: 0.0389845 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Relu6) Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 8163473458334948789 [TRT] Tactic: 8163473458334948789 Time: 0.036276 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Relu6) Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -4212163711445252890 [TRT] Tactic: -4212163711445252890 Time: 0.033724 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Relu6) Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: -3898373634979201110 [TRT] Tactic: -3898373634979201110 Time: 0.035026 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Relu6) Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: -2409163523992614473 [TRT] Tactic: -2409163523992614473 Time: 0.0374475 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Relu6) Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: -1716393687483585322 [TRT] Tactic: -1716393687483585322 Time: 0.033906 [TRT] Fastest Tactic: -4212163711445252890 Time: 0.033724 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 5177343 [TRT] =============== Computing costs for [TRT] *************** Autotuning format combination: Float(2304,9,3,1) -> Float(5130,9,3,1) *************** [TRT] --------------- Timing Runner: BoxPredictor_3/BoxEncodingPredictor/Conv2D || BoxPredictor_3/ClassPredictor/Conv2D (FusedConvActConvolution) [TRT] Tactic: 524287 Time: 0.533672 [TRT] Tactic: 720895 Time: 0.545469 [TRT] Tactic: 983039 Time: 0.446902 [TRT] Tactic: 1048575 Time: 0.660599 [TRT] Tactic: 1703935 Time: 0.625391 [TRT] Tactic: 1769471 Time: 0.566015 [TRT] Tactic: 1966079 Time: 0.608204 [TRT] Tactic: 2031615 Time: 0.528906 [TRT] Tactic: 2228223 Time: 0.909505 [TRT] Tactic: 2424831 Time: 0.81513 [TRT] Tactic: 2621439 Time: 0.696485 [TRT] Tactic: 2752511 Time: 0.636614 [TRT] Tactic: 3014655 Time: 0.838021 [TRT] Tactic: 3145727 Time: 0.534948 [TRT] Tactic: 3604479 Time: 0.831901 [TRT] Tactic: 4390911 Time: 0.69164 [TRT] Tactic: 5046271 Time: 0.500494 [TRT] Tactic: 5963775 Time: 0.553072 [TRT] Tactic: 6160383 Time: 0.510156 [TRT] Tactic: 6488063 Time: 0.824427 [TRT] Tactic: 6881279 Time: 0.471067 [TRT] Tactic: 7274495 Time: 0.433438 [TRT] Tactic: 7864319 Time: 0.716484 [TRT] Tactic: 7995391 Time: 0.588333 [TRT] Tactic: 8585215 Time: 0.598828 [TRT] Tactic: 8847359 Time: 0.797995 [TRT] Tactic: 8978431 Time: 0.558984 [TRT] Tactic: 9043967 Time: 0.762266 [TRT] Tactic: 9175039 Time: 0.82401 [TRT] Tactic: 9502719 Time: 0.723907 [TRT] Tactic: 9961471 Time: 0.882474 [TRT] Tactic: 10027007 Time: 0.555573 [TRT] Tactic: 10092543 Time: 0.690261 [TRT] Tactic: 10289151 Time: 0.61315 [TRT] Tactic: 10485759 Time: 0.553125 [TRT] Tactic: 10682367 Time: 0.699818 [TRT] Tactic: 10813439 Time: 0.495052 [TRT] Fastest Tactic: 7274495 Time: 0.433438 [TRT] --------------- Timing Runner: BoxPredictor_3/BoxEncodingPredictor/Conv2D || BoxPredictor_3/ClassPredictor/Conv2D (CudaDepthwiseConvolution) [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: BoxPredictor_3/BoxEncodingPredictor/Conv2D || BoxPredictor_3/ClassPredictor/Conv2D (CudnnConvolution) [TRT] Tactic: 0 Time: 1.96367 [TRT] Tactic: 1 Time: 2.04896 [TRT] Tactic: 2 Time: 1.63326 [TRT] Tactic: 4 skipped. Scratch requested: 342042624, available: 33554432 [TRT] Tactic: 5 skipped. Scratch requested: 638638592, available: 33554432 [TRT] Tactic: 6 Time: 1.91935 [TRT] Fastest Tactic: 2 Time: 1.63326 [TRT] Setting workspace to 342042624enables more tactics for profiling [TRT] --------------- Timing Runner: BoxPredictor_3/BoxEncodingPredictor/Conv2D || BoxPredictor_3/ClassPredictor/Conv2D (CaskConvolution) [TRT] BoxPredictor_3/BoxEncodingPredictor/Conv2D || BoxPredictor_3/ClassPredictor/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758 [TRT] Tactic: 1062367460111450758 Time: 2.26922 [TRT] BoxPredictor_3/BoxEncodingPredictor/Conv2D || BoxPredictor_3/ClassPredictor/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v0 Tactic: 1754984623894446479 [TRT] Tactic: 1754984623894446479 Time: 2.72794 [TRT] BoxPredictor_3/BoxEncodingPredictor/Conv2D || BoxPredictor_3/ClassPredictor/Conv2D Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v0 Tactic: 3611739942397549984 [TRT] Tactic: 3611739942397549984 Time: 2.03544 [TRT] BoxPredictor_3/BoxEncodingPredictor/Conv2D || BoxPredictor_3/ClassPredictor/Conv2D Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v1 Tactic: 3827454225649558724 [TRT] Tactic: 3827454225649558724 Time: 1.23602 [TRT] BoxPredictor_3/BoxEncodingPredictor/Conv2D || BoxPredictor_3/ClassPredictor/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 Tactic: 4337000649858996379 [TRT] Tactic: 4337000649858996379 Time: 2.03716 [TRT] BoxPredictor_3/BoxEncodingPredictor/Conv2D || BoxPredictor_3/ClassPredictor/Conv2D Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441 [TRT] Tactic: 4501471010995462441 Time: 2.00526 [TRT] BoxPredictor_3/BoxEncodingPredictor/Conv2D || BoxPredictor_3/ClassPredictor/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826 [TRT] Tactic: 5137655947464784826 Time: 1.82141 [TRT] BoxPredictor_3/BoxEncodingPredictor/Conv2D || BoxPredictor_3/ClassPredictor/Conv2D Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929 [TRT] Tactic: 5288347012147084929 Time: 1.97953 [TRT] BoxPredictor_3/BoxEncodingPredictor/Conv2D || BoxPredictor_3/ClassPredictor/Conv2D Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148m_nt_v1 Tactic: 5921334924264294896 [TRT] Tactic: 5921334924264294896 Time: 0.954219 [TRT] BoxPredictor_3/BoxEncodingPredictor/Conv2D || BoxPredictor_3/ClassPredictor/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056 [TRT] Tactic: 6645123197870846056 Time: 1.97607 [TRT] BoxPredictor_3/BoxEncodingPredictor/Conv2D || BoxPredictor_3/ClassPredictor/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478 [TRT] Tactic: 7144526460361122478 Time: 2.36375 [TRT] BoxPredictor_3/BoxEncodingPredictor/Conv2D || BoxPredictor_3/ClassPredictor/Conv2D Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 Tactic: 7852627285308570038 [TRT] Tactic: 7852627285308570038 Time: 1.2675 [TRT] BoxPredictor_3/BoxEncodingPredictor/Conv2D || BoxPredictor_3/ClassPredictor/Conv2D Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 Tactic: -9137461792520977713 [TRT] Tactic: -9137461792520977713 Time: 2.0601 [TRT] BoxPredictor_3/BoxEncodingPredictor/Conv2D || BoxPredictor_3/ClassPredictor/Conv2D Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v0 Tactic: -8776506421218919509 [TRT] Tactic: -8776506421218919509 Time: 1.22818 [TRT] BoxPredictor_3/BoxEncodingPredictor/Conv2D || BoxPredictor_3/ClassPredictor/Conv2D Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730 [TRT] Tactic: -8262349710178828730 Time: 2.05312 [TRT] BoxPredictor_3/BoxEncodingPredictor/Conv2D || BoxPredictor_3/ClassPredictor/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v0 Tactic: -8133971918129952780 [TRT] Tactic: -8133971918129952780 Time: 2.37299 [TRT] BoxPredictor_3/BoxEncodingPredictor/Conv2D || BoxPredictor_3/ClassPredictor/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 Tactic: -6092040395344634144 [TRT] Tactic: -6092040395344634144 Time: 2.37266 [TRT] BoxPredictor_3/BoxEncodingPredictor/Conv2D || BoxPredictor_3/ClassPredictor/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159 [TRT] Tactic: -4787320710726427159 Time: 2.73776 [TRT] BoxPredictor_3/BoxEncodingPredictor/Conv2D || BoxPredictor_3/ClassPredictor/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839 [TRT] Tactic: -3456450830548107839 Time: 1.95107 [TRT] BoxPredictor_3/BoxEncodingPredictor/Conv2D || BoxPredictor_3/ClassPredictor/Conv2D Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v0 Tactic: -2318106587342035239 [TRT] Tactic: -2318106587342035239 Time: 1.22141 [TRT] BoxPredictor_3/BoxEncodingPredictor/Conv2D || BoxPredictor_3/ClassPredictor/Conv2D Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_mobile_relu_tile148t_nt_v0 Tactic: -1343271414618805657 [TRT] Tactic: -1343271414618805657 Time: 0.932317 [TRT] BoxPredictor_3/BoxEncodingPredictor/Conv2D || BoxPredictor_3/ClassPredictor/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241 [TRT] Tactic: -1218658103698133241 Time: 2.34737 [TRT] BoxPredictor_3/BoxEncodingPredictor/Conv2D || BoxPredictor_3/ClassPredictor/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091 [TRT] Tactic: -836875257600482091 Time: 2.14924 [TRT] BoxPredictor_3/BoxEncodingPredictor/Conv2D || BoxPredictor_3/ClassPredictor/Conv2D Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746 [TRT] Tactic: -410470605513481746 Time: 1.91307 [TRT] Fastest Tactic: -1343271414618805657 Time: 0.932317 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 7274495 [TRT] *************** Autotuning format combination: Float(2304,1,768,256) -> Float(5130,1,1710,570) *************** [TRT] --------------- Timing Runner: BoxPredictor_3/BoxEncodingPredictor/Conv2D || BoxPredictor_3/ClassPredictor/Conv2D (CudnnConvolution) [TRT] CudnnConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: BoxPredictor_3/BoxEncodingPredictor/Conv2D || BoxPredictor_3/ClassPredictor/Conv2D (CaskConvolution) [TRT] CaskConvolution has no valid tactics for this config, skipping [TRT] *************** Autotuning format combination: Half(2304,9,3,1) -> Half(5130,9,3,1) *************** [TRT] --------------- Timing Runner: BoxPredictor_3/BoxEncodingPredictor/Conv2D || BoxPredictor_3/ClassPredictor/Conv2D (CudnnConvolution) [TRT] Tactic: 0 Time: 1.37018 [TRT] Tactic: 1 Time: 1.38534 [TRT] Tactic: 2 Time: 1.64344 [TRT] Tactic: 4 skipped. Scratch requested: 342042624, available: 33554432 [TRT] Tactic: 5 skipped. Scratch requested: 638638592, available: 33554432 [TRT] Tactic: 6 Time: 3.34258 [TRT] Fastest Tactic: 0 Time: 1.37018 [TRT] Setting workspace to 342042624enables more tactics for profiling [TRT] --------------- Timing Runner: BoxPredictor_3/BoxEncodingPredictor/Conv2D || BoxPredictor_3/ClassPredictor/Conv2D (CaskConvolution) [TRT] CaskConvolution has no valid tactics for this config, skipping [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 0 [TRT] *************** Autotuning format combination: Half(1152,9:2,3,1) -> Half(2565,9:2,3,1) *************** [TRT] --------------- Timing Runner: BoxPredictor_3/BoxEncodingPredictor/Conv2D || BoxPredictor_3/ClassPredictor/Conv2D (FusedConvActConvolution) [TRT] Tactic: 524287 Time: 0.282448 [TRT] Tactic: 720895 Time: 0.291849 [TRT] Tactic: 983039 Time: 0.248568 [TRT] Tactic: 1048575 Time: 0.359506 [TRT] Tactic: 1703935 Time: 0.35013 [TRT] Tactic: 1769471 Time: 2.01904 [TRT] Tactic: 1966079 Time: 0.357449 [TRT] Tactic: 2031615 Time: 0.286458 [TRT] Tactic: 2228223 Time: 0.461823 [TRT] Tactic: 2424831 Time: 0.616719 [TRT] Tactic: 2621439 Time: 0.379557 [TRT] Tactic: 2752511 Time: 0.337786 [TRT] Tactic: 3014655 Time: 0.471276 [TRT] Tactic: 3145727 Time: 0.300755 [TRT] Tactic: 3604479 Time: 0.47 [TRT] Tactic: 4390911 Time: 0.386485 [TRT] Tactic: 5046271 Time: 0.264453 [TRT] Tactic: 5963775 Time: 0.312161 [TRT] Tactic: 6160383 Time: 0.281198 [TRT] Tactic: 6488063 Time: 0.441041 [TRT] Tactic: 6881279 Time: 0.257681 [TRT] Tactic: 7274495 Time: 0.256093 [TRT] Tactic: 7864319 Time: 0.413229 [TRT] Tactic: 7995391 Time: 0.326823 [TRT] Tactic: 8585215 Time: 0.346042 [TRT] Tactic: 8847359 Time: 0.432057 [TRT] Tactic: 8978431 Time: 0.309375 [TRT] Tactic: 9043967 Time: 0.419479 [TRT] Tactic: 9175039 Time: 0.467813 [TRT] Tactic: 9502719 Time: 0.370521 [TRT] Tactic: 9961471 Time: 0.495885 [TRT] Tactic: 10027007 Time: 0.312604 [TRT] Tactic: 10092543 Time: 0.383672 [TRT] Tactic: 10289151 Time: 0.351849 [TRT] Tactic: 10485759 Time: 0.295547 [TRT] Tactic: 10682367 Time: 0.37224 [TRT] Tactic: 10813439 Time: 0.282865 [TRT] Fastest Tactic: 983039 Time: 0.248568 [TRT] --------------- Timing Runner: BoxPredictor_3/BoxEncodingPredictor/Conv2D || BoxPredictor_3/ClassPredictor/Conv2D (CudnnConvolution) [TRT] CudnnConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: BoxPredictor_3/BoxEncodingPredictor/Conv2D || BoxPredictor_3/ClassPredictor/Conv2D (CaskConvolution) [TRT] BoxPredictor_3/BoxEncodingPredictor/Conv2D || BoxPredictor_3/ClassPredictor/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 3564772625446233998 [TRT] Tactic: 3564772625446233998 Time: 1.14685 [TRT] BoxPredictor_3/BoxEncodingPredictor/Conv2D || BoxPredictor_3/ClassPredictor/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_large_nn_v1 Tactic: 3650389455493082349 [TRT] Tactic: 3650389455493082349 Time: 1.18633 [TRT] BoxPredictor_3/BoxEncodingPredictor/Conv2D || BoxPredictor_3/ClassPredictor/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148m_nt_v1 Tactic: 4772821744921268633 [TRT] Tactic: 4772821744921268633 Time: 0.526224 [TRT] BoxPredictor_3/BoxEncodingPredictor/Conv2D || BoxPredictor_3/ClassPredictor/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: 5319956359050645452 [TRT] Tactic: 5319956359050645452 Time: 0.991016 [TRT] BoxPredictor_3/BoxEncodingPredictor/Conv2D || BoxPredictor_3/ClassPredictor/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 7205456024582378848 [TRT] Tactic: 7205456024582378848 Time: 0.989583 [TRT] BoxPredictor_3/BoxEncodingPredictor/Conv2D || BoxPredictor_3/ClassPredictor/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_large_nn_v1 Tactic: -6490690591794140522 [TRT] Tactic: -6490690591794140522 Time: 1.01768 [TRT] BoxPredictor_3/BoxEncodingPredictor/Conv2D || BoxPredictor_3/ClassPredictor/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_large_nn_v1 Tactic: -4686027666808657977 [TRT] Tactic: -4686027666808657977 Time: 1.02138 [TRT] BoxPredictor_3/BoxEncodingPredictor/Conv2D || BoxPredictor_3/ClassPredictor/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -4212163711445252890 [TRT] Tactic: -4212163711445252890 Time: 0.958073 [TRT] BoxPredictor_3/BoxEncodingPredictor/Conv2D || BoxPredictor_3/ClassPredictor/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: -3898373634979201110 [TRT] Tactic: -3898373634979201110 Time: 0.979062 [TRT] BoxPredictor_3/BoxEncodingPredictor/Conv2D || BoxPredictor_3/ClassPredictor/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: -2409163523992614473 [TRT] Tactic: -2409163523992614473 Time: 0.904401 [TRT] Fastest Tactic: 4772821744921268633 Time: 0.526224 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 983039 [TRT] =============== Computing costs for [TRT] *************** Autotuning format combination: Float(5130,9,3,1) -> Float(4914,91,1,1) *************** [TRT] --------------- Timing Runner: (Unnamed Layer* 615) [Shuffle] + BoxPredictor_3/Reshape_1 (Shuffle) [TRT] Tactic: 0 Time: 0.010495 [TRT] Fastest Tactic: 0 Time: 0.010495 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TRT] *************** Autotuning format combination: Float(5130,1,1710,570) -> Float(4914,1,54,54) *************** [TRT] --------------- Timing Runner: (Unnamed Layer* 615) [Shuffle] + BoxPredictor_3/Reshape_1 (Shuffle) [TRT] Tactic: 0 Time: 0.015781 [TRT] Fastest Tactic: 0 Time: 0.015781 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TRT] *************** Autotuning format combination: Float(162,9:32,3,1) -> Float(182,91:32,1,1) *************** [TRT] --------------- Timing Runner: (Unnamed Layer* 615) [Shuffle] + BoxPredictor_3/Reshape_1 (Shuffle) [TRT] Tactic: 0 Time: 0.018099 [TRT] Fastest Tactic: 0 Time: 0.018099 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TRT] *************** Autotuning format combination: Half(5130,9,3,1) -> Half(4914,91,1,1) *************** [TRT] --------------- Timing Runner: (Unnamed Layer* 615) [Shuffle] + BoxPredictor_3/Reshape_1 (Shuffle) [TRT] Tactic: 0 Time: 0.010703 [TRT] Fastest Tactic: 0 Time: 0.010703 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TRT] *************** Autotuning format combination: Half(2565,9:2,3,1) -> Half(2457,91:2,1,1) *************** [TRT] --------------- Timing Runner: (Unnamed Layer* 615) [Shuffle] + BoxPredictor_3/Reshape_1 (Shuffle) [TRT] Tactic: 0 Time: 0.012943 [TRT] Fastest Tactic: 0 Time: 0.012943 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TRT] =============== Computing costs for [TRT] *************** Autotuning format combination: Float(2304,9,3,1) -> Float(1152,9,3,1) *************** [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Relu6) (FusedConvActConvolution) [TRT] Tactic: 589823 Time: 0.0485155 [TRT] Tactic: 655359 Time: 0.038047 [TRT] Tactic: 786431 Time: 0.0332295 [TRT] Tactic: 851967 Time: 0.021536 [TRT] Tactic: 1179647 Time: 0.027917 [TRT] Tactic: 1310719 Time: 0.102839 [TRT] Tactic: 1376255 Time: 0.060781 [TRT] Tactic: 1441791 Time: 0.023516 [TRT] Tactic: 1507327 Time: 0.037709 [TRT] Tactic: 1638399 Time: 0.029922 [TRT] Tactic: 1835007 Time: 0.02776 [TRT] Tactic: 1900543 Time: 0.067604 [TRT] Tactic: 2097151 Time: 0.0312245 [TRT] Tactic: 2162687 Time: 0.068333 [TRT] Tactic: 2293759 Time: 0.063698 [TRT] Tactic: 2359295 Time: 0.0408075 [TRT] Tactic: 2686975 Time: 0.0583855 [TRT] Tactic: 3080191 Time: 0.022422 [TRT] Tactic: 3342335 Time: 0.037943 [TRT] Tactic: 3407871 Time: 0.0397135 [TRT] Tactic: 3538943 Time: 0.0292705 [TRT] Tactic: 3670015 Time: 0.0650255 [TRT] Tactic: 3932159 Time: 0.058724 [TRT] Tactic: 3997695 Time: 0.0260675 [TRT] Tactic: 4063231 Time: 0.0227605 [TRT] Tactic: 4194303 Time: 0.033906 [TRT] Tactic: 4259839 Time: 0.033698 [TRT] Tactic: 4325375 Time: 0.031172 [TRT] Tactic: 4521983 Time: 0.0619795 [TRT] Tactic: 4587519 Time: 0.0279425 [TRT] Tactic: 4653055 Time: 0.0228645 [TRT] Tactic: 4915199 Time: 0.027734 [TRT] Tactic: 4980735 Time: 0.0491405 [TRT] Tactic: 5177343 Time: 0.015651 [TRT] Tactic: 5242879 Time: 0.037735 [TRT] Tactic: 5373951 Time: 0.0277085 [TRT] Tactic: 5439487 Time: 0.032968 [TRT] Tactic: 5570559 Time: 0.025052 [TRT] Tactic: 5636095 Time: 0.022735 [TRT] Tactic: 5701631 Time: 0.058385 [TRT] Tactic: 5767167 Time: 0.037396 [TRT] Tactic: 5832703 Time: 0.0388545 [TRT] Tactic: 5898239 Time: 0.022787 [TRT] Tactic: 6029311 Time: 0.058047 [TRT] Tactic: 6225919 Time: 0.0252085 [TRT] Tactic: 6291455 Time: 0.027708 [TRT] Tactic: 6422527 Time: 0.0322655 [TRT] Tactic: 6750207 Time: 0.0283855 [TRT] Tactic: 6815743 Time: 0.036797 [TRT] Tactic: 6946815 Time: 0.03862 [TRT] Tactic: 7012351 Time: 0.031979 [TRT] Tactic: 7077887 Time: 0.027656 [TRT] Tactic: 7143423 Time: 0.037578 [TRT] Tactic: 7208959 Time: 0.034323 [TRT] Tactic: 7340031 Time: 0.0225785 [TRT] Tactic: 7405567 Time: 0.022787 [TRT] Tactic: 7536639 Time: 0.040052 [TRT] Tactic: 7602175 Time: 0.0386715 [TRT] Tactic: 7733247 Time: 0.0272135 [TRT] Tactic: 7798783 Time: 0.0322655 [TRT] Tactic: 8191999 Time: 0.035078 [TRT] Tactic: 8257535 Time: 0.0276825 [TRT] Tactic: 8323071 Time: 0.032344 [TRT] Tactic: 8650751 Time: 0.0338805 [TRT] Tactic: 8716287 Time: 0.024974 [TRT] Tactic: 9109503 Time: 0.0321875 [TRT] Tactic: 9568255 Time: 0.0274215 [TRT] Tactic: 9895935 Time: 0.0340625 [TRT] Tactic: 10223615 Time: 0.0586195 [TRT] Tactic: 10354687 Time: 0.036146 [TRT] Tactic: 10551295 Time: 0.0409375 [TRT] Tactic: 10747903 Time: 0.026875 [TRT] Tactic: 10944511 Time: 0.0492185 [TRT] Fastest Tactic: 5177343 Time: 0.015651 [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Relu6) (CudaDepthwiseConvolution) [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Relu6) (CudnnConvolution) [TRT] Tactic: 0 Time: 0.08974 [TRT] Tactic: 1 Time: 0.0820575 [TRT] Tactic: 2 Time: 0.205989 [TRT] Tactic: 4 skipped. Scratch requested: 76218368, available: 33554432 [TRT] Tactic: 5 Time: 2.3237 [TRT] Fastest Tactic: 1 Time: 0.0820575 [TRT] Setting workspace to 76218368enables more tactics for profiling [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Relu6) (CublasConvolution) [TRT] CublasConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Relu6) (CaskConvolution) [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758 [TRT] Tactic: 1062367460111450758 Time: 0.073411 [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 Tactic: 1698681053543049347 [TRT] Tactic: 1698681053543049347 Time: 0.066823 [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441 [TRT] Tactic: 4501471010995462441 Time: 0.061771 [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826 [TRT] Tactic: 5137655947464784826 Time: 0.064114 [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929 [TRT] Tactic: 5288347012147084929 Time: 0.0596355 [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 Tactic: 5326823351883942011 [TRT] Tactic: 5326823351883942011 Time: 0.0583595 [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 Tactic: 5500448035057547314 [TRT] Tactic: 5500448035057547314 Time: 0.0667705 [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056 [TRT] Tactic: 6645123197870846056 Time: 0.068542 [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478 [TRT] Tactic: 7144526460361122478 Time: 0.066276 [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730 [TRT] Tactic: -8262349710178828730 Time: 0.059036 [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 Tactic: -6576203419454146580 [TRT] Tactic: -6576203419454146580 Time: 0.059401 [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159 [TRT] Tactic: -4787320710726427159 Time: 0.0718745 [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839 [TRT] Tactic: -3456450830548107839 Time: 0.0710415 [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241 [TRT] Tactic: -1218658103698133241 Time: 0.069766 [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091 [TRT] Tactic: -836875257600482091 Time: 0.06875 [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746 [TRT] Tactic: -410470605513481746 Time: 0.059115 [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 Tactic: -377491875521947884 [TRT] Tactic: -377491875521947884 Time: 0.059271 [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 Tactic: -37215280111360163 [TRT] Tactic: -37215280111360163 Time: 0.05849 [TRT] Fastest Tactic: 5326823351883942011 Time: 0.0583595 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 5177343 [TRT] *************** Autotuning format combination: Float(2304,1,768,256) -> Float(1152,1,384,128) *************** [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Relu6) (CudnnConvolution) [TRT] CudnnConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Relu6) (CublasConvolution) [TRT] CublasConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Relu6) (CaskConvolution) [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Relu6) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 3886731678879822788 [TRT] Tactic: 3886731678879822788 Time: 0.0567445 [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Relu6) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 6629944304117643200 [TRT] Tactic: 6629944304117643200 Time: 0.079401 [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Relu6) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -9153228964338181824 [TRT] Tactic: -9153228964338181824 Time: 0.079583 [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Relu6) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -7394439838318485025 [TRT] Tactic: -7394439838318485025 Time: 0.0552345 [TRT] Fastest Tactic: -7394439838318485025 Time: 0.0552345 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7394439838318485025 [TRT] *************** Autotuning format combination: Half(2304,9,3,1) -> Half(1152,9,3,1) *************** [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Relu6) (CudnnConvolution) [TRT] Tactic: 0 Time: 0.101719 [TRT] Tactic: 1 Time: 0.107031 [TRT] Tactic: 2 Time: 0.229375 [TRT] Tactic: 4 skipped. Scratch requested: 76218368, available: 33554432 [TRT] Tactic: 5 Time: 2.28714 [TRT] Fastest Tactic: 0 Time: 0.101719 [TRT] Setting workspace to 76218368enables more tactics for profiling [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Relu6) (CublasConvolution) [TRT] CublasConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Relu6) (CaskConvolution) [TRT] CaskConvolution has no valid tactics for this config, skipping [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 0 [TRT] *************** Autotuning format combination: Half(1152,9:2,3,1) -> Half(1152,9,3,1) *************** [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Relu6) (CaskConvolution) [TRT] CaskConvolution has no valid tactics for this config, skipping [TRT] *************** Autotuning format combination: Half(1152,9:2,3,1) -> Half(576,9:2,3,1) *************** [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Relu6) (FusedConvActConvolution) [TRT] Tactic: 589823 Time: 0.031849 [TRT] Tactic: 655359 Time: 0.038932 [TRT] Tactic: 786431 Time: 0.0247135 [TRT] Tactic: 851967 Time: 0.0152865 [TRT] Tactic: 1179647 Time: 0.018073 [TRT] Tactic: 1310719 Time: 0.077109 [TRT] Tactic: 1376255 Time: 0.0354685 [TRT] Tactic: 1441791 Time: 0.0155205 [TRT] Tactic: 1507327 Time: 0.024245 [TRT] Tactic: 1638399 Time: 0.0192445 [TRT] Tactic: 1835007 Time: 0.022552 [TRT] Tactic: 1900543 Time: 0.0414585 [TRT] Tactic: 2097151 Time: 0.022657 [TRT] Tactic: 2162687 Time: 0.038568 [TRT] Tactic: 2293759 Time: 0.035573 [TRT] Tactic: 2359295 Time: 0.026875 [TRT] Tactic: 2686975 Time: 0.057422 [TRT] Tactic: 3080191 Time: 0.0222655 [TRT] Tactic: 3342335 Time: 0.0247135 [TRT] Tactic: 3407871 Time: 0.0227345 [TRT] Tactic: 3538943 Time: 0.017552 [TRT] Tactic: 3670015 Time: 0.0695835 [TRT] Tactic: 3932159 Time: 0.020338 [TRT] Tactic: 3997695 Time: 0.017578 [TRT] Tactic: 4063231 Time: 0.0151565 [TRT] Tactic: 4194303 Time: 0.023828 [TRT] Tactic: 4259839 Time: 0.025026 [TRT] Tactic: 4325375 Time: 0.0195835 [TRT] Tactic: 4521983 Time: 0.035026 [TRT] Tactic: 4587519 Time: 0.0180985 [TRT] Tactic: 4653055 Time: 0.01526 [TRT] Tactic: 4915199 Time: 0.018047 [TRT] Tactic: 4980735 Time: 0.0269275 [TRT] Tactic: 5177343 Time: 0.010599 [TRT] Tactic: 5242879 Time: 0.020026 [TRT] Tactic: 5373951 Time: 0.0177865 [TRT] Tactic: 5439487 Time: 0.0203125 [TRT] Tactic: 5570559 Time: 0.022552 [TRT] Tactic: 5636095 Time: 0.015208 [TRT] Tactic: 5701631 Time: 0.0306775 [TRT] Tactic: 5767167 Time: 0.0204165 [TRT] Tactic: 5832703 Time: 0.0210415 [TRT] Tactic: 5898239 Time: 0.0157035 [TRT] Tactic: 6029311 Time: 0.03211 [TRT] Tactic: 6225919 Time: 0.015703 [TRT] Tactic: 6291455 Time: 0.017838 [TRT] Tactic: 6422527 Time: 0.0214585 [TRT] Tactic: 6750207 Time: 0.023177 [TRT] Tactic: 6815743 Time: 0.0202865 [TRT] Tactic: 6946815 Time: 0.022682 [TRT] Tactic: 7012351 Time: 0.022474 [TRT] Tactic: 7077887 Time: 0.0177605 [TRT] Tactic: 7143423 Time: 0.0217705 [TRT] Tactic: 7208959 Time: 0.019427 [TRT] Tactic: 7340031 Time: 0.015417 [TRT] Tactic: 7405567 Time: 0.014922 [TRT] Tactic: 7536639 Time: 0.0283855 [TRT] Tactic: 7602175 Time: 0.0229425 [TRT] Tactic: 7733247 Time: 0.0179685 [TRT] Tactic: 7798783 Time: 0.024167 [TRT] Tactic: 8191999 Time: 0.0201565 [TRT] Tactic: 8257535 Time: 0.017942 [TRT] Tactic: 8323071 Time: 0.0217185 [TRT] Tactic: 8650751 Time: 0.0182555 [TRT] Tactic: 8716287 Time: 0.0163535 [TRT] Tactic: 9109503 Time: 0.022708 [TRT] Tactic: 9568255 Time: 0.018099 [TRT] Tactic: 9895935 Time: 0.0248955 [TRT] Tactic: 10223615 Time: 0.0566665 [TRT] Tactic: 10354687 Time: 0.0225525 [TRT] Tactic: 10551295 Time: 0.025182 [TRT] Tactic: 10747903 Time: 0.018255 [TRT] Tactic: 10944511 Time: 0.0261725 [TRT] Fastest Tactic: 5177343 Time: 0.010599 [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Relu6) (CudnnConvolution) [TRT] CudnnConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Relu6) (CublasConvolution) [TRT] CublasConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Relu6) (CaskConvolution) [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Relu6) Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 3066127711859985668 [TRT] Tactic: 3066127711859985668 Time: 0.0397915 [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Relu6) Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 3564772625446233998 [TRT] Tactic: 3564772625446233998 Time: 0.0446095 [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Relu6) Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: 5319956359050645452 [TRT] Tactic: 5319956359050645452 Time: 0.0364845 [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Relu6) Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 7205456024582378848 [TRT] Tactic: 7205456024582378848 Time: 0.038776 [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Relu6) Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 8163473458334948789 [TRT] Tactic: 8163473458334948789 Time: 0.0373695 [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Relu6) Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -4212163711445252890 [TRT] Tactic: -4212163711445252890 Time: 0.0326825 [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Relu6) Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: -3898373634979201110 [TRT] Tactic: -3898373634979201110 Time: 0.0345575 [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Relu6) Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: -2409163523992614473 [TRT] Tactic: -2409163523992614473 Time: 0.034922 [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Relu6) Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: -1716393687483585322 [TRT] Tactic: -1716393687483585322 Time: 0.03263 [TRT] Fastest Tactic: -1716393687483585322 Time: 0.03263 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 5177343 [TRT] =============== Computing costs for [TRT] *************** Autotuning format combination: Float(1152,9,3,1) -> Float(512,4,2,1) *************** [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/Relu6) (CudaDepthwiseConvolution) [TRT] Tactic: -1 Time: 0.0472395 [TRT] Fastest Tactic: -1 Time: 0.0472395 [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/Relu6) (CudnnConvolution) [TRT] Tactic: 0 Time: 0.0458595 [TRT] Tactic: 1 Time: 0.04638 [TRT] Tactic: 2 Time: 0.0466925 [TRT] Tactic: 5 Time: 39.5884 [TRT] Fastest Tactic: 0 Time: 0.0458595 [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/Relu6) (CaskConvolution) [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758 [TRT] Tactic: 1062367460111450758 Time: 5.75224 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v0 Tactic: 1754984623894446479 [TRT] Tactic: 1754984623894446479 Time: 6.19932 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v0 Tactic: 3611739942397549984 [TRT] Tactic: 3611739942397549984 Time: 6.26779 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 Tactic: 4337000649858996379 [TRT] Tactic: 4337000649858996379 Time: 6.29102 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441 [TRT] Tactic: 4501471010995462441 Time: 3.4494 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826 [TRT] Tactic: 5137655947464784826 Time: 3.07458 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929 [TRT] Tactic: 5288347012147084929 Time: 3.29958 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056 [TRT] Tactic: 6645123197870846056 Time: 3.38023 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478 [TRT] Tactic: 7144526460361122478 Time: 3.39422 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 Tactic: -9137461792520977713 [TRT] Tactic: -9137461792520977713 Time: 3.53609 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730 [TRT] Tactic: -8262349710178828730 Time: 3.38049 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v0 Tactic: -8133971918129952780 [TRT] Tactic: -8133971918129952780 Time: 3.60432 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 Tactic: -6092040395344634144 [TRT] Tactic: -6092040395344634144 Time: 3.65151 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159 [TRT] Tactic: -4787320710726427159 Time: 3.57255 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839 [TRT] Tactic: -3456450830548107839 Time: 3.17857 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241 [TRT] Tactic: -1218658103698133241 Time: 3.52513 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091 [TRT] Tactic: -836875257600482091 Time: 3.35401 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746 [TRT] Tactic: -410470605513481746 Time: 2.90075 [TRT] Fastest Tactic: -410470605513481746 Time: 2.90075 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 0 [TRT] *************** Autotuning format combination: Float(1152,1,384,128) -> Float(512,1,256,128) *************** [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/Relu6) (CudnnConvolution) [TRT] CudnnConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/Relu6) (CaskConvolution) [TRT] CaskConvolution has no valid tactics for this config, skipping [TRT] *************** Autotuning format combination: Half(1152,9,3,1) -> Half(512,4,2,1) *************** [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/Relu6) (CudnnConvolution) [TRT] Tactic: 0 Time: 0.04625 [TRT] Tactic: 1 Time: 0.04737 [TRT] Tactic: 2 Time: 0.046042 [TRT] Tactic: 5 Time: 39.3207 [TRT] Fastest Tactic: 2 Time: 0.046042 [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/Relu6) (CaskConvolution) [TRT] CaskConvolution has no valid tactics for this config, skipping [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 2 [TRT] *************** Autotuning format combination: Half(576,9:2,3,1) -> Half(256,4:2,2,1) *************** [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/Relu6) (CaskConvolution) [TRT] CaskConvolution has no valid tactics for this config, skipping [TRT] =============== Computing costs for [TRT] *************** Autotuning format combination: Float(512,4,2,1) -> Float(1024,4,2,1) *************** [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Relu6) (FusedConvActConvolution) [TRT] Tactic: 589823 Time: 0.031849 [TRT] Tactic: 655359 Time: 0.0249215 [TRT] Tactic: 786431 Time: 0.0353905 [TRT] Tactic: 851967 Time: 0.0170055 [TRT] Tactic: 1179647 Time: 0.0177085 [TRT] Tactic: 1310719 Time: 0.066797 [TRT] Tactic: 1376255 Time: 0.0342445 [TRT] Tactic: 1441791 Time: 0.02763 [TRT] Tactic: 1507327 Time: 0.027161 [TRT] Tactic: 1638399 Time: 0.0347135 [TRT] Tactic: 1835007 Time: 0.024297 [TRT] Tactic: 1900543 Time: 0.0408595 [TRT] Tactic: 2097151 Time: 0.036979 [TRT] Tactic: 2162687 Time: 0.038958 [TRT] Tactic: 2293759 Time: 0.0359115 [TRT] Tactic: 2359295 Time: 0.029635 [TRT] Tactic: 2686975 Time: 0.0340625 [TRT] Tactic: 3080191 Time: 0.0175515 [TRT] Tactic: 3342335 Time: 0.026953 [TRT] Tactic: 3407871 Time: 0.024583 [TRT] Tactic: 3538943 Time: 0.0178905 [TRT] Tactic: 3670015 Time: 0.038828 [TRT] Tactic: 3932159 Time: 0.0320575 [TRT] Tactic: 3997695 Time: 0.029271 [TRT] Tactic: 4063231 Time: 0.017839 [TRT] Tactic: 4194303 Time: 0.03112 [TRT] Tactic: 4259839 Time: 0.038906 [TRT] Tactic: 4325375 Time: 0.0322915 [TRT] Tactic: 4521983 Time: 0.0369015 [TRT] Tactic: 4587519 Time: 0.03237 [TRT] Tactic: 4653055 Time: 0.0270575 [TRT] Tactic: 4915199 Time: 0.03198 [TRT] Tactic: 4980735 Time: 0.033698 [TRT] Tactic: 5177343 Time: 0.0178125 [TRT] Tactic: 5242879 Time: 0.02362 [TRT] Tactic: 5373951 Time: 0.017708 [TRT] Tactic: 5439487 Time: 0.020078 [TRT] Tactic: 5570559 Time: 0.0213805 [TRT] Tactic: 5636095 Time: 0.0178905 [TRT] Tactic: 5701631 Time: 0.0332815 [TRT] Tactic: 5767167 Time: 0.0227865 [TRT] Tactic: 5832703 Time: 0.024245 [TRT] Tactic: 5898239 Time: 0.0249745 [TRT] Tactic: 6029311 Time: 0.0340365 [TRT] Tactic: 6225919 Time: 0.0153645 [TRT] Tactic: 6291455 Time: 0.017656 [TRT] Tactic: 6422527 Time: 0.019557 [TRT] Tactic: 6750207 Time: 0.0177605 [TRT] Tactic: 6815743 Time: 0.022084 [TRT] Tactic: 6946815 Time: 0.0239585 [TRT] Tactic: 7012351 Time: 0.0370575 [TRT] Tactic: 7077887 Time: 0.01776 [TRT] Tactic: 7143423 Time: 0.023646 [TRT] Tactic: 7208959 Time: 0.023646 [TRT] Tactic: 7340031 Time: 0.024948 [TRT] Tactic: 7405567 Time: 0.020182 [TRT] Tactic: 7536639 Time: 0.0224485 [TRT] Tactic: 7602175 Time: 0.023802 [TRT] Tactic: 7733247 Time: 0.02276 [TRT] Tactic: 7798783 Time: 0.028802 [TRT] Tactic: 8191999 Time: 0.0229165 [TRT] Tactic: 8257535 Time: 0.032005 [TRT] Tactic: 8323071 Time: 0.019948 [TRT] Tactic: 8650751 Time: 0.0237505 [TRT] Tactic: 8716287 Time: 0.0154425 [TRT] Tactic: 9109503 Time: 0.036927 [TRT] Tactic: 9568255 Time: 0.031797 [TRT] Tactic: 9895935 Time: 0.0312755 [TRT] Tactic: 10223615 Time: 0.033985 [TRT] Tactic: 10354687 Time: 0.036875 [TRT] Tactic: 10551295 Time: 0.024531 [TRT] Tactic: 10747903 Time: 0.022656 [TRT] Tactic: 10944511 Time: 0.034557 [TRT] Fastest Tactic: 6225919 Time: 0.0153645 [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Relu6) (CudaDepthwiseConvolution) [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Relu6) (CudnnConvolution) [TRT] Tactic: 0 Time: 0.099141 [TRT] Tactic: 1 Time: 0.098854 [TRT] Tactic: 2 Time: 0.162552 [TRT] Tactic: 4 skipped. Scratch requested: 75923456, available: 33554432 [TRT] Tactic: 5 Time: 2.33213 [TRT] Fastest Tactic: 1 Time: 0.098854 [TRT] Setting workspace to 75923456enables more tactics for profiling [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Relu6) (CublasConvolution) [TRT] CublasConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Relu6) (CaskConvolution) [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758 [TRT] Tactic: 1062367460111450758 Time: 0.079323 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 Tactic: 1698681053543049347 [TRT] Tactic: 1698681053543049347 Time: 0.0733855 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441 [TRT] Tactic: 4501471010995462441 Time: 0.060234 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826 [TRT] Tactic: 5137655947464784826 Time: 0.064375 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929 [TRT] Tactic: 5288347012147084929 Time: 0.060078 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 Tactic: 5326823351883942011 [TRT] Tactic: 5326823351883942011 Time: 0.058203 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 Tactic: 5500448035057547314 [TRT] Tactic: 5500448035057547314 Time: 0.0633595 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056 [TRT] Tactic: 6645123197870846056 Time: 0.0626045 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478 [TRT] Tactic: 7144526460361122478 Time: 0.072891 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730 [TRT] Tactic: -8262349710178828730 Time: 0.0597655 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 Tactic: -6576203419454146580 [TRT] Tactic: -6576203419454146580 Time: 0.0897135 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159 [TRT] Tactic: -4787320710726427159 Time: 0.0765105 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839 [TRT] Tactic: -3456450830548107839 Time: 0.0738015 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241 [TRT] Tactic: -1218658103698133241 Time: 0.066146 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091 [TRT] Tactic: -836875257600482091 Time: 0.064766 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746 [TRT] Tactic: -410470605513481746 Time: 0.059661 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 Tactic: -377491875521947884 [TRT] Tactic: -377491875521947884 Time: 0.061172 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 Tactic: -37215280111360163 [TRT] Tactic: -37215280111360163 Time: 0.063958 [TRT] Fastest Tactic: 5326823351883942011 Time: 0.058203 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 6225919 [TRT] *************** Autotuning format combination: Float(512,1,256,128) -> Float(1024,1,512,256) *************** [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Relu6) (CudnnConvolution) [TRT] CudnnConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Relu6) (CublasConvolution) [TRT] CublasConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Relu6) (CaskConvolution) [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Relu6) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 3886731678879822788 [TRT] Tactic: 3886731678879822788 Time: 0.064349 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Relu6) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 6629944304117643200 [TRT] Tactic: 6629944304117643200 Time: 0.109063 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Relu6) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -9153228964338181824 [TRT] Tactic: -9153228964338181824 Time: 0.109114 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Relu6) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -7394439838318485025 [TRT] Tactic: -7394439838318485025 Time: 0.0647135 [TRT] Fastest Tactic: 3886731678879822788 Time: 0.064349 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3886731678879822788 [TRT] *************** Autotuning format combination: Half(512,4,2,1) -> Half(1024,4,2,1) *************** [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Relu6) (CudnnConvolution) [TRT] Tactic: 0 Time: 0.101719 [TRT] Tactic: 1 Time: 0.0961715 [TRT] Tactic: 2 Time: 0.162552 [TRT] Tactic: 4 skipped. Scratch requested: 75923456, available: 33554432 [TRT] Tactic: 5 Time: 2.3243 [TRT] Fastest Tactic: 1 Time: 0.0961715 [TRT] Setting workspace to 75923456enables more tactics for profiling [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Relu6) (CublasConvolution) [TRT] CublasConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Relu6) (CaskConvolution) [TRT] CaskConvolution has no valid tactics for this config, skipping [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 1 [TRT] *************** Autotuning format combination: Half(256,4:2,2,1) -> Half(1024,4,2,1) *************** [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Relu6) (CaskConvolution) [TRT] CaskConvolution has no valid tactics for this config, skipping [TRT] *************** Autotuning format combination: Half(256,4:2,2,1) -> Half(512,4:2,2,1) *************** [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Relu6) (FusedConvActConvolution) [TRT] Tactic: 589823 Time: 0.022057 [TRT] Tactic: 655359 Time: 0.02401 [TRT] Tactic: 786431 Time: 0.0203905 [TRT] Tactic: 851967 Time: 0.0126565 [TRT] Tactic: 1179647 Time: 0.0127865 [TRT] Tactic: 1310719 Time: 0.0491925 [TRT] Tactic: 1376255 Time: 0.0221355 [TRT] Tactic: 1441791 Time: 0.020052 [TRT] Tactic: 1507327 Time: 0.019792 [TRT] Tactic: 1638399 Time: 0.0245315 [TRT] Tactic: 1835007 Time: 0.017578 [TRT] Tactic: 1900543 Time: 0.026927 [TRT] Tactic: 2097151 Time: 0.029349 [TRT] Tactic: 2162687 Time: 0.024219 [TRT] Tactic: 2293759 Time: 0.0221875 [TRT] Tactic: 2359295 Time: 0.0213545 [TRT] Tactic: 2686975 Time: 0.0320575 [TRT] Tactic: 3080191 Time: 0.017448 [TRT] Tactic: 3342335 Time: 0.019714 [TRT] Tactic: 3407871 Time: 0.015078 [TRT] Tactic: 3538943 Time: 0.0128905 [TRT] Tactic: 3670015 Time: 0.038776 [TRT] Tactic: 3932159 Time: 0.0130985 [TRT] Tactic: 3997695 Time: 0.02224 [TRT] Tactic: 4063231 Time: 0.0129685 [TRT] Tactic: 4194303 Time: 0.02263 [TRT] Tactic: 4259839 Time: 0.0309115 [TRT] Tactic: 4325375 Time: 0.024948 [TRT] Tactic: 4521983 Time: 0.0245835 [TRT] Tactic: 4587519 Time: 0.0220835 [TRT] Tactic: 4653055 Time: 0.018906 [TRT] Tactic: 4915199 Time: 0.0222135 [TRT] Tactic: 4980735 Time: 0.022526 [TRT] Tactic: 5177343 Time: 0.012656 [TRT] Tactic: 5242879 Time: 0.0128645 [TRT] Tactic: 5373951 Time: 0.0128125 [TRT] Tactic: 5439487 Time: 0.0152345 [TRT] Tactic: 5570559 Time: 0.0189585 [TRT] Tactic: 5636095 Time: 0.013151 [TRT] Tactic: 5701631 Time: 0.019974 [TRT] Tactic: 5767167 Time: 0.014219 [TRT] Tactic: 5832703 Time: 0.015156 [TRT] Tactic: 5898239 Time: 0.02013 [TRT] Tactic: 6029311 Time: 0.0198435 [TRT] Tactic: 6225919 Time: 0.010651 [TRT] Tactic: 6291455 Time: 0.012995 [TRT] Tactic: 6422527 Time: 0.0142965 [TRT] Tactic: 6750207 Time: 0.0167975 [TRT] Tactic: 6815743 Time: 0.0128385 [TRT] Tactic: 6946815 Time: 0.015234 [TRT] Tactic: 7012351 Time: 0.029583 [TRT] Tactic: 7077887 Time: 0.0120055 [TRT] Tactic: 7143423 Time: 0.015338 [TRT] Tactic: 7208959 Time: 0.0152605 [TRT] Tactic: 7340031 Time: 0.0202345 [TRT] Tactic: 7405567 Time: 0.0153125 [TRT] Tactic: 7536639 Time: 0.017474 [TRT] Tactic: 7602175 Time: 0.0152085 [TRT] Tactic: 7733247 Time: 0.016771 [TRT] Tactic: 7798783 Time: 0.019818 [TRT] Tactic: 8191999 Time: 0.015339 [TRT] Tactic: 8257535 Time: 0.0225525 [TRT] Tactic: 8323071 Time: 0.0151045 [TRT] Tactic: 8650751 Time: 0.01513 [TRT] Tactic: 8716287 Time: 0.0104425 [TRT] Tactic: 9109503 Time: 0.0292185 [TRT] Tactic: 9568255 Time: 0.022396 [TRT] Tactic: 9895935 Time: 0.02224 [TRT] Tactic: 10223615 Time: 0.032031 [TRT] Tactic: 10354687 Time: 0.02862 [TRT] Tactic: 10551295 Time: 0.015312 [TRT] Tactic: 10747903 Time: 0.016745 [TRT] Tactic: 10944511 Time: 0.0223695 [TRT] Fastest Tactic: 8716287 Time: 0.0104425 [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Relu6) (CudnnConvolution) [TRT] CudnnConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Relu6) (CublasConvolution) [TRT] CublasConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Relu6) (CaskConvolution) [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Relu6) Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 3066127711859985668 [TRT] Tactic: 3066127711859985668 Time: 0.042057 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Relu6) Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 3564772625446233998 [TRT] Tactic: 3564772625446233998 Time: 0.046328 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Relu6) Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: 5319956359050645452 [TRT] Tactic: 5319956359050645452 Time: 0.042292 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Relu6) Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 7205456024582378848 [TRT] Tactic: 7205456024582378848 Time: 0.038672 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Relu6) Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 8163473458334948789 [TRT] Tactic: 8163473458334948789 Time: 0.0359375 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Relu6) Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -4212163711445252890 [TRT] Tactic: -4212163711445252890 Time: 0.035078 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Relu6) Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: -3898373634979201110 [TRT] Tactic: -3898373634979201110 Time: 0.0340625 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Relu6) Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: -2409163523992614473 [TRT] Tactic: -2409163523992614473 Time: 0.037265 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Relu6) Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: -1716393687483585322 [TRT] Tactic: -1716393687483585322 Time: 0.0334375 [TRT] Fastest Tactic: -1716393687483585322 Time: 0.0334375 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 8716287 [TRT] =============== Computing costs for [TRT] *************** Autotuning format combination: Float(1024,4,2,1) -> Float(2280,4,2,1) *************** [TRT] --------------- Timing Runner: BoxPredictor_4/BoxEncodingPredictor/Conv2D || BoxPredictor_4/ClassPredictor/Conv2D (FusedConvActConvolution) [TRT] Tactic: 524287 Time: 0.535338 [TRT] Tactic: 720895 Time: 0.542526 [TRT] Tactic: 983039 Time: 0.446016 [TRT] Tactic: 1048575 Time: 0.652344 [TRT] Tactic: 1703935 Time: 0.627084 [TRT] Tactic: 1769471 Time: 0.552161 [TRT] Tactic: 1966079 Time: 0.611328 [TRT] Tactic: 2031615 Time: 0.538959 [TRT] Tactic: 2228223 Time: 0.911667 [TRT] Tactic: 2424831 Time: 0.814948 [TRT] Tactic: 2621439 Time: 0.685 [TRT] Tactic: 2752511 Time: 0.647161 [TRT] Tactic: 3014655 Time: 0.835833 [TRT] Tactic: 3145727 Time: 0.542786 [TRT] Tactic: 3604479 Time: 0.825182 [TRT] Tactic: 4390911 Time: 0.696615 [TRT] Tactic: 5046271 Time: 0.508515 [TRT] Tactic: 5963775 Time: 0.553854 [TRT] Tactic: 6160383 Time: 0.511797 [TRT] Tactic: 6488063 Time: 0.823074 [TRT] Tactic: 6881279 Time: 0.469661 [TRT] Tactic: 7274495 Time: 0.435338 [TRT] Tactic: 7864319 Time: 0.719844 [TRT] Tactic: 7995391 Time: 0.594063 [TRT] Tactic: 8585215 Time: 0.599114 [TRT] Tactic: 8847359 Time: 0.79987 [TRT] Tactic: 8978431 Time: 0.562812 [TRT] Tactic: 9043967 Time: 0.760338 [TRT] Tactic: 9175039 Time: 0.833073 [TRT] Tactic: 9502719 Time: 0.72375 [TRT] Tactic: 9961471 Time: 0.879063 [TRT] Tactic: 10027007 Time: 0.552709 [TRT] Tactic: 10092543 Time: 0.700573 [TRT] Tactic: 10289151 Time: 0.611979 [TRT] Tactic: 10485759 Time: 0.553099 [TRT] Tactic: 10682367 Time: 0.698021 [TRT] Tactic: 10813439 Time: 0.49737 [TRT] Fastest Tactic: 7274495 Time: 0.435338 [TRT] --------------- Timing Runner: BoxPredictor_4/BoxEncodingPredictor/Conv2D || BoxPredictor_4/ClassPredictor/Conv2D (CudaDepthwiseConvolution) [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: BoxPredictor_4/BoxEncodingPredictor/Conv2D || BoxPredictor_4/ClassPredictor/Conv2D (CudnnConvolution) [TRT] Tactic: 0 Time: 1.96294 [TRT] Tactic: 1 Time: 2.03849 [TRT] Tactic: 2 Time: 1.65885 [TRT] Tactic: 4 skipped. Scratch requested: 342042624, available: 33554432 [TRT] Tactic: 5 skipped. Scratch requested: 638638592, available: 33554432 [TRT] Tactic: 6 Time: 1.9301 [TRT] Fastest Tactic: 2 Time: 1.65885 [TRT] Setting workspace to 342042624enables more tactics for profiling [TRT] --------------- Timing Runner: BoxPredictor_4/BoxEncodingPredictor/Conv2D || BoxPredictor_4/ClassPredictor/Conv2D (CaskConvolution) [TRT] BoxPredictor_4/BoxEncodingPredictor/Conv2D || BoxPredictor_4/ClassPredictor/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758 [TRT] Tactic: 1062367460111450758 Time: 2.14591 [TRT] BoxPredictor_4/BoxEncodingPredictor/Conv2D || BoxPredictor_4/ClassPredictor/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v0 Tactic: 1754984623894446479 [TRT] Tactic: 1754984623894446479 Time: 2.52581 [TRT] BoxPredictor_4/BoxEncodingPredictor/Conv2D || BoxPredictor_4/ClassPredictor/Conv2D Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v0 Tactic: 3611739942397549984 [TRT] Tactic: 3611739942397549984 Time: 2.00237 [TRT] BoxPredictor_4/BoxEncodingPredictor/Conv2D || BoxPredictor_4/ClassPredictor/Conv2D Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v1 Tactic: 3827454225649558724 [TRT] Tactic: 3827454225649558724 Time: 1.23247 [TRT] BoxPredictor_4/BoxEncodingPredictor/Conv2D || BoxPredictor_4/ClassPredictor/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 Tactic: 4337000649858996379 [TRT] Tactic: 4337000649858996379 Time: 1.94279 [TRT] BoxPredictor_4/BoxEncodingPredictor/Conv2D || BoxPredictor_4/ClassPredictor/Conv2D Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441 [TRT] Tactic: 4501471010995462441 Time: 1.97953 [TRT] BoxPredictor_4/BoxEncodingPredictor/Conv2D || BoxPredictor_4/ClassPredictor/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826 [TRT] Tactic: 5137655947464784826 Time: 1.82833 [TRT] BoxPredictor_4/BoxEncodingPredictor/Conv2D || BoxPredictor_4/ClassPredictor/Conv2D Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929 [TRT] Tactic: 5288347012147084929 Time: 1.93544 [TRT] BoxPredictor_4/BoxEncodingPredictor/Conv2D || BoxPredictor_4/ClassPredictor/Conv2D Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148m_nt_v1 Tactic: 5921334924264294896 [TRT] Tactic: 5921334924264294896 Time: 0.952214 [TRT] BoxPredictor_4/BoxEncodingPredictor/Conv2D || BoxPredictor_4/ClassPredictor/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056 [TRT] Tactic: 6645123197870846056 Time: 1.91901 [TRT] BoxPredictor_4/BoxEncodingPredictor/Conv2D || BoxPredictor_4/ClassPredictor/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478 [TRT] Tactic: 7144526460361122478 Time: 2.33901 [TRT] BoxPredictor_4/BoxEncodingPredictor/Conv2D || BoxPredictor_4/ClassPredictor/Conv2D Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 Tactic: 7852627285308570038 [TRT] Tactic: 7852627285308570038 Time: 1.28951 [TRT] BoxPredictor_4/BoxEncodingPredictor/Conv2D || BoxPredictor_4/ClassPredictor/Conv2D Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 Tactic: -9137461792520977713 [TRT] Tactic: -9137461792520977713 Time: 2.02513 [TRT] BoxPredictor_4/BoxEncodingPredictor/Conv2D || BoxPredictor_4/ClassPredictor/Conv2D Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v0 Tactic: -8776506421218919509 [TRT] Tactic: -8776506421218919509 Time: 1.22128 [TRT] BoxPredictor_4/BoxEncodingPredictor/Conv2D || BoxPredictor_4/ClassPredictor/Conv2D Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730 [TRT] Tactic: -8262349710178828730 Time: 2.01779 [TRT] BoxPredictor_4/BoxEncodingPredictor/Conv2D || BoxPredictor_4/ClassPredictor/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v0 Tactic: -8133971918129952780 [TRT] Tactic: -8133971918129952780 Time: 2.25651 [TRT] BoxPredictor_4/BoxEncodingPredictor/Conv2D || BoxPredictor_4/ClassPredictor/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 Tactic: -6092040395344634144 [TRT] Tactic: -6092040395344634144 Time: 2.25083 [TRT] BoxPredictor_4/BoxEncodingPredictor/Conv2D || BoxPredictor_4/ClassPredictor/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159 [TRT] Tactic: -4787320710726427159 Time: 2.52833 [TRT] BoxPredictor_4/BoxEncodingPredictor/Conv2D || BoxPredictor_4/ClassPredictor/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839 [TRT] Tactic: -3456450830548107839 Time: 1.98003 [TRT] BoxPredictor_4/BoxEncodingPredictor/Conv2D || BoxPredictor_4/ClassPredictor/Conv2D Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v0 Tactic: -2318106587342035239 [TRT] Tactic: -2318106587342035239 Time: 1.22607 [TRT] BoxPredictor_4/BoxEncodingPredictor/Conv2D || BoxPredictor_4/ClassPredictor/Conv2D Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_mobile_relu_tile148t_nt_v0 Tactic: -1343271414618805657 [TRT] Tactic: -1343271414618805657 Time: 0.915937 [TRT] BoxPredictor_4/BoxEncodingPredictor/Conv2D || BoxPredictor_4/ClassPredictor/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241 [TRT] Tactic: -1218658103698133241 Time: 2.24471 [TRT] BoxPredictor_4/BoxEncodingPredictor/Conv2D || BoxPredictor_4/ClassPredictor/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091 [TRT] Tactic: -836875257600482091 Time: 2.12781 [TRT] BoxPredictor_4/BoxEncodingPredictor/Conv2D || BoxPredictor_4/ClassPredictor/Conv2D Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746 [TRT] Tactic: -410470605513481746 Time: 1.92794 [TRT] Fastest Tactic: -1343271414618805657 Time: 0.915937 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 7274495 [TRT] *************** Autotuning format combination: Float(1024,1,512,256) -> Float(2280,1,1140,570) *************** [TRT] --------------- Timing Runner: BoxPredictor_4/BoxEncodingPredictor/Conv2D || BoxPredictor_4/ClassPredictor/Conv2D (CudnnConvolution) [TRT] CudnnConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: BoxPredictor_4/BoxEncodingPredictor/Conv2D || BoxPredictor_4/ClassPredictor/Conv2D (CaskConvolution) [TRT] CaskConvolution has no valid tactics for this config, skipping [TRT] *************** Autotuning format combination: Half(1024,4,2,1) -> Half(2280,4,2,1) *************** [TRT] --------------- Timing Runner: BoxPredictor_4/BoxEncodingPredictor/Conv2D || BoxPredictor_4/ClassPredictor/Conv2D (CudnnConvolution) [TRT] Tactic: 0 Time: 1.36125 [TRT] Tactic: 1 Time: 1.36096 [TRT] Tactic: 2 Time: 1.66458 [TRT] Tactic: 4 skipped. Scratch requested: 342042624, available: 33554432 [TRT] Tactic: 5 skipped. Scratch requested: 638638592, available: 33554432 [TRT] Tactic: 6 Time: 3.27456 [TRT] Fastest Tactic: 1 Time: 1.36096 [TRT] Setting workspace to 342042624enables more tactics for profiling [TRT] --------------- Timing Runner: BoxPredictor_4/BoxEncodingPredictor/Conv2D || BoxPredictor_4/ClassPredictor/Conv2D (CaskConvolution) [TRT] CaskConvolution has no valid tactics for this config, skipping [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 1 [TRT] *************** Autotuning format combination: Half(512,4:2,2,1) -> Half(1140,4:2,2,1) *************** [TRT] --------------- Timing Runner: BoxPredictor_4/BoxEncodingPredictor/Conv2D || BoxPredictor_4/ClassPredictor/Conv2D (FusedConvActConvolution) [TRT] Tactic: 524287 Time: 0.284297 [TRT] Tactic: 720895 Time: 0.290208 [TRT] Tactic: 983039 Time: 0.249141 [TRT] Tactic: 1048575 Time: 0.357865 [TRT] Tactic: 1703935 Time: 0.350053 [TRT] Tactic: 1769471 Time: 2.01675 [TRT] Tactic: 1966079 Time: 0.355105 [TRT] Tactic: 2031615 Time: 0.286459 [TRT] Tactic: 2228223 Time: 0.463698 [TRT] Tactic: 2424831 Time: 0.618124 [TRT] Tactic: 2621439 Time: 0.373177 [TRT] Tactic: 2752511 Time: 0.345886 [TRT] Tactic: 3014655 Time: 0.469063 [TRT] Tactic: 3145727 Time: 0.298203 [TRT] Tactic: 3604479 Time: 0.464921 [TRT] Tactic: 4390911 Time: 0.380469 [TRT] Tactic: 5046271 Time: 0.265417 [TRT] Tactic: 5963775 Time: 0.310338 [TRT] Tactic: 6160383 Time: 0.292734 [TRT] Tactic: 6488063 Time: 0.436952 [TRT] Tactic: 6881279 Time: 0.254479 [TRT] Tactic: 7274495 Time: 0.253698 [TRT] Tactic: 7864319 Time: 0.404531 [TRT] Tactic: 7995391 Time: 0.328933 [TRT] Tactic: 8585215 Time: 0.346328 [TRT] Tactic: 8847359 Time: 0.429687 [TRT] Tactic: 8978431 Time: 0.307526 [TRT] Tactic: 9043967 Time: 0.412604 [TRT] Tactic: 9175039 Time: 0.467265 [TRT] Tactic: 9502719 Time: 0.37224 [TRT] Tactic: 9961471 Time: 0.493751 [TRT] Tactic: 10027007 Time: 0.314947 [TRT] Tactic: 10092543 Time: 0.379453 [TRT] Tactic: 10289151 Time: 0.352995 [TRT] Tactic: 10485759 Time: 0.295781 [TRT] Tactic: 10682367 Time: 0.370079 [TRT] Tactic: 10813439 Time: 0.289271 [TRT] Fastest Tactic: 983039 Time: 0.249141 [TRT] --------------- Timing Runner: BoxPredictor_4/BoxEncodingPredictor/Conv2D || BoxPredictor_4/ClassPredictor/Conv2D (CudnnConvolution) [TRT] CudnnConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: BoxPredictor_4/BoxEncodingPredictor/Conv2D || BoxPredictor_4/ClassPredictor/Conv2D (CaskConvolution) [TRT] BoxPredictor_4/BoxEncodingPredictor/Conv2D || BoxPredictor_4/ClassPredictor/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148m_nt_v1 Tactic: 4772821744921268633 [TRT] Tactic: 4772821744921268633 Time: 0.517917 [TRT] Fastest Tactic: 4772821744921268633 Time: 0.517917 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 983039 [TRT] =============== Computing costs for [TRT] *************** Autotuning format combination: Float(2280,4,2,1) -> Float(2184,91,1,1) *************** [TRT] --------------- Timing Runner: (Unnamed Layer* 656) [Shuffle] + BoxPredictor_4/Reshape_1 (Shuffle) [TRT] Tactic: 0 Time: 0.007995 [TRT] Fastest Tactic: 0 Time: 0.007995 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TRT] *************** Autotuning format combination: Float(2280,1,1140,570) -> Float(2184,1,24,24) *************** [TRT] --------------- Timing Runner: (Unnamed Layer* 656) [Shuffle] + BoxPredictor_4/Reshape_1 (Shuffle) [TRT] Tactic: 0 Time: 0.0095575 [TRT] Fastest Tactic: 0 Time: 0.0095575 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TRT] *************** Autotuning format combination: Float(72,4:32,2,1) -> Float(91,91:32,1,1) *************** [TRT] --------------- Timing Runner: (Unnamed Layer* 656) [Shuffle] + BoxPredictor_4/Reshape_1 (Shuffle) [TRT] Tactic: 0 Time: 0.012031 [TRT] Fastest Tactic: 0 Time: 0.012031 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TRT] *************** Autotuning format combination: Half(2280,4,2,1) -> Half(2184,91,1,1) *************** [TRT] --------------- Timing Runner: (Unnamed Layer* 656) [Shuffle] + BoxPredictor_4/Reshape_1 (Shuffle) [TRT] Tactic: 0 Time: 0.005912 [TRT] Fastest Tactic: 0 Time: 0.005912 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TRT] *************** Autotuning format combination: Half(1140,4:2,2,1) -> Half(1092,91:2,1,1) *************** [TRT] --------------- Timing Runner: (Unnamed Layer* 656) [Shuffle] + BoxPredictor_4/Reshape_1 (Shuffle) [TRT] Tactic: 0 Time: 0.0088025 [TRT] Fastest Tactic: 0 Time: 0.0088025 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TRT] =============== Computing costs for [TRT] *************** Autotuning format combination: Float(1024,4,2,1) -> Float(256,4,2,1) *************** [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Relu6) (FusedConvActConvolution) [TRT] Tactic: 589823 Time: 0.048333 [TRT] Tactic: 655359 Time: 0.0369015 [TRT] Tactic: 786431 Time: 0.028594 [TRT] Tactic: 851967 Time: 0.020209 [TRT] Tactic: 1179647 Time: 0.0127345 [TRT] Tactic: 1310719 Time: 0.100182 [TRT] Tactic: 1376255 Time: 0.0598175 [TRT] Tactic: 1441791 Time: 0.0175515 [TRT] Tactic: 1507327 Time: 0.036797 [TRT] Tactic: 1638399 Time: 0.0200265 [TRT] Tactic: 1835007 Time: 0.025703 [TRT] Tactic: 1900543 Time: 0.0669275 [TRT] Tactic: 2097151 Time: 0.017474 [TRT] Tactic: 2162687 Time: 0.0643495 [TRT] Tactic: 2293759 Time: 0.058776 [TRT] Tactic: 2359295 Time: 0.0400515 [TRT] Tactic: 2686975 Time: 0.056641 [TRT] Tactic: 3080191 Time: 0.0221615 [TRT] Tactic: 3342335 Time: 0.0369525 [TRT] Tactic: 3407871 Time: 0.035886 [TRT] Tactic: 3538943 Time: 0.0197135 [TRT] Tactic: 3670015 Time: 0.064427 [TRT] Tactic: 3932159 Time: 0.0493225 [TRT] Tactic: 3997695 Time: 0.018958 [TRT] Tactic: 4063231 Time: 0.0222655 [TRT] Tactic: 4194303 Time: 0.0291405 [TRT] Tactic: 4259839 Time: 0.017786 [TRT] Tactic: 4325375 Time: 0.0271615 [TRT] Tactic: 4521983 Time: 0.0603125 [TRT] Tactic: 4587519 Time: 0.0191145 [TRT] Tactic: 4653055 Time: 0.015286 [TRT] Tactic: 4915199 Time: 0.0197915 [TRT] Tactic: 4980735 Time: 0.0385415 [TRT] Tactic: 5177343 Time: 0.012916 [TRT] Tactic: 5242879 Time: 0.0316925 [TRT] Tactic: 5373951 Time: 0.0130205 [TRT] Tactic: 5439487 Time: 0.0243485 [TRT] Tactic: 5570559 Time: 0.02487 [TRT] Tactic: 5636095 Time: 0.0222135 [TRT] Tactic: 5701631 Time: 0.054844 [TRT] Tactic: 5767167 Time: 0.031927 [TRT] Tactic: 5832703 Time: 0.0334375 [TRT] Tactic: 5898239 Time: 0.0177085 [TRT] Tactic: 6029311 Time: 0.0528125 [TRT] Tactic: 6225919 Time: 0.0174475 [TRT] Tactic: 6291455 Time: 0.0129945 [TRT] Tactic: 6422527 Time: 0.029453 [TRT] Tactic: 6750207 Time: 0.016615 [TRT] Tactic: 6815743 Time: 0.0316405 [TRT] Tactic: 6946815 Time: 0.0318225 [TRT] Tactic: 7012351 Time: 0.0176045 [TRT] Tactic: 7077887 Time: 0.019766 [TRT] Tactic: 7143423 Time: 0.031927 [TRT] Tactic: 7208959 Time: 0.0341145 [TRT] Tactic: 7340031 Time: 0.0176565 [TRT] Tactic: 7405567 Time: 0.0200525 [TRT] Tactic: 7536639 Time: 0.03151 [TRT] Tactic: 7602175 Time: 0.031849 [TRT] Tactic: 7733247 Time: 0.022396 [TRT] Tactic: 7798783 Time: 0.0286455 [TRT] Tactic: 8191999 Time: 0.027005 [TRT] Tactic: 8257535 Time: 0.018802 [TRT] Tactic: 8323071 Time: 0.0245575 [TRT] Tactic: 8650751 Time: 0.031979 [TRT] Tactic: 8716287 Time: 0.0175005 [TRT] Tactic: 9109503 Time: 0.01763 [TRT] Tactic: 9568255 Time: 0.0196615 [TRT] Tactic: 9895935 Time: 0.0292445 [TRT] Tactic: 10223615 Time: 0.056562 [TRT] Tactic: 10354687 Time: 0.0188805 [TRT] Tactic: 10551295 Time: 0.0367445 [TRT] Tactic: 10747903 Time: 0.0221615 [TRT] Tactic: 10944511 Time: 0.0386455 [TRT] Fastest Tactic: 1179647 Time: 0.0127345 [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Relu6) (CudaDepthwiseConvolution) [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Relu6) (CudnnConvolution) [TRT] Tactic: 0 Time: 0.100782 [TRT] Tactic: 1 Time: 0.0955725 [TRT] Tactic: 2 Time: 0.196198 [TRT] Tactic: 4 skipped. Scratch requested: 38404096, available: 33554432 [TRT] Tactic: 5 Time: 0.97513 [TRT] Fastest Tactic: 1 Time: 0.0955725 [TRT] Setting workspace to 38404096enables more tactics for profiling [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Relu6) (CublasConvolution) [TRT] CublasConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Relu6) (CaskConvolution) [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758 [TRT] Tactic: 1062367460111450758 Time: 0.0534115 [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 Tactic: 1698681053543049347 [TRT] Tactic: 1698681053543049347 Time: 0.042057 [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441 [TRT] Tactic: 4501471010995462441 Time: 0.059844 [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826 [TRT] Tactic: 5137655947464784826 Time: 0.0416145 [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929 [TRT] Tactic: 5288347012147084929 Time: 0.0600005 [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 Tactic: 5326823351883942011 [TRT] Tactic: 5326823351883942011 Time: 0.0585155 [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 Tactic: 5500448035057547314 [TRT] Tactic: 5500448035057547314 Time: 0.048776 [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056 [TRT] Tactic: 6645123197870846056 Time: 0.066146 [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478 [TRT] Tactic: 7144526460361122478 Time: 0.04625 [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730 [TRT] Tactic: -8262349710178828730 Time: 0.061198 [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 Tactic: -6576203419454146580 [TRT] Tactic: -6576203419454146580 Time: 0.044036 [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159 [TRT] Tactic: -4787320710726427159 Time: 0.0489845 [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839 [TRT] Tactic: -3456450830548107839 Time: 0.046875 [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241 [TRT] Tactic: -1218658103698133241 Time: 0.0529945 [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091 [TRT] Tactic: -836875257600482091 Time: 0.050286 [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746 [TRT] Tactic: -410470605513481746 Time: 0.0584895 [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 Tactic: -377491875521947884 [TRT] Tactic: -377491875521947884 Time: 0.058255 [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 Tactic: -37215280111360163 [TRT] Tactic: -37215280111360163 Time: 0.0418225 [TRT] Fastest Tactic: 5137655947464784826 Time: 0.0416145 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 1179647 [TRT] *************** Autotuning format combination: Float(1024,1,512,256) -> Float(256,1,128,64) *************** [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Relu6) (CudnnConvolution) [TRT] CudnnConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Relu6) (CublasConvolution) [TRT] CublasConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Relu6) (CaskConvolution) [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Relu6) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 3886731678879822788 [TRT] Tactic: 3886731678879822788 Time: 0.034349 [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Relu6) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 6629944304117643200 [TRT] Tactic: 6629944304117643200 Time: 0.041276 [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Relu6) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -9153228964338181824 [TRT] Tactic: -9153228964338181824 Time: 0.041198 [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Relu6) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -7394439838318485025 [TRT] Tactic: -7394439838318485025 Time: 0.0344535 [TRT] Fastest Tactic: 3886731678879822788 Time: 0.034349 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 3886731678879822788 [TRT] *************** Autotuning format combination: Half(1024,4,2,1) -> Half(256,4,2,1) *************** [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Relu6) (CudnnConvolution) [TRT] Tactic: 0 Time: 0.074844 [TRT] Tactic: 1 Time: 0.105756 [TRT] Tactic: 2 Time: 0.195208 [TRT] Tactic: 4 skipped. Scratch requested: 38404096, available: 33554432 [TRT] Tactic: 5 Time: 0.94112 [TRT] Fastest Tactic: 0 Time: 0.074844 [TRT] Setting workspace to 38404096enables more tactics for profiling [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Relu6) (CublasConvolution) [TRT] CublasConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Relu6) (CaskConvolution) [TRT] CaskConvolution has no valid tactics for this config, skipping [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 0 [TRT] *************** Autotuning format combination: Half(512,4:2,2,1) -> Half(256,4,2,1) *************** [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Relu6) (CaskConvolution) [TRT] CaskConvolution has no valid tactics for this config, skipping [TRT] *************** Autotuning format combination: Half(512,4:2,2,1) -> Half(128,4:2,2,1) *************** [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Relu6) (FusedConvActConvolution) [TRT] Tactic: 589823 Time: 0.0317185 [TRT] Tactic: 655359 Time: 0.0381505 [TRT] Tactic: 786431 Time: 0.0222395 [TRT] Tactic: 851967 Time: 0.015261 [TRT] Tactic: 1179647 Time: 0.008255 [TRT] Tactic: 1310719 Time: 0.0751825 [TRT] Tactic: 1376255 Time: 0.0340105 [TRT] Tactic: 1441791 Time: 0.0127865 [TRT] Tactic: 1507327 Time: 0.024557 [TRT] Tactic: 1638399 Time: 0.014349 [TRT] Tactic: 1835007 Time: 0.0197915 [TRT] Tactic: 1900543 Time: 0.0415625 [TRT] Tactic: 2097151 Time: 0.013073 [TRT] Tactic: 2162687 Time: 0.037578 [TRT] Tactic: 2293759 Time: 0.033542 [TRT] Tactic: 2359295 Time: 0.026484 [TRT] Tactic: 2686975 Time: 0.0570835 [TRT] Tactic: 3080191 Time: 0.021745 [TRT] Tactic: 3342335 Time: 0.0244535 [TRT] Tactic: 3407871 Time: 0.0211205 [TRT] Tactic: 3538943 Time: 0.012969 [TRT] Tactic: 3670015 Time: 0.0671355 [TRT] Tactic: 3932159 Time: 0.0176565 [TRT] Tactic: 3997695 Time: 0.0152085 [TRT] Tactic: 4063231 Time: 0.015078 [TRT] Tactic: 4194303 Time: 0.0210415 [TRT] Tactic: 4259839 Time: 0.0131775 [TRT] Tactic: 4325375 Time: 0.015052 [TRT] Tactic: 4521983 Time: 0.036172 [TRT] Tactic: 4587519 Time: 0.0129165 [TRT] Tactic: 4653055 Time: 0.0128125 [TRT] Tactic: 4915199 Time: 0.01513 [TRT] Tactic: 4980735 Time: 0.0244005 [TRT] Tactic: 5177343 Time: 0.008203 [TRT] Tactic: 5242879 Time: 0.018802 [TRT] Tactic: 5373951 Time: 0.0082555 [TRT] Tactic: 5439487 Time: 0.0174215 [TRT] Tactic: 5570559 Time: 0.0225 [TRT] Tactic: 5636095 Time: 0.015104 [TRT] Tactic: 5701631 Time: 0.0306515 [TRT] Tactic: 5767167 Time: 0.0201305 [TRT] Tactic: 5832703 Time: 0.019818 [TRT] Tactic: 5898239 Time: 0.0128645 [TRT] Tactic: 6029311 Time: 0.0307295 [TRT] Tactic: 6225919 Time: 0.0118495 [TRT] Tactic: 6291455 Time: 0.008151 [TRT] Tactic: 6422527 Time: 0.0188535 [TRT] Tactic: 6750207 Time: 0.012864 [TRT] Tactic: 6815743 Time: 0.0175 [TRT] Tactic: 6946815 Time: 0.017552 [TRT] Tactic: 7012351 Time: 0.013047 [TRT] Tactic: 7077887 Time: 0.012786 [TRT] Tactic: 7143423 Time: 0.0198955 [TRT] Tactic: 7208959 Time: 0.0197655 [TRT] Tactic: 7340031 Time: 0.0126825 [TRT] Tactic: 7405567 Time: 0.012917 [TRT] Tactic: 7536639 Time: 0.027083 [TRT] Tactic: 7602175 Time: 0.0175785 [TRT] Tactic: 7733247 Time: 0.0166405 [TRT] Tactic: 7798783 Time: 0.022578 [TRT] Tactic: 8191999 Time: 0.012865 [TRT] Tactic: 8257535 Time: 0.0129685 [TRT] Tactic: 8323071 Time: 0.017213 [TRT] Tactic: 8650751 Time: 0.0174215 [TRT] Tactic: 8716287 Time: 0.0115365 [TRT] Tactic: 9109503 Time: 0.0128125 [TRT] Tactic: 9568255 Time: 0.015 [TRT] Tactic: 9895935 Time: 0.020182 [TRT] Tactic: 10223615 Time: 0.0565625 [TRT] Tactic: 10354687 Time: 0.012578 [TRT] Tactic: 10551295 Time: 0.022161 [TRT] Tactic: 10747903 Time: 0.015104 [TRT] Tactic: 10944511 Time: 0.024088 [TRT] Fastest Tactic: 6291455 Time: 0.008151 [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Relu6) (CudnnConvolution) [TRT] CudnnConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Relu6) (CublasConvolution) [TRT] CublasConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Relu6) (CaskConvolution) [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Relu6) Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 3066127711859985668 [TRT] Tactic: 3066127711859985668 Time: 0.026849 [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Relu6) Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 3564772625446233998 [TRT] Tactic: 3564772625446233998 Time: 0.031875 [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Relu6) Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: 5319956359050645452 [TRT] Tactic: 5319956359050645452 Time: 0.0271615 [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Relu6) Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 7205456024582378848 [TRT] Tactic: 7205456024582378848 Time: 0.0273955 [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Relu6) Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 8163473458334948789 [TRT] Tactic: 8163473458334948789 Time: 0.0248955 [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Relu6) Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -4212163711445252890 [TRT] Tactic: -4212163711445252890 Time: 0.0321875 [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Relu6) Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: -3898373634979201110 [TRT] Tactic: -3898373634979201110 Time: 0.034427 [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Relu6) Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: -2409163523992614473 [TRT] Tactic: -2409163523992614473 Time: 0.024792 [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Relu6) Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: -1716393687483585322 [TRT] Tactic: -1716393687483585322 Time: 0.0321875 [TRT] Fastest Tactic: -2409163523992614473 Time: 0.024792 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 6291455 [TRT] =============== Computing costs for [TRT] *************** Autotuning format combination: Float(256,4,2,1) -> Float(64,1,1,1) *************** [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/Relu6) (CudaDepthwiseConvolution) [TRT] Tactic: -1 Time: 0.024193 [TRT] Fastest Tactic: -1 Time: 0.024193 [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/Relu6) (CudnnConvolution) [TRT] Tactic: 0 Time: 0.027187 [TRT] Tactic: 1 Time: 0.027682 [TRT] Tactic: 2 Time: 0.027083 [TRT] Tactic: 5 Time: 19.6508 [TRT] Fastest Tactic: 2 Time: 0.027083 [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/Relu6) (CaskConvolution) [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758 [TRT] Tactic: 1062367460111450758 Time: 1.35812 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v0 Tactic: 1754984623894446479 [TRT] Tactic: 1754984623894446479 Time: 1.4462 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v0 Tactic: 3611739942397549984 [TRT] Tactic: 3611739942397549984 Time: 1.37914 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v1 Tactic: 4337000649858996379 [TRT] Tactic: 4337000649858996379 Time: 1.55812 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441 [TRT] Tactic: 4501471010995462441 Time: 1.39219 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826 [TRT] Tactic: 5137655947464784826 Time: 1.69745 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929 [TRT] Tactic: 5288347012147084929 Time: 1.41315 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056 [TRT] Tactic: 6645123197870846056 Time: 1.64922 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478 [TRT] Tactic: 7144526460361122478 Time: 1.6556 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_large_nn_v1 Tactic: -9137461792520977713 [TRT] Tactic: -9137461792520977713 Time: 1.73677 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730 [TRT] Tactic: -8262349710178828730 Time: 1.64372 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_large_nn_v0 Tactic: -8133971918129952780 [TRT] Tactic: -8133971918129952780 Time: 1.71078 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_large_nn_v1 Tactic: -6092040395344634144 [TRT] Tactic: -6092040395344634144 Time: 1.64461 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159 [TRT] Tactic: -4787320710726427159 Time: 1.45573 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839 [TRT] Tactic: -3456450830548107839 Time: 1.54875 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241 [TRT] Tactic: -1218658103698133241 Time: 1.7113 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091 [TRT] Tactic: -836875257600482091 Time: 1.49443 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746 [TRT] Tactic: -410470605513481746 Time: 1.62607 [TRT] Fastest Tactic: 1062367460111450758 Time: 1.35812 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudaDepthwiseConvolution Tactic: -1 [TRT] *************** Autotuning format combination: Float(256,1,128,64) -> Float(64,1,64,64) *************** [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/Relu6) (CudnnConvolution) [TRT] CudnnConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/Relu6) (CaskConvolution) [TRT] CaskConvolution has no valid tactics for this config, skipping [TRT] *************** Autotuning format combination: Half(256,4,2,1) -> Half(64,1,1,1) *************** [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/Relu6) (CudnnConvolution) [TRT] Tactic: 0 Time: 0.028672 [TRT] Tactic: 1 Time: 0.0271095 [TRT] Tactic: 2 Time: 0.027657 [TRT] Tactic: 5 Time: 19.7016 [TRT] Fastest Tactic: 1 Time: 0.0271095 [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/Relu6) (CaskConvolution) [TRT] CaskConvolution has no valid tactics for this config, skipping [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 1 [TRT] *************** Autotuning format combination: Half(128,4:2,2,1) -> Half(32,1:2,1,1) *************** [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/Relu6) (CaskConvolution) [TRT] CaskConvolution has no valid tactics for this config, skipping [TRT] =============== Computing costs for [TRT] *************** Autotuning format combination: Float(64,1,1,1) -> Float(128,1,1,1) *************** [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Relu6) (FusedConvActConvolution) [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Relu6) (CudaDepthwiseConvolution) [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Relu6) (CudnnConvolution) [TRT] Tactic: 0 Time: 0.0314325 [TRT] Tactic: 1 Time: 0.0384895 [TRT] Tactic: 2 Time: 0.0674475 [TRT] Tactic: 4 Time: 2.4519 [TRT] Tactic: 5 Time: 0.436771 [TRT] Fastest Tactic: 0 Time: 0.0314325 [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Relu6) (CublasConvolution) [TRT] CublasConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Relu6) (CaskConvolution) [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v1 Tactic: 1062367460111450758 [TRT] Tactic: 1062367460111450758 Time: 0.030859 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 Tactic: 1698681053543049347 [TRT] Tactic: 1698681053543049347 Time: 0.0253385 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v1 Tactic: 4501471010995462441 [TRT] Tactic: 4501471010995462441 Time: 0.0247655 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826 [TRT] Tactic: 5137655947464784826 Time: 0.027031 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v0 Tactic: 5288347012147084929 [TRT] Tactic: 5288347012147084929 Time: 0.0248175 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 Tactic: 5326823351883942011 [TRT] Tactic: 5326823351883942011 Time: 0.024219 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v0 Tactic: 5500448035057547314 [TRT] Tactic: 5500448035057547314 Time: 0.025052 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056 [TRT] Tactic: 6645123197870846056 Time: 0.0265625 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478 [TRT] Tactic: 7144526460361122478 Time: 0.0251825 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_medium_nn_v0 Tactic: -8262349710178828730 [TRT] Tactic: -8262349710178828730 Time: 0.0250785 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 Tactic: -6576203419454146580 [TRT] Tactic: -6576203419454146580 Time: 0.027787 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_medium_nn_v0 Tactic: -4787320710726427159 [TRT] Tactic: -4787320710726427159 Time: 0.0266665 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v1 Tactic: -3456450830548107839 [TRT] Tactic: -3456450830548107839 Time: 0.0298965 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v0 Tactic: -1218658103698133241 [TRT] Tactic: -1218658103698133241 Time: 0.027266 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v0 Tactic: -836875257600482091 [TRT] Tactic: -836875257600482091 Time: 0.026328 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_small_nn_v1 Tactic: -410470605513481746 [TRT] Tactic: -410470605513481746 Time: 0.025 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Relu6) Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v0 Tactic: -377491875521947884 [TRT] Tactic: -377491875521947884 Time: 0.024792 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 Tactic: -37215280111360163 [TRT] Tactic: -37215280111360163 Time: 0.025521 [TRT] Fastest Tactic: 5326823351883942011 Time: 0.024219 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: 5326823351883942011 [TRT] *************** Autotuning format combination: Float(64,1,64,64) -> Float(128,1,128,128) *************** [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Relu6) (CudnnConvolution) [TRT] CudnnConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Relu6) (CublasConvolution) [TRT] CublasConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Relu6) (CaskConvolution) [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Relu6) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 3886731678879822788 [TRT] Tactic: 3886731678879822788 Time: 0.0339325 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Relu6) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_interior_nhwc_tn_v1 Tactic: 6629944304117643200 [TRT] Tactic: 6629944304117643200 Time: 0.044609 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Relu6) Set Tactic Name: maxwell_scudnn_128x32_sliced1x4_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -9153228964338181824 [TRT] Tactic: -9153228964338181824 Time: 0.0440365 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Relu6) Set Tactic Name: maxwell_scudnn_128x64_sliced1x2_ldg4_relu_exp_small_nhwc_tn_v1 Tactic: -7394439838318485025 [TRT] Tactic: -7394439838318485025 Time: 0.024141 [TRT] Fastest Tactic: -7394439838318485025 Time: 0.024141 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -7394439838318485025 [TRT] *************** Autotuning format combination: Half(64,1,1,1) -> Half(128,1,1,1) *************** [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Relu6) (CudnnConvolution) [TRT] Tactic: 0 Time: 0.0391665 [TRT] Tactic: 1 Time: 0.0322915 [TRT] Tactic: 2 Time: 0.0648175 [TRT] Tactic: 4 Time: 2.44508 [TRT] Tactic: 5 Time: 0.432057 [TRT] Fastest Tactic: 1 Time: 0.0322915 [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Relu6) (CublasConvolution) [TRT] CublasConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Relu6) (CaskConvolution) [TRT] CaskConvolution has no valid tactics for this config, skipping [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 1 [TRT] *************** Autotuning format combination: Half(32,1:2,1,1) -> Half(128,1,1,1) *************** [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Relu6) (CaskConvolution) [TRT] CaskConvolution has no valid tactics for this config, skipping [TRT] *************** Autotuning format combination: Half(32,1:2,1,1) -> Half(64,1:2,1,1) *************** [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Relu6) (FusedConvActConvolution) [TRT] Tactic: 589823 Time: 0.0150525 [TRT] Tactic: 655359 Time: 0.017265 [TRT] Tactic: 786431 Time: 0.0138285 [TRT] Tactic: 851967 Time: 0.0082815 [TRT] Tactic: 1179647 Time: 0.007995 [TRT] Tactic: 1310719 Time: 0.02888 [TRT] Tactic: 1376255 Time: 0.0150785 [TRT] Tactic: 1441791 Time: 0.0103645 [TRT] Tactic: 1507327 Time: 0.012917 [TRT] Tactic: 1638399 Time: 0.010599 [TRT] Tactic: 1835007 Time: 0.0127085 [TRT] Tactic: 1900543 Time: 0.019844 [TRT] Tactic: 2097151 Time: 0.012891 [TRT] Tactic: 2162687 Time: 0.016797 [TRT] Tactic: 2293759 Time: 0.014219 [TRT] Tactic: 2359295 Time: 0.015078 [TRT] Tactic: 2686975 Time: 0.0198965 [TRT] Tactic: 3080191 Time: 0.010521 [TRT] Tactic: 3342335 Time: 0.0126825 [TRT] Tactic: 3407871 Time: 0.011849 [TRT] Tactic: 3538943 Time: 0.008073 [TRT] Tactic: 3670015 Time: 0.0245055 [TRT] Tactic: 3932159 Time: 0.010312 [TRT] Tactic: 3997695 Time: 0.010391 [TRT] Tactic: 4063231 Time: 0.010312 [TRT] Tactic: 4194303 Time: 0.014245 [TRT] Tactic: 4259839 Time: 0.0129165 [TRT] Tactic: 4325375 Time: 0.010443 [TRT] Tactic: 4521983 Time: 0.0153905 [TRT] Tactic: 4587519 Time: 0.010364 [TRT] Tactic: 4653055 Time: 0.010391 [TRT] Tactic: 4915199 Time: 0.0105465 [TRT] Tactic: 4980735 Time: 0.014427 [TRT] Tactic: 5177343 Time: 0.007969 [TRT] Tactic: 5242879 Time: 0.010417 [TRT] Tactic: 5373951 Time: 0.0073435 [TRT] Tactic: 5439487 Time: 0.010235 [TRT] Tactic: 5570559 Time: 0.0129165 [TRT] Tactic: 5636095 Time: 0.009479 [TRT] Tactic: 5701631 Time: 0.012812 [TRT] Tactic: 5767167 Time: 0.007943 [TRT] Tactic: 5832703 Time: 0.0104165 [TRT] Tactic: 5898239 Time: 0.0104955 [TRT] Tactic: 6029311 Time: 0.0127605 [TRT] Tactic: 6225919 Time: 0.0079425 [TRT] Tactic: 6291455 Time: 0.008151 [TRT] Tactic: 6422527 Time: 0.009713 [TRT] Tactic: 6750207 Time: 0.008047 [TRT] Tactic: 6815743 Time: 0.010391 [TRT] Tactic: 6946815 Time: 0.010313 [TRT] Tactic: 7012351 Time: 0.0128385 [TRT] Tactic: 7077887 Time: 0.0080725 [TRT] Tactic: 7143423 Time: 0.008151 [TRT] Tactic: 7208959 Time: 0.010495 [TRT] Tactic: 7340031 Time: 0.0104165 [TRT] Tactic: 7405567 Time: 0.0092965 [TRT] Tactic: 7536639 Time: 0.010365 [TRT] Tactic: 7602175 Time: 0.010312 [TRT] Tactic: 7733247 Time: 0.0103645 [TRT] Tactic: 7798783 Time: 0.0128905 [TRT] Tactic: 8191999 Time: 0.007969 [TRT] Tactic: 8257535 Time: 0.010339 [TRT] Tactic: 8323071 Time: 0.0103125 [TRT] Tactic: 8650751 Time: 0.010443 [TRT] Tactic: 8716287 Time: 0.0078645 [TRT] Tactic: 9109503 Time: 0.012682 [TRT] Tactic: 9568255 Time: 0.010443 [TRT] Tactic: 9895935 Time: 0.0141665 [TRT] Tactic: 10223615 Time: 0.0199215 [TRT] Tactic: 10354687 Time: 0.01289 [TRT] Tactic: 10551295 Time: 0.0104165 [TRT] Tactic: 10747903 Time: 0.0103385 [TRT] Tactic: 10944511 Time: 0.015182 [TRT] Fastest Tactic: 5373951 Time: 0.0073435 [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Relu6) (CudnnConvolution) [TRT] CudnnConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Relu6) (CublasConvolution) [TRT] CublasConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Relu6) (CaskConvolution) [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Relu6) Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_interior_nn_v1 Tactic: 3066127711859985668 [TRT] Tactic: 3066127711859985668 Time: 0.0180465 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Relu6) Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_medium_nn_v1 Tactic: 3564772625446233998 [TRT] Tactic: 3564772625446233998 Time: 0.0189845 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Relu6) Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x32_relu_small_nn_v1 Tactic: 5319956359050645452 [TRT] Tactic: 5319956359050645452 Time: 0.0176305 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Relu6) Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_medium_nn_v1 Tactic: 7205456024582378848 [TRT] Tactic: 7205456024582378848 Time: 0.0169005 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Relu6) Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 8163473458334948789 [TRT] Tactic: 8163473458334948789 Time: 0.015703 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Relu6) Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_small_nn_v1 Tactic: -4212163711445252890 [TRT] Tactic: -4212163711445252890 Time: 0.0153385 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Relu6) Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_medium_nn_v1 Tactic: -3898373634979201110 [TRT] Tactic: -3898373634979201110 Time: 0.0172135 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Relu6) Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: -2409163523992614473 [TRT] Tactic: -2409163523992614473 Time: 0.017604 [TRT] FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Relu6) Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: -1716393687483585322 [TRT] Tactic: -1716393687483585322 Time: 0.015365 [TRT] Fastest Tactic: -4212163711445252890 Time: 0.0153385 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 5373951 [TRT] =============== Computing costs for [TRT] *************** Autotuning format combination: Float(128,1,1,1) -> Float(570,1,1,1) *************** [TRT] --------------- Timing Runner: BoxPredictor_5/BoxEncodingPredictor/Conv2D || BoxPredictor_5/ClassPredictor/Conv2D (FusedConvActConvolution) [TRT] FusedConvActConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: BoxPredictor_5/BoxEncodingPredictor/Conv2D || BoxPredictor_5/ClassPredictor/Conv2D (CudaDepthwiseConvolution) [TRT] CudaDepthwiseConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: BoxPredictor_5/BoxEncodingPredictor/Conv2D || BoxPredictor_5/ClassPredictor/Conv2D (CudnnConvolution) [TRT] Tactic: 0 Time: 0.918177 [TRT] Tactic: 1 Time: 1.03193 [TRT] Tactic: 2 Time: 0.780234 [TRT] Tactic: 4 skipped. Scratch requested: 171021312, available: 33554432 [TRT] Tactic: 5 skipped. Scratch requested: 320559616, available: 33554432 [TRT] Tactic: 6 Time: 0.97552 [TRT] Fastest Tactic: 2 Time: 0.780234 [TRT] Setting workspace to 171021312enables more tactics for profiling [TRT] --------------- Timing Runner: BoxPredictor_5/BoxEncodingPredictor/Conv2D || BoxPredictor_5/ClassPredictor/Conv2D (CaskConvolution) [TRT] BoxPredictor_5/BoxEncodingPredictor/Conv2D || BoxPredictor_5/ClassPredictor/Conv2D Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v1 Tactic: 3827454225649558724 [TRT] Tactic: 3827454225649558724 Time: 0.666198 [TRT] BoxPredictor_5/BoxEncodingPredictor/Conv2D || BoxPredictor_5/ClassPredictor/Conv2D Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148m_nt_v1 Tactic: 5921334924264294896 [TRT] Tactic: 5921334924264294896 Time: 0.52961 [TRT] BoxPredictor_5/BoxEncodingPredictor/Conv2D || BoxPredictor_5/ClassPredictor/Conv2D Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v1 Tactic: 7852627285308570038 [TRT] Tactic: 7852627285308570038 Time: 0.697994 [TRT] BoxPredictor_5/BoxEncodingPredictor/Conv2D || BoxPredictor_5/ClassPredictor/Conv2D Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148n_nt_v0 Tactic: -8776506421218919509 [TRT] Tactic: -8776506421218919509 Time: 0.674401 [TRT] BoxPredictor_5/BoxEncodingPredictor/Conv2D || BoxPredictor_5/ClassPredictor/Conv2D Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_relu_tile148t_nt_v0 Tactic: -2318106587342035239 [TRT] Tactic: -2318106587342035239 Time: 0.667917 [TRT] BoxPredictor_5/BoxEncodingPredictor/Conv2D || BoxPredictor_5/ClassPredictor/Conv2D Set Tactic Name: maxwell_scudnn_winograd_128x128_ldg1_ldg4_mobile_relu_tile148t_nt_v0 Tactic: -1343271414618805657 [TRT] Tactic: -1343271414618805657 Time: 0.501901 [TRT] Fastest Tactic: -1343271414618805657 Time: 0.501901 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CaskConvolution Tactic: -1343271414618805657 [TRT] *************** Autotuning format combination: Float(128,1,128,128) -> Float(570,1,570,570) *************** [TRT] --------------- Timing Runner: BoxPredictor_5/BoxEncodingPredictor/Conv2D || BoxPredictor_5/ClassPredictor/Conv2D (CudnnConvolution) [TRT] CudnnConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: BoxPredictor_5/BoxEncodingPredictor/Conv2D || BoxPredictor_5/ClassPredictor/Conv2D (CaskConvolution) [TRT] CaskConvolution has no valid tactics for this config, skipping [TRT] *************** Autotuning format combination: Half(128,1,1,1) -> Half(570,1,1,1) *************** [TRT] --------------- Timing Runner: BoxPredictor_5/BoxEncodingPredictor/Conv2D || BoxPredictor_5/ClassPredictor/Conv2D (CudnnConvolution) [TRT] Tactic: 0 Time: 0.617709 [TRT] Tactic: 1 Time: 0.623855 [TRT] Tactic: 2 Time: 0.771016 [TRT] Tactic: 4 skipped. Scratch requested: 171021312, available: 33554432 [TRT] Tactic: 5 skipped. Scratch requested: 320559616, available: 33554432 [TRT] Tactic: 6 Time: 1.5431 [TRT] Fastest Tactic: 0 Time: 0.617709 [TRT] Setting workspace to 171021312enables more tactics for profiling [TRT] --------------- Timing Runner: BoxPredictor_5/BoxEncodingPredictor/Conv2D || BoxPredictor_5/ClassPredictor/Conv2D (CaskConvolution) [TRT] CaskConvolution has no valid tactics for this config, skipping [TRT] >>>>>>>>>>>>>>> Chose Runner Type: CudnnConvolution Tactic: 0 [TRT] *************** Autotuning format combination: Half(64,1:2,1,1) -> Half(285,1:2,1,1) *************** [TRT] --------------- Timing Runner: BoxPredictor_5/BoxEncodingPredictor/Conv2D || BoxPredictor_5/ClassPredictor/Conv2D (FusedConvActConvolution) [TRT] Tactic: 524287 Time: 0.147994 [TRT] Tactic: 720895 Time: 0.161171 [TRT] Tactic: 983039 Time: 0.132265 [TRT] Tactic: 1048575 Time: 0.190287 [TRT] Tactic: 1703935 Time: 0.187369 [TRT] Tactic: 1769471 Time: 1.0237 [TRT] Tactic: 1966079 Time: 0.188203 [TRT] Tactic: 2031615 Time: 0.15375 [TRT] Tactic: 2228223 Time: 0.240626 [TRT] Tactic: 2424831 Time: 0.325235 [TRT] Tactic: 2621439 Time: 0.207864 [TRT] Tactic: 2752511 Time: 0.185417 [TRT] Tactic: 3014655 Time: 0.257005 [TRT] Tactic: 3145727 Time: 0.168021 [TRT] Tactic: 3604479 Time: 0.258307 [TRT] Tactic: 4390911 Time: 0.206068 [TRT] Tactic: 5046271 Time: 0.1425 [TRT] Tactic: 5963775 Time: 0.169973 [TRT] Tactic: 6160383 Time: 0.154792 [TRT] Tactic: 6488063 Time: 0.23836 [TRT] Tactic: 6881279 Time: 0.13737 [TRT] Tactic: 7274495 Time: 0.137448 [TRT] Tactic: 7864319 Time: 0.222162 [TRT] Tactic: 7995391 Time: 0.180521 [TRT] Tactic: 8585215 Time: 0.183672 [TRT] Tactic: 8847359 Time: 0.24336 [TRT] Tactic: 8978431 Time: 0.168204 [TRT] Tactic: 9043967 Time: 0.223724 [TRT] Tactic: 9175039 Time: 0.252344 [TRT] Tactic: 9502719 Time: 0.207943 [TRT] Tactic: 9961471 Time: 0.268099 [TRT] Tactic: 10027007 Time: 0.168673 [TRT] Tactic: 10092543 Time: 0.210964 [TRT] Tactic: 10289151 Time: 0.191171 [TRT] Tactic: 10485759 Time: 0.159844 [TRT] Tactic: 10682367 Time: 0.201901 [TRT] Tactic: 10813439 Time: 0.159219 [TRT] Fastest Tactic: 983039 Time: 0.132265 [TRT] --------------- Timing Runner: BoxPredictor_5/BoxEncodingPredictor/Conv2D || BoxPredictor_5/ClassPredictor/Conv2D (CudnnConvolution) [TRT] CudnnConvolution has no valid tactics for this config, skipping [TRT] --------------- Timing Runner: BoxPredictor_5/BoxEncodingPredictor/Conv2D || BoxPredictor_5/ClassPredictor/Conv2D (CaskConvolution) [TRT] BoxPredictor_5/BoxEncodingPredictor/Conv2D || BoxPredictor_5/ClassPredictor/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148m_nt_v1 Tactic: 4772821744921268633 [TRT] Tactic: 4772821744921268633 Time: 0.290365 [TRT] Fastest Tactic: 4772821744921268633 Time: 0.290365 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: FusedConvActConvolution Tactic: 983039 [TRT] =============== Computing costs for [TRT] *************** Autotuning format combination: Float(570,1,1,1) -> Float(546,91,1,1) *************** [TRT] --------------- Timing Runner: (Unnamed Layer* 697) [Shuffle] + BoxPredictor_5/Reshape_1 (Shuffle) [TRT] Tactic: 0 Time: 0.005625 [TRT] Fastest Tactic: 0 Time: 0.005625 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TRT] *************** Autotuning format combination: Float(570,1,570,570) -> Float(546,1,6,6) *************** [TRT] --------------- Timing Runner: (Unnamed Layer* 697) [Shuffle] + BoxPredictor_5/Reshape_1 (Shuffle) [TRT] Tactic: 0 Time: 0.005625 [TRT] Fastest Tactic: 0 Time: 0.005625 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TRT] *************** Autotuning format combination: Float(18,1:32,1,1) -> Float(91,91:32,1,1) *************** [TRT] --------------- Timing Runner: (Unnamed Layer* 697) [Shuffle] + BoxPredictor_5/Reshape_1 (Shuffle) [TRT] Tactic: 0 Time: 0.0104685 [TRT] Fastest Tactic: 0 Time: 0.0104685 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TRT] *************** Autotuning format combination: Half(570,1,1,1) -> Half(546,91,1,1) *************** [TRT] --------------- Timing Runner: (Unnamed Layer* 697) [Shuffle] + BoxPredictor_5/Reshape_1 (Shuffle) [TRT] Tactic: 0 Time: 0.005729 [TRT] Fastest Tactic: 0 Time: 0.005729 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TRT] *************** Autotuning format combination: Half(285,1:2,1,1) -> Half(273,91:2,1,1) *************** [TRT] --------------- Timing Runner: (Unnamed Layer* 697) [Shuffle] + BoxPredictor_5/Reshape_1 (Shuffle) [TRT] Tactic: 0 Time: 0.005521 [TRT] Fastest Tactic: 0 Time: 0.005521 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TRT] =============== Computing costs for [TRT] *************** Autotuning format combination: Float(98553,91,1,1), Float(54600,91,1,1), Float(13650,91,1,1), Float(4914,91,1,1), Float(2184,91,1,1), Float(546,91,1,1) -> Float(174447,1,1,1) *************** [TRT] =============== Computing costs for [TRT] *************** Autotuning format combination: Float(102885,361,19,1) -> Float(4332,4,4,1) *************** [TRT] --------------- Timing Runner: (Unnamed Layer* 707) [Shuffle] + BoxPredictor_0/Reshape (Shuffle) [TRT] Tactic: 0 Time: 0.010364 [TRT] Fastest Tactic: 0 Time: 0.010364 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TRT] *************** Autotuning format combination: Float(102885,1,5415,285) -> Float(4332,1,4332,1083) *************** [TRT] --------------- Timing Runner: (Unnamed Layer* 707) [Shuffle] + BoxPredictor_0/Reshape (Shuffle) [TRT] Tactic: 0 Time: 0.0104165 [TRT] Fastest Tactic: 0 Time: 0.0104165 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TRT] *************** Autotuning format combination: Float(3249,361:32,19,1) -> Float(136,4:32,4,1) *************** [TRT] --------------- Timing Runner: (Unnamed Layer* 707) [Shuffle] + BoxPredictor_0/Reshape (Shuffle) [TRT] Tactic: 0 Time: 0.0128905 [TRT] Fastest Tactic: 0 Time: 0.0128905 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TRT] *************** Autotuning format combination: Half(102885,361,19,1) -> Half(4332,4,4,1) *************** [TRT] --------------- Timing Runner: (Unnamed Layer* 707) [Shuffle] + BoxPredictor_0/Reshape (Shuffle) [TRT] Tactic: 0 Time: 0.010573 [TRT] Fastest Tactic: 0 Time: 0.010573 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TRT] *************** Autotuning format combination: Half(51623,361:2,19,1) -> Half(2168,4:2,4,1) *************** [TRT] --------------- Timing Runner: (Unnamed Layer* 707) [Shuffle] + BoxPredictor_0/Reshape (Shuffle) [TRT] Tactic: 0 Time: 0.0129425 [TRT] Fastest Tactic: 0 Time: 0.0129425 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TRT] =============== Computing costs for [TRT] *************** Autotuning format combination: Float(57000,100,10,1) -> Float(2400,4,4,1) *************** [TRT] --------------- Timing Runner: (Unnamed Layer* 716) [Shuffle] + BoxPredictor_1/Reshape (Shuffle) [TRT] Tactic: 0 Time: 0.0080985 [TRT] Fastest Tactic: 0 Time: 0.0080985 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TRT] *************** Autotuning format combination: Float(57000,1,5700,570) -> Float(2400,1,2400,600) *************** [TRT] --------------- Timing Runner: (Unnamed Layer* 716) [Shuffle] + BoxPredictor_1/Reshape (Shuffle) [TRT] Tactic: 0 Time: 0.008021 [TRT] Fastest Tactic: 0 Time: 0.008021 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TRT] *************** Autotuning format combination: Float(1800,100:32,10,1) -> Float(76,4:32,4,1) *************** [TRT] --------------- Timing Runner: (Unnamed Layer* 716) [Shuffle] + BoxPredictor_1/Reshape (Shuffle) [TRT] Tactic: 0 Time: 0.0079685 [TRT] Fastest Tactic: 0 Time: 0.0079685 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TRT] *************** Autotuning format combination: Half(57000,100,10,1) -> Half(2400,4,4,1) *************** [TRT] --------------- Timing Runner: (Unnamed Layer* 716) [Shuffle] + BoxPredictor_1/Reshape (Shuffle) [TRT] Tactic: 0 Time: 0.0070575 [TRT] Fastest Tactic: 0 Time: 0.0070575 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TRT] *************** Autotuning format combination: Half(28500,100:2,10,1) -> Half(1200,4:2,4,1) *************** [TRT] --------------- Timing Runner: (Unnamed Layer* 716) [Shuffle] + BoxPredictor_1/Reshape (Shuffle) [TRT] Tactic: 0 Time: 0.008099 [TRT] Fastest Tactic: 0 Time: 0.008099 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TRT] =============== Computing costs for [TRT] *************** Autotuning format combination: Float(14250,25,5,1) -> Float(600,4,4,1) *************** [TRT] --------------- Timing Runner: (Unnamed Layer* 725) [Shuffle] + BoxPredictor_2/Reshape (Shuffle) [TRT] Tactic: 0 Time: 0.005625 [TRT] Fastest Tactic: 0 Time: 0.005625 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TRT] *************** Autotuning format combination: Float(14250,1,2850,570) -> Float(600,1,600,150) *************** [TRT] --------------- Timing Runner: (Unnamed Layer* 725) [Shuffle] + BoxPredictor_2/Reshape (Shuffle) [TRT] Tactic: 0 Time: 0.0072915 [TRT] Fastest Tactic: 0 Time: 0.0072915 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TRT] *************** Autotuning format combination: Float(450,25:32,5,1) -> Float(20,4:32,4,1) *************** [TRT] --------------- Timing Runner: (Unnamed Layer* 725) [Shuffle] + BoxPredictor_2/Reshape (Shuffle) [TRT] Tactic: 0 Time: 0.005547 [TRT] Fastest Tactic: 0 Time: 0.005547 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TRT] *************** Autotuning format combination: Half(14250,25,5,1) -> Half(600,4,4,1) *************** [TRT] --------------- Timing Runner: (Unnamed Layer* 725) [Shuffle] + BoxPredictor_2/Reshape (Shuffle) [TRT] Tactic: 0 Time: 0.005599 [TRT] Fastest Tactic: 0 Time: 0.005599 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TRT] *************** Autotuning format combination: Half(7125,25:2,5,1) -> Half(300,4:2,4,1) *************** [TRT] --------------- Timing Runner: (Unnamed Layer* 725) [Shuffle] + BoxPredictor_2/Reshape (Shuffle) [TRT] Tactic: 0 Time: 0.005625 [TRT] Fastest Tactic: 0 Time: 0.005625 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TRT] =============== Computing costs for [TRT] *************** Autotuning format combination: Float(5130,9,3,1) -> Float(216,4,4,1) *************** [TRT] --------------- Timing Runner: (Unnamed Layer* 734) [Shuffle] + BoxPredictor_3/Reshape (Shuffle) [TRT] Tactic: 0 Time: 0.005703 [TRT] Fastest Tactic: 0 Time: 0.005703 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TRT] *************** Autotuning format combination: Float(5130,1,1710,570) -> Float(216,1,216,54) *************** [TRT] --------------- Timing Runner: (Unnamed Layer* 734) [Shuffle] + BoxPredictor_3/Reshape (Shuffle) [TRT] Tactic: 0 Time: 0.005703 [TRT] Fastest Tactic: 0 Time: 0.005703 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TRT] *************** Autotuning format combination: Float(162,9:32,3,1) -> Float(8,4:32,4,1) *************** [TRT] --------------- Timing Runner: (Unnamed Layer* 734) [Shuffle] + BoxPredictor_3/Reshape (Shuffle) [TRT] Tactic: 0 Time: 0.005703 [TRT] Fastest Tactic: 0 Time: 0.005703 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TRT] *************** Autotuning format combination: Half(5130,9,3,1) -> Half(216,4,4,1) *************** [TRT] --------------- Timing Runner: (Unnamed Layer* 734) [Shuffle] + BoxPredictor_3/Reshape (Shuffle) [TRT] Tactic: 0 Time: 0.005625 [TRT] Fastest Tactic: 0 Time: 0.005625 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TRT] *************** Autotuning format combination: Half(2565,9:2,3,1) -> Half(108,4:2,4,1) *************** [TRT] --------------- Timing Runner: (Unnamed Layer* 734) [Shuffle] + BoxPredictor_3/Reshape (Shuffle) [TRT] Tactic: 0 Time: 0.0056505 [TRT] Fastest Tactic: 0 Time: 0.0056505 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TRT] =============== Computing costs for [TRT] *************** Autotuning format combination: Float(2280,4,2,1) -> Float(96,4,4,1) *************** [TRT] --------------- Timing Runner: (Unnamed Layer* 743) [Shuffle] + BoxPredictor_4/Reshape (Shuffle) [TRT] Tactic: 0 Time: 0.005573 [TRT] Fastest Tactic: 0 Time: 0.005573 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TRT] *************** Autotuning format combination: Float(2280,1,1140,570) -> Float(96,1,96,24) *************** [TRT] --------------- Timing Runner: (Unnamed Layer* 743) [Shuffle] + BoxPredictor_4/Reshape (Shuffle) [TRT] Tactic: 0 Time: 0.004688 [TRT] Fastest Tactic: 0 Time: 0.004688 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TRT] *************** Autotuning format combination: Float(72,4:32,2,1) -> Float(4,4:32,4,1) *************** [TRT] --------------- Timing Runner: (Unnamed Layer* 743) [Shuffle] + BoxPredictor_4/Reshape (Shuffle) [TRT] Tactic: 0 Time: 0.005677 [TRT] Fastest Tactic: 0 Time: 0.005677 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TRT] *************** Autotuning format combination: Half(2280,4,2,1) -> Half(96,4,4,1) *************** [TRT] --------------- Timing Runner: (Unnamed Layer* 743) [Shuffle] + BoxPredictor_4/Reshape (Shuffle) [TRT] Tactic: 0 Time: 0.0045575 [TRT] Fastest Tactic: 0 Time: 0.0045575 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TRT] *************** Autotuning format combination: Half(1140,4:2,2,1) -> Half(48,4:2,4,1) *************** [TRT] --------------- Timing Runner: (Unnamed Layer* 743) [Shuffle] + BoxPredictor_4/Reshape (Shuffle) [TRT] Tactic: 0 Time: 0.005573 [TRT] Fastest Tactic: 0 Time: 0.005573 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TRT] =============== Computing costs for [TRT] *************** Autotuning format combination: Float(570,1,1,1) -> Float(24,4,4,1) *************** [TRT] --------------- Timing Runner: (Unnamed Layer* 752) [Shuffle] + BoxPredictor_5/Reshape (Shuffle) [TRT] Tactic: 0 Time: 0.005703 [TRT] Fastest Tactic: 0 Time: 0.005703 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TRT] *************** Autotuning format combination: Float(570,1,570,570) -> Float(24,1,24,6) *************** [TRT] --------------- Timing Runner: (Unnamed Layer* 752) [Shuffle] + BoxPredictor_5/Reshape (Shuffle) [TRT] Tactic: 0 Time: 0.005651 [TRT] Fastest Tactic: 0 Time: 0.005651 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TRT] *************** Autotuning format combination: Float(18,1:32,1,1) -> Float(4,4:32,4,1) *************** [TRT] --------------- Timing Runner: (Unnamed Layer* 752) [Shuffle] + BoxPredictor_5/Reshape (Shuffle) [TRT] Tactic: 0 Time: 0.005729 [TRT] Fastest Tactic: 0 Time: 0.005729 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TRT] *************** Autotuning format combination: Half(570,1,1,1) -> Half(24,4,4,1) *************** [TRT] --------------- Timing Runner: (Unnamed Layer* 752) [Shuffle] + BoxPredictor_5/Reshape (Shuffle) [TRT] Tactic: 0 Time: 0.0045315 [TRT] Fastest Tactic: 0 Time: 0.0045315 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TRT] *************** Autotuning format combination: Half(285,1:2,1,1) -> Half(12,4:2,4,1) *************** [TRT] --------------- Timing Runner: (Unnamed Layer* 752) [Shuffle] + BoxPredictor_5/Reshape (Shuffle) [TRT] Tactic: 0 Time: 0.0046615 [TRT] Fastest Tactic: 0 Time: 0.0046615 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: Shuffle Tactic: 0 [TRT] =============== Computing costs for [TRT] *************** Autotuning format combination: Float(4332,4,4,1), Float(2400,4,4,1), Float(600,4,4,1), Float(216,4,4,1), Float(96,4,4,1), Float(24,4,4,1) -> Float(7668,1,1,1) *************** [TRT] =============== Computing costs for [TRT] *************** Autotuning format combination: -> Float(2,1) *************** [TRT] *************** Autotuning format combination: -> Half(2,1) *************** [TRT] =============== Computing costs for [TRT] *************** Autotuning format combination: Float(2,1) -> Float(8664,4332,1,1), Float(4800,2400,1,1), Float(1200,600,1,1), Float(432,216,1,1), Float(192,96,1,1), Float(48,24,1,1) *************** [TRT] =============== Computing costs for [TRT] *************** Autotuning format combination: Float(174447,1,1,1), Float(7668,1,1,1), Float(15336,7668,1,1) -> Float(700,700,7,1), Float(1,1,1,1) *************** [TRT] --------------- Timing Runner: NMS (PluginV2) [TRT] Tactic: 0 Time: 11.7916 [TRT] Fastest Tactic: 0 Time: 11.7916 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PluginV2 Tactic: 0 [TRT] *************** Autotuning format combination: Half(174447,1,1,1), Half(7668,1,1,1), Half(15336,7668,1,1) -> Half(700,700,7,1), Float(1,1,1,1) *************** [TRT] --------------- Timing Runner: NMS (PluginV2) [TRT] Tactic: 0 Time: 8.56583 [TRT] Fastest Tactic: 0 Time: 8.56583 [TRT] >>>>>>>>>>>>>>> Chose Runner Type: PluginV2 Tactic: 0 [TRT] Adding reformat layer: Reformatted Input Tensor 0 to FeatureExtractor/MobilenetV2/expanded_conv_13/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_13/expand/Relu6) (FeatureExtractor/MobilenetV2/expanded_conv_12/add) from Float(34656,361,19,1) to Half(17328,361:2,19,1) [TRT] Adding reformat layer: Reformatted Output Tensor 0 to BoxPredictor_0/BoxEncodingPredictor/Conv2D || BoxPredictor_0/ClassPredictor/Conv2D (BoxPredictor_0/BoxEncodingPredictor/Conv2D || BoxPredictor_0/ClassPredictor/Conv2D) from Half(51623,361:2,19,1) to Float(102885,361,19,1) [TRT] Adding reformat layer: Reformatted Input Tensor 0 to FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/Relu6) (FeatureExtractor/MobilenetV2/expanded_conv_13/expand/Relu6) from Half(103968,361:2,19,1) to Half(207936,361,19,1) [TRT] Adding reformat layer: Reformatted Input Tensor 0 to FeatureExtractor/MobilenetV2/expanded_conv_13/project/Conv2D (FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/Relu6) from Half(57600,100,10,1) to Half(28800,100:2,10,1) [TRT] Adding reformat layer: Reformatted Input Tensor 0 to FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/Relu6) (FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Relu6) from Half(48000,100:2,10,1) to Half(96000,100,10,1) [TRT] Adding reformat layer: Reformatted Input Tensor 0 to FeatureExtractor/MobilenetV2/expanded_conv_14/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_14/add (FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/Relu6) from Half(96000,100,10,1) to Half(48000,100:2,10,1) [TRT] Adding reformat layer: Reformatted Input Tensor 0 to FeatureExtractor/MobilenetV2/expanded_conv_15/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_15/depthwise/Relu6) (FeatureExtractor/MobilenetV2/expanded_conv_15/expand/Relu6) from Half(48000,100:2,10,1) to Half(96000,100,10,1) [TRT] Adding reformat layer: Reformatted Input Tensor 0 to FeatureExtractor/MobilenetV2/expanded_conv_15/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_15/add (FeatureExtractor/MobilenetV2/expanded_conv_15/depthwise/Relu6) from Half(96000,100,10,1) to Half(48000,100:2,10,1) [TRT] Adding reformat layer: Reformatted Input Tensor 0 to FeatureExtractor/MobilenetV2/expanded_conv_16/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_16/depthwise/Relu6) (FeatureExtractor/MobilenetV2/expanded_conv_16/expand/Relu6) from Half(48000,100:2,10,1) to Half(96000,100,10,1) [TRT] Adding reformat layer: Reformatted Input Tensor 0 to FeatureExtractor/MobilenetV2/expanded_conv_16/project/Conv2D (FeatureExtractor/MobilenetV2/expanded_conv_16/depthwise/Relu6) from Half(96000,100,10,1) to Half(48000,100:2,10,1) [TRT] Adding reformat layer: Reformatted Output Tensor 0 to BoxPredictor_1/BoxEncodingPredictor/Conv2D || BoxPredictor_1/ClassPredictor/Conv2D (BoxPredictor_1/BoxEncodingPredictor/Conv2D || BoxPredictor_1/ClassPredictor/Conv2D) from Half(28500,100:2,10,1) to Float(57000,100,10,1) [TRT] Adding reformat layer: Reformatted Input Tensor 0 to FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/Relu6) (FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Relu6) from Half(12800,100:2,10,1) to Float(25600,100,10,1) [TRT] Adding reformat layer: Reformatted Input Tensor 0 to FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Relu6) (FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/Relu6) from Float(6400,25,5,1) to Half(3200,25:2,5,1) [TRT] Adding reformat layer: Reformatted Output Tensor 0 to BoxPredictor_2/BoxEncodingPredictor/Conv2D || BoxPredictor_2/ClassPredictor/Conv2D (BoxPredictor_2/BoxEncodingPredictor/Conv2D || BoxPredictor_2/ClassPredictor/Conv2D) from Half(7125,25:2,5,1) to Float(14250,25,5,1) [TRT] Adding reformat layer: Reformatted Input Tensor 0 to FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/Relu6) (FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Relu6) from Half(1600,25:2,5,1) to Half(3200,25,5,1) [TRT] Adding reformat layer: Reformatted Input Tensor 0 to FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Relu6) (FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/Relu6) from Half(1152,9,3,1) to Half(576,9:2,3,1) [TRT] Adding reformat layer: Reformatted Output Tensor 0 to BoxPredictor_3/BoxEncodingPredictor/Conv2D || BoxPredictor_3/ClassPredictor/Conv2D (BoxPredictor_3/BoxEncodingPredictor/Conv2D || BoxPredictor_3/ClassPredictor/Conv2D) from Half(2565,9:2,3,1) to Float(5130,9,3,1) [TRT] Adding reformat layer: Reformatted Input Tensor 0 to FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/Relu6) (FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Relu6) from Half(576,9:2,3,1) to Half(1152,9,3,1) [TRT] Adding reformat layer: Reformatted Input Tensor 0 to FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Relu6) (FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/Relu6) from Half(512,4,2,1) to Half(256,4:2,2,1) [TRT] Adding reformat layer: Reformatted Output Tensor 0 to BoxPredictor_4/BoxEncodingPredictor/Conv2D || BoxPredictor_4/ClassPredictor/Conv2D (BoxPredictor_4/BoxEncodingPredictor/Conv2D || BoxPredictor_4/ClassPredictor/Conv2D) from Half(1140,4:2,2,1) to Float(2280,4,2,1) [TRT] Adding reformat layer: Reformatted Input Tensor 0 to FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/Relu6) (FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Relu6) from Half(128,4:2,2,1) to Half(256,4,2,1) [TRT] Adding reformat layer: Reformatted Input Tensor 0 to FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Relu6) (FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/Relu6) from Half(64,1,1,1) to Half(32,1:2,1,1) [TRT] Adding reformat layer: Reformatted Output Tensor 0 to BoxPredictor_5/BoxEncodingPredictor/Conv2D || BoxPredictor_5/ClassPredictor/Conv2D (BoxPredictor_5/BoxEncodingPredictor/Conv2D || BoxPredictor_5/ClassPredictor/Conv2D) from Half(285,1:2,1,1) to Float(570,1,1,1) [TRT] Adding reformat layer: Reformatted Output Tensor 0 to Squeeze (Squeeze) from Float(7668,1,1,1) to Half(7668,1,1,1) [TRT] Adding reformat layer: Reformatted Input Tensor 0 to GridAnchor (Const) from Float(2,1) to Float(2,1) [TRT] Adding reformat layer: Reformatted Input Tensor 0 to NMS (concat_box_conf) from Float(174447,1,1,1) to Half(174447,1,1,1) [TRT] Adding reformat layer: Reformatted Output Tensor 0 to NMS (NMS) from Half(700,700,7,1) to Float(700,700,7,1) [TRT] Formats and tactics selection completed in 266.198 seconds. [TRT] After reformat layers: 120 layers [TRT] Pre-optimized block assignment. [TRT] Block size 2880000 [TRT] Block size 2880000 [TRT] Block size 1440256 [TRT] Block size 8640000 [TRT] Block size 2160128 [TRT] Block size 540160 [TRT] Block size 3240448 [TRT] Block size 3240448 [TRT] Block size 540160 [TRT] Block size 3240448 [TRT] Block size 832000 [TRT] Block size 184832 [TRT] Block size 1108992 [TRT] Block size 1108992 [TRT] Block size 184832 [TRT] Block size 1108992 [TRT] Block size 1108992 [TRT] Block size 184832 [TRT] Block size 1108992 [TRT] Block size 277504 [TRT] Block size 92672 [TRT] Block size 554496 [TRT] Block size 554496 [TRT] Block size 92672 [TRT] Block size 554496 [TRT] Block size 554496 [TRT] Block size 92672 [TRT] Block size 554496 [TRT] Block size 554496 [TRT] Block size 92672 [TRT] Block size 554496 [TRT] Block size 554496 [TRT] Block size 138752 [TRT] Block size 832000 [TRT] Block size 832000 [TRT] Block size 138752 [TRT] Block size 832000 [TRT] Block size 832000 [TRT] Block size 138752 [TRT] Block size 416256 [TRT] Block size 394240 [TRT] Block size 115200 [TRT] Block size 32256 [TRT] Block size 192000 [TRT] Block size 192000 [TRT] Block size 32256 [TRT] Block size 192000 [TRT] Block size 192000 [TRT] Block size 32256 [TRT] Block size 192000 [TRT] Block size 192000 [TRT] Block size 64000 [TRT] Block size 256000 [TRT] Block size 218624 [TRT] Block size 51200 [TRT] Block size 25600 [TRT] Block size 25600 [TRT] Block size 54784 [TRT] Block size 6656 [TRT] Block size 2560 [TRT] Block size 4608 [TRT] Block size 19968 [TRT] Block size 2560 [TRT] Block size 1024 [TRT] Block size 2048 [TRT] Block size 9216 [TRT] Block size 512 [TRT] Block size 512 [TRT] Block size 512 [TRT] Block size 2560 [TRT] Block size 697856 [TRT] Block size 17408 [TRT] Block size 9728 [TRT] Block size 2560 [TRT] Block size 1024 [TRT] Block size 512 [TRT] Block size 512 [TRT] Block size 15360 [TRT] Block size 34816 [TRT] Block size 19456 [TRT] Block size 5120 [TRT] Block size 2048 [TRT] Block size 1024 [TRT] Block size 512 [TRT] Block size 30720 [TRT] Block size 411648 [TRT] Block size 228352 [TRT] Block size 57344 [TRT] Block size 20992 [TRT] Block size 9216 [TRT] Block size 2560 [TRT] Block size 69632 [TRT] Block size 206848 [TRT] Block size 416256 [TRT] Block size 115200 [TRT] Block size 192000 [TRT] Block size 192000 [TRT] Block size 192000 [TRT] Block size 192000 [TRT] Block size 192000 [TRT] Block size 192000 [TRT] Block size 114176 [TRT] Block size 102400 [TRT] Block size 12800 [TRT] Block size 28672 [TRT] Block size 6656 [TRT] Block size 2560 [TRT] Block size 10752 [TRT] Block size 2560 [TRT] Block size 1024 [TRT] Block size 4608 [TRT] Block size 512 [TRT] Block size 1 [TRT] Block size 1536 [TRT] Block size 30720 [TRT] Block size 512 [TRT] Block size 349184 [TRT] Block size 1536 [TRT] Block size 33554432 [TRT] Total Activation Memory: 85238273 [TRT] Detected 1 inputs and 2 output network tensors. [TRT] FeatureExtractor/MobilenetV2/Conv/Conv2D + PWN(FeatureExtractor/MobilenetV2/Conv/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_small_nn_v0 Tactic: 7144526460361122478 [TRT] FeatureExtractor/MobilenetV2/expanded_conv/project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 Tactic: 1698681053543049347 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_1/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_1/expand/Relu6) Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 Tactic: 1698681053543049347 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_1/project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 Tactic: 1698681053543049347 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_2/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_2/expand/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 Tactic: -37215280111360163 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_2/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_2/add Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v0 Tactic: 1698681053543049347 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_3/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_3/expand/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 Tactic: -37215280111360163 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_3/project/Conv2D Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 Tactic: -6576203419454146580 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_4/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_4/expand/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_4/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_4/add Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 Tactic: -6576203419454146580 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_5/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_5/expand/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_5/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_5/add Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 Tactic: -6576203419454146580 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_6/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_6/expand/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_medium_nn_v1 Tactic: 6645123197870846056 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_6/project/Conv2D Set Tactic Name: maxwell_scudnn_128x64_relu_small_nn_v1 Tactic: 5137655947464784826 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 Tactic: -37215280111360163 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_7/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_7/add Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 Tactic: -37215280111360163 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_8/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_8/expand/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 Tactic: -37215280111360163 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_8/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_8/add Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 Tactic: -37215280111360163 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_9/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_9/expand/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 Tactic: -37215280111360163 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_9/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_9/add Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 Tactic: -37215280111360163 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_10/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_10/expand/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 Tactic: -37215280111360163 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_10/project/Conv2D Set Tactic Name: maxwell_scudnn_128x128_relu_interior_nn_v1 Tactic: 5326823351883942011 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 Tactic: -37215280111360163 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_11/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_11/add Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 Tactic: -6576203419454146580 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_12/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_12/expand/Relu6) Set Tactic Name: maxwell_scudnn_128x64_relu_interior_nn_v1 Tactic: -37215280111360163 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_12/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_12/add Set Tactic Name: maxwell_scudnn_128x32_relu_interior_nn_v1 Tactic: -6576203419454146580 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_13/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_13/expand/Relu6) Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: -2409163523992614473 [TRT] BoxPredictor_0/BoxEncodingPredictor/Conv2D || BoxPredictor_0/ClassPredictor/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_small_nn_v1 Tactic: -2409163523992614473 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_13/project/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 8163473458334948789 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Relu6) Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 8163473458334948789 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_14/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_14/add Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 8163473458334948789 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_15/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_15/expand/Relu6) Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 8163473458334948789 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_15/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_15/add Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 8163473458334948789 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_16/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_16/expand/Relu6) Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 8163473458334948789 [TRT] FeatureExtractor/MobilenetV2/expanded_conv_16/project/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x64_relu_interior_nn_v1 Tactic: 8163473458334948789 [TRT] FeatureExtractor/MobilenetV2/Conv_1/Conv2D + PWN(FeatureExtractor/MobilenetV2/Conv_1/Relu6) Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: -1716393687483585322 [TRT] BoxPredictor_1/BoxEncodingPredictor/Conv2D || BoxPredictor_1/ClassPredictor/Conv2D Set Tactic Name: maxwell_fp16x2_hcudnn_winograd_fp16x2_128x128_ldg1_ldg4_relu_tile148m_nt_v1 Tactic: 4772821744921268633 [TRT] FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Relu6) Set Tactic Name: maxwell_fp16x2_hcudnn_fp16x2_128x128_relu_interior_nn_v1 Tactic: -1716393687483585322 [TRT] Layer: FeatureExtractor/MobilenetV2/Conv/Conv2D + PWN(FeatureExtractor/MobilenetV2/Conv/Relu6) Host Persistent: 1664 Device Persistent: 138752 Scratch Memory: 0 [TRT] Layer: FeatureExtractor/MobilenetV2/expanded_conv/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv/depthwise/Relu6) Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [TRT] Layer: FeatureExtractor/MobilenetV2/expanded_conv/project/Conv2D Host Persistent: 3200 Device Persistent: 137216 Scratch Memory: 0 [TRT] Layer: FeatureExtractor/MobilenetV2/expanded_conv_1/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_1/expand/Relu6) Host Persistent: 3200 Device Persistent: 141824 Scratch Memory: 0 [TRT] Layer: FeatureExtractor/MobilenetV2/expanded_conv_1/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_1/depthwise/Relu6) Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [TRT] Layer: FeatureExtractor/MobilenetV2/expanded_conv_1/project/Conv2D Host Persistent: 3200 Device Persistent: 43520 Scratch Memory: 0 [TRT] Layer: FeatureExtractor/MobilenetV2/expanded_conv_2/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_2/expand/Relu6) Host Persistent: 3200 Device Persistent: 48640 Scratch Memory: 0 [TRT] Layer: FeatureExtractor/MobilenetV2/expanded_conv_2/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_2/depthwise/Relu6) Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [TRT] Layer: FeatureExtractor/MobilenetV2/expanded_conv_2/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_2/add Host Persistent: 3200 Device Persistent: 48128 Scratch Memory: 0 [TRT] Layer: FeatureExtractor/MobilenetV2/expanded_conv_3/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_3/expand/Relu6) Host Persistent: 3200 Device Persistent: 48640 Scratch Memory: 0 [TRT] Layer: FeatureExtractor/MobilenetV2/expanded_conv_3/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_3/depthwise/Relu6) Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [TRT] Layer: FeatureExtractor/MobilenetV2/expanded_conv_3/project/Conv2D Host Persistent: 3200 Device Persistent: 27648 Scratch Memory: 0 [TRT] Layer: FeatureExtractor/MobilenetV2/expanded_conv_4/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_4/expand/Relu6) Host Persistent: 2176 Device Persistent: 34304 Scratch Memory: 0 [TRT] Layer: FeatureExtractor/MobilenetV2/expanded_conv_4/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_4/depthwise/Relu6) Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [TRT] Layer: FeatureExtractor/MobilenetV2/expanded_conv_4/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_4/add Host Persistent: 3200 Device Persistent: 33792 Scratch Memory: 0 [TRT] Layer: FeatureExtractor/MobilenetV2/expanded_conv_5/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_5/expand/Relu6) Host Persistent: 2176 Device Persistent: 34304 Scratch Memory: 0 [TRT] Layer: FeatureExtractor/MobilenetV2/expanded_conv_5/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_5/depthwise/Relu6) Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [TRT] Layer: FeatureExtractor/MobilenetV2/expanded_conv_5/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_5/add Host Persistent: 3200 Device Persistent: 33792 Scratch Memory: 0 [TRT] Layer: FeatureExtractor/MobilenetV2/expanded_conv_6/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_6/expand/Relu6) Host Persistent: 2176 Device Persistent: 34304 Scratch Memory: 0 [TRT] Layer: FeatureExtractor/MobilenetV2/expanded_conv_6/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_6/depthwise/Relu6) Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [TRT] Layer: FeatureExtractor/MobilenetV2/expanded_conv_6/project/Conv2D Host Persistent: 1664 Device Persistent: 51712 Scratch Memory: 0 [TRT] Layer: FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Relu6) Host Persistent: 3200 Device Persistent: 102400 Scratch Memory: 0 [TRT] Layer: FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/Relu6) Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [TRT] Layer: FeatureExtractor/MobilenetV2/expanded_conv_7/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_7/add Host Persistent: 3200 Device Persistent: 100864 Scratch Memory: 0 [TRT] Layer: FeatureExtractor/MobilenetV2/expanded_conv_8/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_8/expand/Relu6) Host Persistent: 3200 Device Persistent: 102400 Scratch Memory: 0 [TRT] Layer: FeatureExtractor/MobilenetV2/expanded_conv_8/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_8/depthwise/Relu6) Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [TRT] Layer: FeatureExtractor/MobilenetV2/expanded_conv_8/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_8/add Host Persistent: 3200 Device Persistent: 100864 Scratch Memory: 0 [TRT] Layer: FeatureExtractor/MobilenetV2/expanded_conv_9/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_9/expand/Relu6) Host Persistent: 3200 Device Persistent: 102400 Scratch Memory: 0 [TRT] Layer: FeatureExtractor/MobilenetV2/expanded_conv_9/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_9/depthwise/Relu6) Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [TRT] Layer: FeatureExtractor/MobilenetV2/expanded_conv_9/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_9/add Host Persistent: 3200 Device Persistent: 100864 Scratch Memory: 0 [TRT] Layer: FeatureExtractor/MobilenetV2/expanded_conv_10/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_10/expand/Relu6) Host Persistent: 3200 Device Persistent: 102400 Scratch Memory: 0 [TRT] Layer: FeatureExtractor/MobilenetV2/expanded_conv_10/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_10/depthwise/Relu6) Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [TRT] Layer: FeatureExtractor/MobilenetV2/expanded_conv_10/project/Conv2D Host Persistent: 3200 Device Persistent: 150528 Scratch Memory: 0 [TRT] Layer: FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Relu6) Host Persistent: 3200 Device Persistent: 225792 Scratch Memory: 0 [TRT] Layer: FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/Relu6) Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [TRT] Layer: FeatureExtractor/MobilenetV2/expanded_conv_11/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_11/add Host Persistent: 3200 Device Persistent: 223744 Scratch Memory: 0 [TRT] Layer: FeatureExtractor/MobilenetV2/expanded_conv_12/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_12/expand/Relu6) Host Persistent: 3200 Device Persistent: 225792 Scratch Memory: 0 [TRT] Layer: FeatureExtractor/MobilenetV2/expanded_conv_12/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_12/depthwise/Relu6) Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [TRT] Layer: FeatureExtractor/MobilenetV2/expanded_conv_12/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_12/add Host Persistent: 3200 Device Persistent: 223744 Scratch Memory: 0 [TRT] Layer: Reformatting CopyNode for Input Tensor 0 to FeatureExtractor/MobilenetV2/expanded_conv_13/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_13/expand/Relu6) Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [TRT] Layer: FeatureExtractor/MobilenetV2/expanded_conv_13/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_13/expand/Relu6) Host Persistent: 1664 Device Persistent: 114176 Scratch Memory: 0 [TRT] Layer: BoxPredictor_0/BoxEncodingPredictor/Conv2D || BoxPredictor_0/ClassPredictor/Conv2D Host Persistent: 1664 Device Persistent: 2968064 Scratch Memory: 0 [TRT] Layer: Reformatting CopyNode for Output Tensor 0 to BoxPredictor_0/BoxEncodingPredictor/Conv2D || BoxPredictor_0/ClassPredictor/Conv2D Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [TRT] Layer: (Unnamed Layer* 404) [Shuffle] + BoxPredictor_0/Reshape_1 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [TRT] Layer: Reformatting CopyNode for Input Tensor 0 to FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/Relu6) Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [TRT] Layer: FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/Relu6) Host Persistent: 32 Device Persistent: 0 Scratch Memory: 0 [TRT] Layer: Reformatting CopyNode for Input Tensor 0 to FeatureExtractor/MobilenetV2/expanded_conv_13/project/Conv2D Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [TRT] Layer: FeatureExtractor/MobilenetV2/expanded_conv_13/project/Conv2D Host Persistent: 3200 Device Persistent: 185344 Scratch Memory: 0 [TRT] Layer: FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Relu6) Host Persistent: 3200 Device Persistent: 309760 Scratch Memory: 0 [TRT] Layer: Reformatting CopyNode for Input Tensor 0 to FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/Relu6) Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [TRT] Layer: FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/Relu6) Host Persistent: 32 Device Persistent: 0 Scratch Memory: 0 [TRT] Layer: Reformatting CopyNode for Input Tensor 0 to FeatureExtractor/MobilenetV2/expanded_conv_14/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_14/add Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [TRT] Layer: FeatureExtractor/MobilenetV2/expanded_conv_14/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_14/add Host Persistent: 3200 Device Persistent: 308224 Scratch Memory: 0 [TRT] Layer: FeatureExtractor/MobilenetV2/expanded_conv_15/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_15/expand/Relu6) Host Persistent: 3200 Device Persistent: 309760 Scratch Memory: 0 [TRT] Layer: Reformatting CopyNode for Input Tensor 0 to FeatureExtractor/MobilenetV2/expanded_conv_15/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_15/depthwise/Relu6) Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [TRT] Layer: FeatureExtractor/MobilenetV2/expanded_conv_15/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_15/depthwise/Relu6) Host Persistent: 32 Device Persistent: 0 Scratch Memory: 0 [TRT] Layer: Reformatting CopyNode for Input Tensor 0 to FeatureExtractor/MobilenetV2/expanded_conv_15/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_15/add Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [TRT] Layer: FeatureExtractor/MobilenetV2/expanded_conv_15/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_15/add Host Persistent: 3200 Device Persistent: 308224 Scratch Memory: 0 [TRT] Layer: FeatureExtractor/MobilenetV2/expanded_conv_16/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_16/expand/Relu6) Host Persistent: 3200 Device Persistent: 309760 Scratch Memory: 0 [TRT] Layer: Reformatting CopyNode for Input Tensor 0 to FeatureExtractor/MobilenetV2/expanded_conv_16/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_16/depthwise/Relu6) Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [TRT] Layer: FeatureExtractor/MobilenetV2/expanded_conv_16/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_16/depthwise/Relu6) Host Persistent: 32 Device Persistent: 0 Scratch Memory: 0 [TRT] Layer: Reformatting CopyNode for Input Tensor 0 to FeatureExtractor/MobilenetV2/expanded_conv_16/project/Conv2D Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [TRT] Layer: FeatureExtractor/MobilenetV2/expanded_conv_16/project/Conv2D Host Persistent: 3200 Device Persistent: 615936 Scratch Memory: 0 [TRT] Layer: FeatureExtractor/MobilenetV2/Conv_1/Conv2D + PWN(FeatureExtractor/MobilenetV2/Conv_1/Relu6) Host Persistent: 3200 Device Persistent: 822784 Scratch Memory: 0 [TRT] Layer: BoxPredictor_1/BoxEncodingPredictor/Conv2D || BoxPredictor_1/ClassPredictor/Conv2D Host Persistent: 512 Device Persistent: 36727296 Scratch Memory: 0 [TRT] Layer: Reformatting CopyNode for Output Tensor 0 to BoxPredictor_1/BoxEncodingPredictor/Conv2D || BoxPredictor_1/ClassPredictor/Conv2D Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [TRT] Layer: (Unnamed Layer* 533) [Shuffle] + BoxPredictor_1/Reshape_1 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [TRT] Layer: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Relu6) Host Persistent: 3200 Device Persistent: 656896 Scratch Memory: 0 [TRT] Layer: Reformatting CopyNode for Input Tensor 0 to FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/Relu6) Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [TRT] Layer: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/Relu6) Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [TRT] Layer: Reformatting CopyNode for Input Tensor 0 to FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Relu6) Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [TRT] Layer: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Relu6) Host Persistent: 2192 Device Persistent: 0 Scratch Memory: 0 [TRT] Layer: BoxPredictor_2/BoxEncodingPredictor/Conv2D || BoxPredictor_2/ClassPredictor/Conv2D Host Persistent: 2192 Device Persistent: 0 Scratch Memory: 0 [TRT] Layer: Reformatting CopyNode for Output Tensor 0 to BoxPredictor_2/BoxEncodingPredictor/Conv2D || BoxPredictor_2/ClassPredictor/Conv2D Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [TRT] Layer: (Unnamed Layer* 574) [Shuffle] + BoxPredictor_2/Reshape_1 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [TRT] Layer: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Relu6) Host Persistent: 2192 Device Persistent: 0 Scratch Memory: 0 [TRT] Layer: Reformatting CopyNode for Input Tensor 0 to FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/Relu6) Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [TRT] Layer: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/Relu6) Host Persistent: 32 Device Persistent: 0 Scratch Memory: 0 [TRT] Layer: Reformatting CopyNode for Input Tensor 0 to FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Relu6) Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [TRT] Layer: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Relu6) Host Persistent: 2192 Device Persistent: 0 Scratch Memory: 0 [TRT] Layer: BoxPredictor_3/BoxEncodingPredictor/Conv2D || BoxPredictor_3/ClassPredictor/Conv2D Host Persistent: 2192 Device Persistent: 0 Scratch Memory: 0 [TRT] Layer: Reformatting CopyNode for Output Tensor 0 to BoxPredictor_3/BoxEncodingPredictor/Conv2D || BoxPredictor_3/ClassPredictor/Conv2D Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [TRT] Layer: (Unnamed Layer* 615) [Shuffle] + BoxPredictor_3/Reshape_1 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [TRT] Layer: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Relu6) Host Persistent: 2192 Device Persistent: 0 Scratch Memory: 0 [TRT] Layer: Reformatting CopyNode for Input Tensor 0 to FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/Relu6) Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [TRT] Layer: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/Relu6) Host Persistent: 32 Device Persistent: 0 Scratch Memory: 0 [TRT] Layer: Reformatting CopyNode for Input Tensor 0 to FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Relu6) Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [TRT] Layer: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Relu6) Host Persistent: 2192 Device Persistent: 0 Scratch Memory: 0 [TRT] Layer: BoxPredictor_4/BoxEncodingPredictor/Conv2D || BoxPredictor_4/ClassPredictor/Conv2D Host Persistent: 2192 Device Persistent: 0 Scratch Memory: 0 [TRT] Layer: Reformatting CopyNode for Output Tensor 0 to BoxPredictor_4/BoxEncodingPredictor/Conv2D || BoxPredictor_4/ClassPredictor/Conv2D Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [TRT] Layer: (Unnamed Layer* 656) [Shuffle] + BoxPredictor_4/Reshape_1 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [TRT] Layer: FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Relu6) Host Persistent: 2192 Device Persistent: 0 Scratch Memory: 0 [TRT] Layer: Reformatting CopyNode for Input Tensor 0 to FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/Relu6) Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [TRT] Layer: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/Relu6) Host Persistent: 32 Device Persistent: 0 Scratch Memory: 1536 [TRT] Layer: Reformatting CopyNode for Input Tensor 0 to FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Relu6) Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [TRT] Layer: FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Relu6) Host Persistent: 2192 Device Persistent: 0 Scratch Memory: 0 [TRT] Layer: BoxPredictor_5/BoxEncodingPredictor/Conv2D || BoxPredictor_5/ClassPredictor/Conv2D Host Persistent: 2192 Device Persistent: 0 Scratch Memory: 0 [TRT] Layer: Reformatting CopyNode for Output Tensor 0 to BoxPredictor_5/BoxEncodingPredictor/Conv2D || BoxPredictor_5/ClassPredictor/Conv2D Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [TRT] Layer: (Unnamed Layer* 697) [Shuffle] + BoxPredictor_5/Reshape_1 Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [TRT] Layer: concat_box_conf Host Persistent: 56 Device Persistent: 0 Scratch Memory: 0 [TRT] Layer: (Unnamed Layer* 707) [Shuffle] + BoxPredictor_0/Reshape Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [TRT] Layer: (Unnamed Layer* 716) [Shuffle] + BoxPredictor_1/Reshape Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [TRT] Layer: (Unnamed Layer* 725) [Shuffle] + BoxPredictor_2/Reshape Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [TRT] Layer: (Unnamed Layer* 734) [Shuffle] + BoxPredictor_3/Reshape Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [TRT] Layer: (Unnamed Layer* 743) [Shuffle] + BoxPredictor_4/Reshape Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [TRT] Layer: (Unnamed Layer* 752) [Shuffle] + BoxPredictor_5/Reshape Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [TRT] Layer: Squeeze Host Persistent: 56 Device Persistent: 0 Scratch Memory: 0 [TRT] Layer: Reformatting CopyNode for Output Tensor 0 to Squeeze Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [TRT] Layer: Const Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [TRT] Layer: Reformatting CopyNode for Input Tensor 0 to GridAnchor Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [TRT] Layer: GridAnchor Host Persistent: 56 Device Persistent: 0 Scratch Memory: 0 [TRT] Layer: GridAnchor copy Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [TRT] Layer: GridAnchor_1 copy Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [TRT] Layer: GridAnchor_2 copy Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [TRT] Layer: GridAnchor_3 copy Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [TRT] Layer: GridAnchor_4 copy Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [TRT] Layer: GridAnchor_5 copy Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [TRT] Layer: Reformatting CopyNode for Input Tensor 0 to NMS Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [TRT] Layer: NMS Host Persistent: 40 Device Persistent: 0 Scratch Memory: 3578624 [TRT] Layer: Reformatting CopyNode for Output Tensor 0 to NMS Host Persistent: 0 Device Persistent: 0 Scratch Memory: 0 [TRT] Total Host Persistent Memory: 134272 [TRT] Total Device Persistent Memory: 46254592 [TRT] Total Scratch Memory: 3578624 [TRT] [MemUsageStats] Peak memory usage of TRT CPU/GPU memory allocators: CPU 96 MiB, GPU 129 MiB [TRT] [BlockAssignment] Algorithm ShiftNTopDown took 77.0802ms to assign 13 blocks to 120 nodes requiring 13360640 bytes. [TRT] Optimized block assignment. [TRT] Block size 8640000 [TRT] Block size 3240448 [TRT] Block size 540160 [TRT] Block size 540160 [TRT] Block size 218624 [TRT] Block size 57344 [TRT] Block size 54784 [TRT] Block size 25600 [TRT] Block size 19968 [TRT] Block size 9216 [TRT] Block size 9216 [TRT] Block size 2560 [TRT] Block size 2560 [TRT] Total Activation Memory: 13360640 [TRT] Using cublas as a tactic source [TRT] [MemUsageChange] Init cuBLAS/cuBLASLt: CPU +0, GPU +5, now: CPU 1182, GPU 1937 (MiB) [TRT] Using cuDNN as a tactic source [TRT] [MemUsageChange] Init cuDNN: CPU +1, GPU +2, now: CPU 1183, GPU 1939 (MiB) [TRT] Engine generation completed in 275.333 seconds. [TRT] Engine Layer Information: Layer(CaskConvolution): FeatureExtractor/MobilenetV2/Conv/Conv2D + PWN(FeatureExtractor/MobilenetV2/Conv/Relu6), Tactic: 7144526460361122478, Input[Float(-2,3,300,300)] -> FeatureExtractor/MobilenetV2/Conv/Relu6[Float(-2,32,150,150)] Layer(CudaDepthwiseConvolution): FeatureExtractor/MobilenetV2/expanded_conv/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv/depthwise/Relu6), Tactic: -1, FeatureExtractor/MobilenetV2/Conv/Relu6[Float(-2,32,150,150)] -> FeatureExtractor/MobilenetV2/expanded_conv/depthwise/Relu6[Float(-2,32,150,150)] Layer(CaskConvolution): FeatureExtractor/MobilenetV2/expanded_conv/project/Conv2D, Tactic: 1698681053543049347, FeatureExtractor/MobilenetV2/expanded_conv/depthwise/Relu6[Float(-2,32,150,150)] -> FeatureExtractor/MobilenetV2/expanded_conv/project/BatchNorm/batchnorm/add_1[Float(-2,16,150,150)] Layer(CaskConvolution): FeatureExtractor/MobilenetV2/expanded_conv_1/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_1/expand/Relu6), Tactic: 1698681053543049347, FeatureExtractor/MobilenetV2/expanded_conv/project/BatchNorm/batchnorm/add_1[Float(-2,16,150,150)] -> FeatureExtractor/MobilenetV2/expanded_conv_1/expand/Relu6[Float(-2,96,150,150)] Layer(CudaDepthwiseConvolution): FeatureExtractor/MobilenetV2/expanded_conv_1/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_1/depthwise/Relu6), Tactic: -1, FeatureExtractor/MobilenetV2/expanded_conv_1/expand/Relu6[Float(-2,96,150,150)] -> FeatureExtractor/MobilenetV2/expanded_conv_1/depthwise/Relu6[Float(-2,96,75,75)] Layer(CaskConvolution): FeatureExtractor/MobilenetV2/expanded_conv_1/project/Conv2D, Tactic: 1698681053543049347, FeatureExtractor/MobilenetV2/expanded_conv_1/depthwise/Relu6[Float(-2,96,75,75)] -> FeatureExtractor/MobilenetV2/expanded_conv_1/project/BatchNorm/batchnorm/add_1[Float(-2,24,75,75)] Layer(CaskConvolution): FeatureExtractor/MobilenetV2/expanded_conv_2/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_2/expand/Relu6), Tactic: -37215280111360163, FeatureExtractor/MobilenetV2/expanded_conv_1/project/BatchNorm/batchnorm/add_1[Float(-2,24,75,75)] -> FeatureExtractor/MobilenetV2/expanded_conv_2/expand/Relu6[Float(-2,144,75,75)] Layer(CudaDepthwiseConvolution): FeatureExtractor/MobilenetV2/expanded_conv_2/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_2/depthwise/Relu6), Tactic: -1, FeatureExtractor/MobilenetV2/expanded_conv_2/expand/Relu6[Float(-2,144,75,75)] -> FeatureExtractor/MobilenetV2/expanded_conv_2/depthwise/Relu6[Float(-2,144,75,75)] Layer(CaskConvolution): FeatureExtractor/MobilenetV2/expanded_conv_2/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_2/add, Tactic: 1698681053543049347, FeatureExtractor/MobilenetV2/expanded_conv_2/depthwise/Relu6[Float(-2,144,75,75)], FeatureExtractor/MobilenetV2/expanded_conv_1/project/BatchNorm/batchnorm/add_1[Float(-2,24,75,75)] -> FeatureExtractor/MobilenetV2/expanded_conv_2/add[Float(-2,24,75,75)] Layer(CaskConvolution): FeatureExtractor/MobilenetV2/expanded_conv_3/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_3/expand/Relu6), Tactic: -37215280111360163, FeatureExtractor/MobilenetV2/expanded_conv_2/add[Float(-2,24,75,75)] -> FeatureExtractor/MobilenetV2/expanded_conv_3/expand/Relu6[Float(-2,144,75,75)] Layer(CudaDepthwiseConvolution): FeatureExtractor/MobilenetV2/expanded_conv_3/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_3/depthwise/Relu6), Tactic: -1, FeatureExtractor/MobilenetV2/expanded_conv_3/expand/Relu6[Float(-2,144,75,75)] -> FeatureExtractor/MobilenetV2/expanded_conv_3/depthwise/Relu6[Float(-2,144,38,38)] Layer(CaskConvolution): FeatureExtractor/MobilenetV2/expanded_conv_3/project/Conv2D, Tactic: -6576203419454146580, FeatureExtractor/MobilenetV2/expanded_conv_3/depthwise/Relu6[Float(-2,144,38,38)] -> FeatureExtractor/MobilenetV2/expanded_conv_3/project/BatchNorm/batchnorm/add_1[Float(-2,32,38,38)] Layer(CaskConvolution): FeatureExtractor/MobilenetV2/expanded_conv_4/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_4/expand/Relu6), Tactic: 6645123197870846056, FeatureExtractor/MobilenetV2/expanded_conv_3/project/BatchNorm/batchnorm/add_1[Float(-2,32,38,38)] -> FeatureExtractor/MobilenetV2/expanded_conv_4/expand/Relu6[Float(-2,192,38,38)] Layer(CudaDepthwiseConvolution): FeatureExtractor/MobilenetV2/expanded_conv_4/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_4/depthwise/Relu6), Tactic: -1, FeatureExtractor/MobilenetV2/expanded_conv_4/expand/Relu6[Float(-2,192,38,38)] -> FeatureExtractor/MobilenetV2/expanded_conv_4/depthwise/Relu6[Float(-2,192,38,38)] Layer(CaskConvolution): FeatureExtractor/MobilenetV2/expanded_conv_4/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_4/add, Tactic: -6576203419454146580, FeatureExtractor/MobilenetV2/expanded_conv_4/depthwise/Relu6[Float(-2,192,38,38)], FeatureExtractor/MobilenetV2/expanded_conv_3/project/BatchNorm/batchnorm/add_1[Float(-2,32,38,38)] -> FeatureExtractor/MobilenetV2/expanded_conv_4/add[Float(-2,32,38,38)] Layer(CaskConvolution): FeatureExtractor/MobilenetV2/expanded_conv_5/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_5/expand/Relu6), Tactic: 6645123197870846056, FeatureExtractor/MobilenetV2/expanded_conv_4/add[Float(-2,32,38,38)] -> FeatureExtractor/MobilenetV2/expanded_conv_5/expand/Relu6[Float(-2,192,38,38)] Layer(CudaDepthwiseConvolution): FeatureExtractor/MobilenetV2/expanded_conv_5/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_5/depthwise/Relu6), Tactic: -1, FeatureExtractor/MobilenetV2/expanded_conv_5/expand/Relu6[Float(-2,192,38,38)] -> FeatureExtractor/MobilenetV2/expanded_conv_5/depthwise/Relu6[Float(-2,192,38,38)] Layer(CaskConvolution): FeatureExtractor/MobilenetV2/expanded_conv_5/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_5/add, Tactic: -6576203419454146580, FeatureExtractor/MobilenetV2/expanded_conv_5/depthwise/Relu6[Float(-2,192,38,38)], FeatureExtractor/MobilenetV2/expanded_conv_4/add[Float(-2,32,38,38)] -> FeatureExtractor/MobilenetV2/expanded_conv_5/add[Float(-2,32,38,38)] Layer(CaskConvolution): FeatureExtractor/MobilenetV2/expanded_conv_6/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_6/expand/Relu6), Tactic: 6645123197870846056, FeatureExtractor/MobilenetV2/expanded_conv_5/add[Float(-2,32,38,38)] -> FeatureExtractor/MobilenetV2/expanded_conv_6/expand/Relu6[Float(-2,192,38,38)] Layer(CudaDepthwiseConvolution): FeatureExtractor/MobilenetV2/expanded_conv_6/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_6/depthwise/Relu6), Tactic: -1, FeatureExtractor/MobilenetV2/expanded_conv_6/expand/Relu6[Float(-2,192,38,38)] -> FeatureExtractor/MobilenetV2/expanded_conv_6/depthwise/Relu6[Float(-2,192,19,19)] Layer(CaskConvolution): FeatureExtractor/MobilenetV2/expanded_conv_6/project/Conv2D, Tactic: 5137655947464784826, FeatureExtractor/MobilenetV2/expanded_conv_6/depthwise/Relu6[Float(-2,192,19,19)] -> FeatureExtractor/MobilenetV2/expanded_conv_6/project/BatchNorm/batchnorm/add_1[Float(-2,64,19,19)] Layer(CaskConvolution): FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Relu6), Tactic: -37215280111360163, FeatureExtractor/MobilenetV2/expanded_conv_6/project/BatchNorm/batchnorm/add_1[Float(-2,64,19,19)] -> FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Relu6[Float(-2,384,19,19)] Layer(CudaDepthwiseConvolution): FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/Relu6), Tactic: -1, FeatureExtractor/MobilenetV2/expanded_conv_7/expand/Relu6[Float(-2,384,19,19)] -> FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/Relu6[Float(-2,384,19,19)] Layer(CaskConvolution): FeatureExtractor/MobilenetV2/expanded_conv_7/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_7/add, Tactic: -37215280111360163, FeatureExtractor/MobilenetV2/expanded_conv_7/depthwise/Relu6[Float(-2,384,19,19)], FeatureExtractor/MobilenetV2/expanded_conv_6/project/BatchNorm/batchnorm/add_1[Float(-2,64,19,19)] -> FeatureExtractor/MobilenetV2/expanded_conv_7/add[Float(-2,64,19,19)] Layer(CaskConvolution): FeatureExtractor/MobilenetV2/expanded_conv_8/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_8/expand/Relu6), Tactic: -37215280111360163, FeatureExtractor/MobilenetV2/expanded_conv_7/add[Float(-2,64,19,19)] -> FeatureExtractor/MobilenetV2/expanded_conv_8/expand/Relu6[Float(-2,384,19,19)] Layer(CudaDepthwiseConvolution): FeatureExtractor/MobilenetV2/expanded_conv_8/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_8/depthwise/Relu6), Tactic: -1, FeatureExtractor/MobilenetV2/expanded_conv_8/expand/Relu6[Float(-2,384,19,19)] -> FeatureExtractor/MobilenetV2/expanded_conv_8/depthwise/Relu6[Float(-2,384,19,19)] Layer(CaskConvolution): FeatureExtractor/MobilenetV2/expanded_conv_8/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_8/add, Tactic: -37215280111360163, FeatureExtractor/MobilenetV2/expanded_conv_8/depthwise/Relu6[Float(-2,384,19,19)], FeatureExtractor/MobilenetV2/expanded_conv_7/add[Float(-2,64,19,19)] -> FeatureExtractor/MobilenetV2/expanded_conv_8/add[Float(-2,64,19,19)] Layer(CaskConvolution): FeatureExtractor/MobilenetV2/expanded_conv_9/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_9/expand/Relu6), Tactic: -37215280111360163, FeatureExtractor/MobilenetV2/expanded_conv_8/add[Float(-2,64,19,19)] -> FeatureExtractor/MobilenetV2/expanded_conv_9/expand/Relu6[Float(-2,384,19,19)] Layer(CudaDepthwiseConvolution): FeatureExtractor/MobilenetV2/expanded_conv_9/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_9/depthwise/Relu6), Tactic: -1, FeatureExtractor/MobilenetV2/expanded_conv_9/expand/Relu6[Float(-2,384,19,19)] -> FeatureExtractor/MobilenetV2/expanded_conv_9/depthwise/Relu6[Float(-2,384,19,19)] Layer(CaskConvolution): FeatureExtractor/MobilenetV2/expanded_conv_9/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_9/add, Tactic: -37215280111360163, FeatureExtractor/MobilenetV2/expanded_conv_9/depthwise/Relu6[Float(-2,384,19,19)], FeatureExtractor/MobilenetV2/expanded_conv_8/add[Float(-2,64,19,19)] -> FeatureExtractor/MobilenetV2/expanded_conv_9/add[Float(-2,64,19,19)] Layer(CaskConvolution): FeatureExtractor/MobilenetV2/expanded_conv_10/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_10/expand/Relu6), Tactic: -37215280111360163, FeatureExtractor/MobilenetV2/expanded_conv_9/add[Float(-2,64,19,19)] -> FeatureExtractor/MobilenetV2/expanded_conv_10/expand/Relu6[Float(-2,384,19,19)] Layer(CudaDepthwiseConvolution): FeatureExtractor/MobilenetV2/expanded_conv_10/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_10/depthwise/Relu6), Tactic: -1, FeatureExtractor/MobilenetV2/expanded_conv_10/expand/Relu6[Float(-2,384,19,19)] -> FeatureExtractor/MobilenetV2/expanded_conv_10/depthwise/Relu6[Float(-2,384,19,19)] Layer(CaskConvolution): FeatureExtractor/MobilenetV2/expanded_conv_10/project/Conv2D, Tactic: 5326823351883942011, FeatureExtractor/MobilenetV2/expanded_conv_10/depthwise/Relu6[Float(-2,384,19,19)] -> FeatureExtractor/MobilenetV2/expanded_conv_10/project/BatchNorm/batchnorm/add_1[Float(-2,96,19,19)] Layer(CaskConvolution): FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Relu6), Tactic: -37215280111360163, FeatureExtractor/MobilenetV2/expanded_conv_10/project/BatchNorm/batchnorm/add_1[Float(-2,96,19,19)] -> FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Relu6[Float(-2,576,19,19)] Layer(CudaDepthwiseConvolution): FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/Relu6), Tactic: -1, FeatureExtractor/MobilenetV2/expanded_conv_11/expand/Relu6[Float(-2,576,19,19)] -> FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/Relu6[Float(-2,576,19,19)] Layer(CaskConvolution): FeatureExtractor/MobilenetV2/expanded_conv_11/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_11/add, Tactic: -6576203419454146580, FeatureExtractor/MobilenetV2/expanded_conv_11/depthwise/Relu6[Float(-2,576,19,19)], FeatureExtractor/MobilenetV2/expanded_conv_10/project/BatchNorm/batchnorm/add_1[Float(-2,96,19,19)] -> FeatureExtractor/MobilenetV2/expanded_conv_11/add[Float(-2,96,19,19)] Layer(CaskConvolution): FeatureExtractor/MobilenetV2/expanded_conv_12/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_12/expand/Relu6), Tactic: -37215280111360163, FeatureExtractor/MobilenetV2/expanded_conv_11/add[Float(-2,96,19,19)] -> FeatureExtractor/MobilenetV2/expanded_conv_12/expand/Relu6[Float(-2,576,19,19)] Layer(CudaDepthwiseConvolution): FeatureExtractor/MobilenetV2/expanded_conv_12/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_12/depthwise/Relu6), Tactic: -1, FeatureExtractor/MobilenetV2/expanded_conv_12/expand/Relu6[Float(-2,576,19,19)] -> FeatureExtractor/MobilenetV2/expanded_conv_12/depthwise/Relu6[Float(-2,576,19,19)] Layer(CaskConvolution): FeatureExtractor/MobilenetV2/expanded_conv_12/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_12/add, Tactic: -6576203419454146580, FeatureExtractor/MobilenetV2/expanded_conv_12/depthwise/Relu6[Float(-2,576,19,19)], FeatureExtractor/MobilenetV2/expanded_conv_11/add[Float(-2,96,19,19)] -> FeatureExtractor/MobilenetV2/expanded_conv_12/add[Float(-2,96,19,19)] Layer(Reformat): Reformatting CopyNode for Input Tensor 0 to FeatureExtractor/MobilenetV2/expanded_conv_13/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_13/expand/Relu6), Tactic: 0, FeatureExtractor/MobilenetV2/expanded_conv_12/add[Float(-2,96,19,19)] -> Reformatted Input Tensor 0 to FeatureExtractor/MobilenetV2/expanded_conv_13/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_13/expand/Relu6)[Half(-2,96,19,19)] Layer(CaskConvolution): FeatureExtractor/MobilenetV2/expanded_conv_13/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_13/expand/Relu6), Tactic: -2409163523992614473, Reformatted Input Tensor 0 to FeatureExtractor/MobilenetV2/expanded_conv_13/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_13/expand/Relu6)[Half(-2,96,19,19)] -> FeatureExtractor/MobilenetV2/expanded_conv_13/expand/Relu6[Half(-2,576,19,19)] Layer(CaskConvolution): BoxPredictor_0/BoxEncodingPredictor/Conv2D || BoxPredictor_0/ClassPredictor/Conv2D, Tactic: -2409163523992614473, FeatureExtractor/MobilenetV2/expanded_conv_13/expand/Relu6[Half(-2,576,19,19)] -> Reformatted Output Tensor 0 to BoxPredictor_0/BoxEncodingPredictor/Conv2D || BoxPredictor_0/ClassPredictor/Conv2D[Half(-2,285,19,19)] Layer(Reformat): Reformatting CopyNode for Output Tensor 0 to BoxPredictor_0/BoxEncodingPredictor/Conv2D || BoxPredictor_0/ClassPredictor/Conv2D, Tactic: 0, Reformatted Output Tensor 0 to BoxPredictor_0/BoxEncodingPredictor/Conv2D || BoxPredictor_0/ClassPredictor/Conv2D[Half(-2,285,19,19)] -> BoxPredictor_0/BoxEncodingPredictor/Conv2D || BoxPredictor_0/ClassPredictor/Conv2D[Float(-2,285,19,19)] Layer(Shuffle): (Unnamed Layer* 404) [Shuffle] + BoxPredictor_0/Reshape_1, Tactic: 0, BoxPredictor_0/BoxEncodingPredictor/Conv2D || BoxPredictor_0/ClassPredictor/Conv2D[Float(-2,273,19,19)] -> BoxPredictor_0/Reshape_1[Float(-2,1083,91,1)] Layer(Reformat): Reformatting CopyNode for Input Tensor 0 to FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/Relu6), Tactic: 0, FeatureExtractor/MobilenetV2/expanded_conv_13/expand/Relu6[Half(-2,576,19,19)] -> Reformatted Input Tensor 0 to FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/Relu6)[Half(-2,576,19,19)] Layer(CudnnConvolution): FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/Relu6), Tactic: 1, Reformatted Input Tensor 0 to FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/Relu6)[Half(-2,576,19,19)] -> FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/Relu6[Half(-2,576,10,10)] Layer(Reformat): Reformatting CopyNode for Input Tensor 0 to FeatureExtractor/MobilenetV2/expanded_conv_13/project/Conv2D, Tactic: 0, FeatureExtractor/MobilenetV2/expanded_conv_13/depthwise/Relu6[Half(-2,576,10,10)] -> Reformatted Input Tensor 0 to FeatureExtractor/MobilenetV2/expanded_conv_13/project/Conv2D[Half(-2,576,10,10)] Layer(CaskConvolution): FeatureExtractor/MobilenetV2/expanded_conv_13/project/Conv2D, Tactic: 8163473458334948789, Reformatted Input Tensor 0 to FeatureExtractor/MobilenetV2/expanded_conv_13/project/Conv2D[Half(-2,576,10,10)] -> FeatureExtractor/MobilenetV2/expanded_conv_13/project/BatchNorm/batchnorm/add_1[Half(-2,160,10,10)] Layer(CaskConvolution): FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Relu6), Tactic: 8163473458334948789, FeatureExtractor/MobilenetV2/expanded_conv_13/project/BatchNorm/batchnorm/add_1[Half(-2,160,10,10)] -> FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Relu6[Half(-2,960,10,10)] Layer(Reformat): Reformatting CopyNode for Input Tensor 0 to FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/Relu6), Tactic: 0, FeatureExtractor/MobilenetV2/expanded_conv_14/expand/Relu6[Half(-2,960,10,10)] -> Reformatted Input Tensor 0 to FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/Relu6)[Half(-2,960,10,10)] Layer(CudnnConvolution): FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/Relu6), Tactic: 0, Reformatted Input Tensor 0 to FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/Relu6)[Half(-2,960,10,10)] -> FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/Relu6[Half(-2,960,10,10)] Layer(Reformat): Reformatting CopyNode for Input Tensor 0 to FeatureExtractor/MobilenetV2/expanded_conv_14/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_14/add, Tactic: 0, FeatureExtractor/MobilenetV2/expanded_conv_14/depthwise/Relu6[Half(-2,960,10,10)] -> Reformatted Input Tensor 0 to FeatureExtractor/MobilenetV2/expanded_conv_14/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_14/add[Half(-2,960,10,10)] Layer(CaskConvolution): FeatureExtractor/MobilenetV2/expanded_conv_14/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_14/add, Tactic: 8163473458334948789, Reformatted Input Tensor 0 to FeatureExtractor/MobilenetV2/expanded_conv_14/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_14/add[Half(-2,960,10,10)], FeatureExtractor/MobilenetV2/expanded_conv_13/project/BatchNorm/batchnorm/add_1[Half(-2,160,10,10)] -> FeatureExtractor/MobilenetV2/expanded_conv_14/add[Half(-2,160,10,10)] Layer(CaskConvolution): FeatureExtractor/MobilenetV2/expanded_conv_15/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_15/expand/Relu6), Tactic: 8163473458334948789, FeatureExtractor/MobilenetV2/expanded_conv_14/add[Half(-2,160,10,10)] -> FeatureExtractor/MobilenetV2/expanded_conv_15/expand/Relu6[Half(-2,960,10,10)] Layer(Reformat): Reformatting CopyNode for Input Tensor 0 to FeatureExtractor/MobilenetV2/expanded_conv_15/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_15/depthwise/Relu6), Tactic: 0, FeatureExtractor/MobilenetV2/expanded_conv_15/expand/Relu6[Half(-2,960,10,10)] -> Reformatted Input Tensor 0 to FeatureExtractor/MobilenetV2/expanded_conv_15/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_15/depthwise/Relu6)[Half(-2,960,10,10)] Layer(CudnnConvolution): FeatureExtractor/MobilenetV2/expanded_conv_15/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_15/depthwise/Relu6), Tactic: 0, Reformatted Input Tensor 0 to FeatureExtractor/MobilenetV2/expanded_conv_15/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_15/depthwise/Relu6)[Half(-2,960,10,10)] -> FeatureExtractor/MobilenetV2/expanded_conv_15/depthwise/Relu6[Half(-2,960,10,10)] Layer(Reformat): Reformatting CopyNode for Input Tensor 0 to FeatureExtractor/MobilenetV2/expanded_conv_15/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_15/add, Tactic: 0, FeatureExtractor/MobilenetV2/expanded_conv_15/depthwise/Relu6[Half(-2,960,10,10)] -> Reformatted Input Tensor 0 to FeatureExtractor/MobilenetV2/expanded_conv_15/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_15/add[Half(-2,960,10,10)] Layer(CaskConvolution): FeatureExtractor/MobilenetV2/expanded_conv_15/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_15/add, Tactic: 8163473458334948789, Reformatted Input Tensor 0 to FeatureExtractor/MobilenetV2/expanded_conv_15/project/Conv2D + FeatureExtractor/MobilenetV2/expanded_conv_15/add[Half(-2,960,10,10)], FeatureExtractor/MobilenetV2/expanded_conv_14/add[Half(-2,160,10,10)] -> FeatureExtractor/MobilenetV2/expanded_conv_15/add[Half(-2,160,10,10)] Layer(CaskConvolution): FeatureExtractor/MobilenetV2/expanded_conv_16/expand/Conv2D + PWN(FeatureExtractor/MobilenetV2/expanded_conv_16/expand/Relu6), Tactic: 8163473458334948789, FeatureExtractor/MobilenetV2/expanded_conv_15/add[Half(-2,160,10,10)] -> FeatureExtractor/MobilenetV2/expanded_conv_16/expand/Relu6[Half(-2,960,10,10)] Layer(Reformat): Reformatting CopyNode for Input Tensor 0 to FeatureExtractor/MobilenetV2/expanded_conv_16/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_16/depthwise/Relu6), Tactic: 0, FeatureExtractor/MobilenetV2/expanded_conv_16/expand/Relu6[Half(-2,960,10,10)] -> Reformatted Input Tensor 0 to FeatureExtractor/MobilenetV2/expanded_conv_16/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_16/depthwise/Relu6)[Half(-2,960,10,10)] Layer(CudnnConvolution): FeatureExtractor/MobilenetV2/expanded_conv_16/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_16/depthwise/Relu6), Tactic: 0, Reformatted Input Tensor 0 to FeatureExtractor/MobilenetV2/expanded_conv_16/depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/expanded_conv_16/depthwise/Relu6)[Half(-2,960,10,10)] -> FeatureExtractor/MobilenetV2/expanded_conv_16/depthwise/Relu6[Half(-2,960,10,10)] Layer(Reformat): Reformatting CopyNode for Input Tensor 0 to FeatureExtractor/MobilenetV2/expanded_conv_16/project/Conv2D, Tactic: 0, FeatureExtractor/MobilenetV2/expanded_conv_16/depthwise/Relu6[Half(-2,960,10,10)] -> Reformatted Input Tensor 0 to FeatureExtractor/MobilenetV2/expanded_conv_16/project/Conv2D[Half(-2,960,10,10)] Layer(CaskConvolution): FeatureExtractor/MobilenetV2/expanded_conv_16/project/Conv2D, Tactic: 8163473458334948789, Reformatted Input Tensor 0 to FeatureExtractor/MobilenetV2/expanded_conv_16/project/Conv2D[Half(-2,960,10,10)] -> FeatureExtractor/MobilenetV2/expanded_conv_16/project/BatchNorm/batchnorm/add_1[Half(-2,320,10,10)] Layer(CaskConvolution): FeatureExtractor/MobilenetV2/Conv_1/Conv2D + PWN(FeatureExtractor/MobilenetV2/Conv_1/Relu6), Tactic: -1716393687483585322, FeatureExtractor/MobilenetV2/expanded_conv_16/project/BatchNorm/batchnorm/add_1[Half(-2,320,10,10)] -> FeatureExtractor/MobilenetV2/Conv_1/Relu6[Half(-2,1280,10,10)] Layer(CaskConvolution): BoxPredictor_1/BoxEncodingPredictor/Conv2D || BoxPredictor_1/ClassPredictor/Conv2D, Tactic: 4772821744921268633, FeatureExtractor/MobilenetV2/Conv_1/Relu6[Half(-2,1280,10,10)] -> Reformatted Output Tensor 0 to BoxPredictor_1/BoxEncodingPredictor/Conv2D || BoxPredictor_1/ClassPredictor/Conv2D[Half(-2,570,10,10)] Layer(Reformat): Reformatting CopyNode for Output Tensor 0 to BoxPredictor_1/BoxEncodingPredictor/Conv2D || BoxPredictor_1/ClassPredictor/Conv2D, Tactic: 0, Reformatted Output Tensor 0 to BoxPredictor_1/BoxEncodingPredictor/Conv2D || BoxPredictor_1/ClassPredictor/Conv2D[Half(-2,570,10,10)] -> BoxPredictor_1/BoxEncodingPredictor/Conv2D || BoxPredictor_1/ClassPredictor/Conv2D[Float(-2,570,10,10)] Layer(Shuffle): (Unnamed Layer* 533) [Shuffle] + BoxPredictor_1/Reshape_1, Tactic: 0, BoxPredictor_1/BoxEncodingPredictor/Conv2D || BoxPredictor_1/ClassPredictor/Conv2D[Float(-2,546,10,10)] -> BoxPredictor_1/Reshape_1[Float(-2,600,91,1)] Layer(CaskConvolution): FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Relu6), Tactic: -1716393687483585322, FeatureExtractor/MobilenetV2/Conv_1/Relu6[Half(-2,1280,10,10)] -> FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Relu6[Half(-2,256,10,10)] Layer(Reformat): Reformatting CopyNode for Input Tensor 0 to FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/Relu6), Tactic: 0, FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_2_1x1_256/Relu6[Half(-2,256,10,10)] -> Reformatted Input Tensor 0 to FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/Relu6)[Float(-2,256,10,10)] Layer(CudaDepthwiseConvolution): FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/Relu6), Tactic: -1, Reformatted Input Tensor 0 to FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/Relu6)[Float(-2,256,10,10)] -> FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/Relu6[Float(-2,256,5,5)] Layer(Reformat): Reformatting CopyNode for Input Tensor 0 to FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Relu6), Tactic: 0, FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512_depthwise/Relu6[Float(-2,256,5,5)] -> Reformatted Input Tensor 0 to FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Relu6)[Half(-2,256,5,5)] Layer(FusedConvActConvolution): FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Relu6), Tactic: 7798783, Reformatted Input Tensor 0 to FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Relu6)[Half(-2,256,5,5)] -> FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Relu6[Half(-2,512,5,5)] Layer(FusedConvActConvolution): BoxPredictor_2/BoxEncodingPredictor/Conv2D || BoxPredictor_2/ClassPredictor/Conv2D, Tactic: 720895, FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Relu6[Half(-2,512,5,5)] -> Reformatted Output Tensor 0 to BoxPredictor_2/BoxEncodingPredictor/Conv2D || BoxPredictor_2/ClassPredictor/Conv2D[Half(-2,570,5,5)] Layer(Reformat): Reformatting CopyNode for Output Tensor 0 to BoxPredictor_2/BoxEncodingPredictor/Conv2D || BoxPredictor_2/ClassPredictor/Conv2D, Tactic: 0, Reformatted Output Tensor 0 to BoxPredictor_2/BoxEncodingPredictor/Conv2D || BoxPredictor_2/ClassPredictor/Conv2D[Half(-2,570,5,5)] -> BoxPredictor_2/BoxEncodingPredictor/Conv2D || BoxPredictor_2/ClassPredictor/Conv2D[Float(-2,570,5,5)] Layer(Shuffle): (Unnamed Layer* 574) [Shuffle] + BoxPredictor_2/Reshape_1, Tactic: 0, BoxPredictor_2/BoxEncodingPredictor/Conv2D || BoxPredictor_2/ClassPredictor/Conv2D[Float(-2,546,5,5)] -> BoxPredictor_2/Reshape_1[Float(-2,150,91,1)] Layer(FusedConvActConvolution): FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Relu6), Tactic: 3997695, FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_2_3x3_s2_512/Relu6[Half(-2,512,5,5)] -> FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Relu6[Half(-2,128,5,5)] Layer(Reformat): Reformatting CopyNode for Input Tensor 0 to FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/Relu6), Tactic: 0, FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_3_1x1_128/Relu6[Half(-2,128,5,5)] -> Reformatted Input Tensor 0 to FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/Relu6)[Half(-2,128,5,5)] Layer(CudnnConvolution): FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/Relu6), Tactic: 0, Reformatted Input Tensor 0 to FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/Relu6)[Half(-2,128,5,5)] -> FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/Relu6[Half(-2,128,3,3)] Layer(Reformat): Reformatting CopyNode for Input Tensor 0 to FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Relu6), Tactic: 0, FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256_depthwise/Relu6[Half(-2,128,3,3)] -> Reformatted Input Tensor 0 to FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Relu6)[Half(-2,128,3,3)] Layer(FusedConvActConvolution): FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Relu6), Tactic: 5177343, Reformatted Input Tensor 0 to FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Relu6)[Half(-2,128,3,3)] -> FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Relu6[Half(-2,256,3,3)] Layer(FusedConvActConvolution): BoxPredictor_3/BoxEncodingPredictor/Conv2D || BoxPredictor_3/ClassPredictor/Conv2D, Tactic: 983039, FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Relu6[Half(-2,256,3,3)] -> Reformatted Output Tensor 0 to BoxPredictor_3/BoxEncodingPredictor/Conv2D || BoxPredictor_3/ClassPredictor/Conv2D[Half(-2,570,3,3)] Layer(Reformat): Reformatting CopyNode for Output Tensor 0 to BoxPredictor_3/BoxEncodingPredictor/Conv2D || BoxPredictor_3/ClassPredictor/Conv2D, Tactic: 0, Reformatted Output Tensor 0 to BoxPredictor_3/BoxEncodingPredictor/Conv2D || BoxPredictor_3/ClassPredictor/Conv2D[Half(-2,570,3,3)] -> BoxPredictor_3/BoxEncodingPredictor/Conv2D || BoxPredictor_3/ClassPredictor/Conv2D[Float(-2,570,3,3)] Layer(Shuffle): (Unnamed Layer* 615) [Shuffle] + BoxPredictor_3/Reshape_1, Tactic: 0, BoxPredictor_3/BoxEncodingPredictor/Conv2D || BoxPredictor_3/ClassPredictor/Conv2D[Float(-2,546,3,3)] -> BoxPredictor_3/Reshape_1[Float(-2,54,91,1)] Layer(FusedConvActConvolution): FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Relu6), Tactic: 5177343, FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_3_3x3_s2_256/Relu6[Half(-2,256,3,3)] -> FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Relu6[Half(-2,128,3,3)] Layer(Reformat): Reformatting CopyNode for Input Tensor 0 to FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/Relu6), Tactic: 0, FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_4_1x1_128/Relu6[Half(-2,128,3,3)] -> Reformatted Input Tensor 0 to FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/Relu6)[Half(-2,128,3,3)] Layer(CudnnConvolution): FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/Relu6), Tactic: 2, Reformatted Input Tensor 0 to FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/Relu6)[Half(-2,128,3,3)] -> FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/Relu6[Half(-2,128,2,2)] Layer(Reformat): Reformatting CopyNode for Input Tensor 0 to FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Relu6), Tactic: 0, FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256_depthwise/Relu6[Half(-2,128,2,2)] -> Reformatted Input Tensor 0 to FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Relu6)[Half(-2,128,2,2)] Layer(FusedConvActConvolution): FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Relu6), Tactic: 8716287, Reformatted Input Tensor 0 to FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Relu6)[Half(-2,128,2,2)] -> FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Relu6[Half(-2,256,2,2)] Layer(FusedConvActConvolution): BoxPredictor_4/BoxEncodingPredictor/Conv2D || BoxPredictor_4/ClassPredictor/Conv2D, Tactic: 983039, FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Relu6[Half(-2,256,2,2)] -> Reformatted Output Tensor 0 to BoxPredictor_4/BoxEncodingPredictor/Conv2D || BoxPredictor_4/ClassPredictor/Conv2D[Half(-2,570,2,2)] Layer(Reformat): Reformatting CopyNode for Output Tensor 0 to BoxPredictor_4/BoxEncodingPredictor/Conv2D || BoxPredictor_4/ClassPredictor/Conv2D, Tactic: 0, Reformatted Output Tensor 0 to BoxPredictor_4/BoxEncodingPredictor/Conv2D || BoxPredictor_4/ClassPredictor/Conv2D[Half(-2,570,2,2)] -> BoxPredictor_4/BoxEncodingPredictor/Conv2D || BoxPredictor_4/ClassPredictor/Conv2D[Float(-2,570,2,2)] Layer(Shuffle): (Unnamed Layer* 656) [Shuffle] + BoxPredictor_4/Reshape_1, Tactic: 0, BoxPredictor_4/BoxEncodingPredictor/Conv2D || BoxPredictor_4/ClassPredictor/Conv2D[Float(-2,546,2,2)] -> BoxPredictor_4/Reshape_1[Float(-2,24,91,1)] Layer(FusedConvActConvolution): FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Relu6), Tactic: 6291455, FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_4_3x3_s2_256/Relu6[Half(-2,256,2,2)] -> FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Relu6[Half(-2,64,2,2)] Layer(Reformat): Reformatting CopyNode for Input Tensor 0 to FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/Relu6), Tactic: 0, FeatureExtractor/MobilenetV2/layer_19_1_Conv2d_5_1x1_64/Relu6[Half(-2,64,2,2)] -> Reformatted Input Tensor 0 to FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/Relu6)[Half(-2,64,2,2)] Layer(CudnnConvolution): FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/Relu6), Tactic: 1, Reformatted Input Tensor 0 to FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/depthwise + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/Relu6)[Half(-2,64,2,2)] -> FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/Relu6[Half(-2,64,1,1)] Layer(NoOp): Reformatting CopyNode for Input Tensor 0 to FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Relu6), Tactic: 0, FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128_depthwise/Relu6[Half(-2,64,1,1)] -> Reformatted Input Tensor 0 to FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Relu6)[Half(-2,64,1,1)] Layer(FusedConvActConvolution): FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Relu6), Tactic: 5373951, Reformatted Input Tensor 0 to FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Conv2D + PWN(FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Relu6)[Half(-2,64,1,1)] -> FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Relu6[Half(-2,128,1,1)] Layer(FusedConvActConvolution): BoxPredictor_5/BoxEncodingPredictor/Conv2D || BoxPredictor_5/ClassPredictor/Conv2D, Tactic: 983039, FeatureExtractor/MobilenetV2/layer_19_2_Conv2d_5_3x3_s2_128/Relu6[Half(-2,128,1,1)] -> Reformatted Output Tensor 0 to BoxPredictor_5/BoxEncodingPredictor/Conv2D || BoxPredictor_5/ClassPredictor/Conv2D[Half(-2,570,1,1)] Layer(Reformat): Reformatting CopyNode for Output Tensor 0 to BoxPredictor_5/BoxEncodingPredictor/Conv2D || BoxPredictor_5/ClassPredictor/Conv2D, Tactic: 0, Reformatted Output Tensor 0 to BoxPredictor_5/BoxEncodingPredictor/Conv2D || BoxPredictor_5/ClassPredictor/Conv2D[Half(-2,570,1,1)] -> BoxPredictor_5/BoxEncodingPredictor/Conv2D || BoxPredictor_5/ClassPredictor/Conv2D[Float(-2,570,1,1)] Layer(Shuffle): (Unnamed Layer* 697) [Shuffle] + BoxPredictor_5/Reshape_1, Tactic: 0, BoxPredictor_5/BoxEncodingPredictor/Conv2D || BoxPredictor_5/ClassPredictor/Conv2D[Float(-2,546,1,1)] -> BoxPredictor_5/Reshape_1[Float(-2,6,91,1)] Layer(PluginV2): concat_box_conf, Tactic: 0, BoxPredictor_0/Reshape_1[Float(-2,1083,91,1)], BoxPredictor_1/Reshape_1[Float(-2,600,91,1)], BoxPredictor_2/Reshape_1[Float(-2,150,91,1)], BoxPredictor_3/Reshape_1[Float(-2,54,91,1)], BoxPredictor_4/Reshape_1[Float(-2,24,91,1)], BoxPredictor_5/Reshape_1[Float(-2,6,91,1)] -> concat_box_conf[Float(-2,174447,1,1)] Layer(Shuffle): (Unnamed Layer* 707) [Shuffle] + BoxPredictor_0/Reshape, Tactic: 0, BoxPredictor_0/BoxEncodingPredictor/Conv2D || BoxPredictor_0/ClassPredictor/Conv2D[Float(-2,12,19,19)] -> BoxPredictor_0/Reshape[Float(-2,1083,1,4)] Layer(Shuffle): (Unnamed Layer* 716) [Shuffle] + BoxPredictor_1/Reshape, Tactic: 0, BoxPredictor_1/BoxEncodingPredictor/Conv2D || BoxPredictor_1/ClassPredictor/Conv2D[Float(-2,24,10,10)] -> BoxPredictor_1/Reshape[Float(-2,600,1,4)] Layer(Shuffle): (Unnamed Layer* 725) [Shuffle] + BoxPredictor_2/Reshape, Tactic: 0, BoxPredictor_2/BoxEncodingPredictor/Conv2D || BoxPredictor_2/ClassPredictor/Conv2D[Float(-2,24,5,5)] -> BoxPredictor_2/Reshape[Float(-2,150,1,4)] Layer(Shuffle): (Unnamed Layer* 734) [Shuffle] + BoxPredictor_3/Reshape, Tactic: 0, BoxPredictor_3/BoxEncodingPredictor/Conv2D || BoxPredictor_3/ClassPredictor/Conv2D[Float(-2,24,3,3)] -> BoxPredictor_3/Reshape[Float(-2,54,1,4)] Layer(Shuffle): (Unnamed Layer* 743) [Shuffle] + BoxPredictor_4/Reshape, Tactic: 0, BoxPredictor_4/BoxEncodingPredictor/Conv2D || BoxPredictor_4/ClassPredictor/Conv2D[Float(-2,24,2,2)] -> BoxPredictor_4/Reshape[Float(-2,24,1,4)] Layer(Shuffle): (Unnamed Layer* 752) [Shuffle] + BoxPredictor_5/Reshape, Tactic: 0, BoxPredictor_5/BoxEncodingPredictor/Conv2D || BoxPredictor_5/ClassPredictor/Conv2D[Float(-2,24,1,1)] -> BoxPredictor_5/Reshape[Float(-2,6,1,4)] Layer(PluginV2): Squeeze, Tactic: 0, BoxPredictor_0/Reshape[Float(-2,1083,1,4)], BoxPredictor_1/Reshape[Float(-2,600,1,4)], BoxPredictor_2/Reshape[Float(-2,150,1,4)], BoxPredictor_3/Reshape[Float(-2,54,1,4)], BoxPredictor_4/Reshape[Float(-2,24,1,4)], BoxPredictor_5/Reshape[Float(-2,6,1,4)] -> Reformatted Output Tensor 0 to Squeeze[Float(-2,7668,1,1)] Layer(Reformat): Reformatting CopyNode for Output Tensor 0 to Squeeze, Tactic: 0, Reformatted Output Tensor 0 to Squeeze[Float(-2,7668,1,1)] -> Squeeze[Half(-2,7668,1,1)] Layer(Constant): Const, Tactic: 0, -> Const[Float(1,2)] Layer(Reformat): Reformatting CopyNode for Input Tensor 0 to GridAnchor, Tactic: 0, Const[Float(1,2)] -> Reformatted Input Tensor 0 to GridAnchor[Float(-2,2)] Layer(PluginV2): GridAnchor, Tactic: 0, Reformatted Input Tensor 0 to GridAnchor[Float(-2,2)] -> GridAnchor[Float(-2,2,4332,1)], GridAnchor_1[Float(-2,2,2400,1)], GridAnchor_2[Float(-2,2,600,1)], GridAnchor_3[Float(-2,2,216,1)], GridAnchor_4[Float(-2,2,96,1)], GridAnchor_5[Float(-2,2,24,1)] Layer(Reformat): GridAnchor copy, Tactic: 0, GridAnchor[Float(-2,2,4332,1)] -> concat_priorbox[Half(-2,2,4332,1)] Layer(Reformat): GridAnchor_1 copy, Tactic: 0, GridAnchor_1[Float(-2,2,2400,1)] -> concat_priorbox[Half(-2,2,2400,1)] Layer(Reformat): GridAnchor_2 copy, Tactic: 0, GridAnchor_2[Float(-2,2,600,1)] -> concat_priorbox[Half(-2,2,600,1)] Layer(Reformat): GridAnchor_3 copy, Tactic: 0, GridAnchor_3[Float(-2,2,216,1)] -> concat_priorbox[Half(-2,2,216,1)] Layer(Reformat): GridAnchor_4 copy, Tactic: 0, GridAnchor_4[Float(-2,2,96,1)] -> concat_priorbox[Half(-2,2,96,1)] Layer(Reformat): GridAnchor_5 copy, Tactic: 0, GridAnchor_5[Float(-2,2,24,1)] -> concat_priorbox[Half(-2,2,24,1)] Layer(Reformat): Reformatting CopyNode for Input Tensor 0 to NMS, Tactic: 0, concat_box_conf[Float(-2,174447,1,1)] -> Reformatted Input Tensor 0 to NMS[Half(-2,174447,1,1)] Layer(PluginV2): NMS, Tactic: 0, Reformatted Input Tensor 0 to NMS[Half(-2,174447,1,1)], Squeeze[Half(-2,7668,1,1)], concat_priorbox[Half(-2,2,7668,1)] -> Reformatted Output Tensor 0 to NMS[Half(-2,1,100,7)], NMS_1[Float(-2,1,1,1)] Layer(Reformat): Reformatting CopyNode for Output Tensor 0 to NMS, Tactic: 0, Reformatted Output Tensor 0 to NMS[Half(-2,1,100,7)] -> NMS[Float(-2,1,100,7)] [TRT] [MemUsageChange] TensorRT-managed allocation in building engine: CPU +33, GPU +64, now: CPU 33, GPU 64 (MiB) [TRT] device GPU, completed building CUDA engine [TRT] Serializing timing cache. UUID = GPU-a220528a-4ef6-34d2-ac51-72ebc267ecf9, commit ID = 44fcda3a40ebbc3b [TRT] Serialized 1098 timing cache entries [TRT] saving timing cache to /usr/local/bin/networks/tensorrt.8201.timingcache (114312 bytes) [TRT] Deleting timing cache: 1098 entries, 746 hits [TRT] network profiling complete, saving engine cache to /usr/local/bin/networks/SSD-Mobilenet-v2/ssd_mobilenet_v2_coco.uff.1.1.8201.GPU.FP16.engine [TRT] device GPU, completed saving engine cache to /usr/local/bin/networks/SSD-Mobilenet-v2/ssd_mobilenet_v2_coco.uff.1.1.8201.GPU.FP16.engine [TRT] saving model checksum to /usr/local/bin/networks/SSD-Mobilenet-v2/ssd_mobilenet_v2_coco.uff.sha256sum [TRT] sha256sum /usr/local/bin/networks/SSD-Mobilenet-v2/ssd_mobilenet_v2_coco.uff | awk '{print $1}' > /usr/local/bin/networks/SSD-Mobilenet-v2/ssd_mobilenet_v2_coco.uff.sha256sum [TRT] device GPU, loaded /usr/local/bin/networks/SSD-Mobilenet-v2/ssd_mobilenet_v2_coco.uff [TRT] [MemUsageChange] Init CUDA: CPU +0, GPU +0, now: CPU 1136, GPU 1935 (MiB) [TRT] Loaded engine size: 56 MiB [TRT] Using cublas as a tactic source [TRT] [MemUsageChange] Init cuBLAS/cuBLASLt: CPU +0, GPU +3, now: CPU 1136, GPU 1876 (MiB) [TRT] Using cuDNN as a tactic source [TRT] [MemUsageChange] Init cuDNN: CPU +1, GPU +0, now: CPU 1137, GPU 1876 (MiB) [TRT] Deserialization required 293235 microseconds. [TRT] [MemUsageChange] TensorRT-managed allocation in engine deserialization: CPU +0, GPU +56, now: CPU 0, GPU 56 (MiB) [TRT] Using cublas as a tactic source [TRT] [MemUsageChange] Init cuBLAS/cuBLASLt: CPU +0, GPU +0, now: CPU 1137, GPU 1876 (MiB) [TRT] Using cuDNN as a tactic source [TRT] [MemUsageChange] Init cuDNN: CPU +0, GPU +0, now: CPU 1137, GPU 1876 (MiB) [TRT] Total per-runner device persistent memory is 46254592 [TRT] Total per-runner host persistent memory is 134272 [TRT] Allocated activation device memory of size 13360640 [TRT] [MemUsageChange] TensorRT-managed allocation in IExecutionContext creation: CPU +0, GPU +57, now: CPU 0, GPU 113 (MiB) [TRT] [TRT] CUDA engine context initialized on device GPU: [TRT] -- layers 120 [TRT] -- maxBatchSize 1 [TRT] -- deviceMemory 13360640 [TRT] -- bindings 3 [TRT] binding 0 -- index 0 -- name 'Input' -- type FP32 -- in/out INPUT -- # dims 3 -- dim #0 3 -- dim #1 300 -- dim #2 300 [TRT] binding 1 -- index 1 -- name 'NMS' -- type FP32 -- in/out OUTPUT -- # dims 3 -- dim #0 1 -- dim #1 100 -- dim #2 7 [TRT] binding 2 -- index 2 -- name 'NMS_1' -- type FP32 -- in/out OUTPUT -- # dims 3 -- dim #0 1 -- dim #1 1 -- dim #2 1 [TRT] [TRT] binding to input 0 Input binding index: 0 [TRT] binding to input 0 Input dims (b=1 c=3 h=300 w=300) size=1080000 [TRT] binding to output 0 NMS binding index: 1 [TRT] binding to output 0 NMS dims (b=1 c=1 h=100 w=7) size=2800 [TRT] binding to output 1 NMS_1 binding index: 2 [TRT] binding to output 1 NMS_1 dims (b=1 c=1 h=1 w=1) size=4 [TRT] [TRT] device GPU, /usr/local/bin/networks/SSD-Mobilenet-v2/ssd_mobilenet_v2_coco.uff initialized. [TRT] W = 7 H = 100 C = 1 [TRT] detectNet -- maximum bounding boxes: 100 [TRT] loaded 91 class labels [TRT] detectNet -- number of object classes: 91 [TRT] loaded 0 class colors [TRT] didn't load expected number of class colors (0 of 91) [TRT] filling in remaining 91 class colors with default colors [gstreamer] opening gstCamera for streaming, transitioning pipeline to GST_STATE_PLAYING [gstreamer] gstreamer changed state from NULL to READY ==> mysink [gstreamer] gstreamer changed state from NULL to READY ==> capsfilter1 [gstreamer] gstreamer changed state from NULL to READY ==> nvvconv0 [gstreamer] gstreamer changed state from NULL to READY ==> capsfilter0 [gstreamer] gstreamer changed state from NULL to READY ==> nvarguscamerasrc0 [gstreamer] gstreamer changed state from NULL to READY ==> pipeline0 [gstreamer] gstreamer changed state from READY to PAUSED ==> capsfilter1 [gstreamer] gstreamer changed state from READY to PAUSED ==> nvvconv0 [gstreamer] gstreamer changed state from READY to PAUSED ==> capsfilter0 [gstreamer] gstreamer stream status CREATE ==> src [gstreamer] gstreamer changed state from READY to PAUSED ==> nvarguscamerasrc0 [gstreamer] gstreamer changed state from READY to PAUSED ==> pipeline0 [gstreamer] gstreamer stream status ENTER ==> src [gstreamer] gstreamer message new-clock ==> pipeline0 [gstreamer] gstreamer changed state from PAUSED to PLAYING ==> capsfilter1 [gstreamer] gstreamer changed state from PAUSED to PLAYING ==> nvvconv0 [gstreamer] gstreamer changed state from PAUSED to PLAYING ==> capsfilter0 [gstreamer] gstreamer changed state from PAUSED to PLAYING ==> nvarguscamerasrc0 [gstreamer] gstreamer message stream-start ==> pipeline0 GST_ARGUS: Creating output stream CONSUMER: Waiting until producer is connected... GST_ARGUS: Available Sensor modes : GST_ARGUS: 3264 x 2464 FR = 21.000000 fps Duration = 47619048 ; Analog Gain range min 1.000000, max 10.625000; Exposure Range min 13000, max 683709000; GST_ARGUS: 3264 x 1848 FR = 28.000001 fps Duration = 35714284 ; Analog Gain range min 1.000000, max 10.625000; Exposure Range min 13000, max 683709000; GST_ARGUS: 1920 x 1080 FR = 29.999999 fps Duration = 33333334 ; Analog Gain range min 1.000000, max 10.625000; Exposure Range min 13000, max 683709000; GST_ARGUS: 1640 x 1232 FR = 29.999999 fps Duration = 33333334 ; Analog Gain range min 1.000000, max 10.625000; Exposure Range min 13000, max 683709000; GST_ARGUS: 1280 x 720 FR = 59.999999 fps Duration = 16666667 ; Analog Gain range min 1.000000, max 10.625000; Exposure Range min 13000, max 683709000; GST_ARGUS: 1280 x 720 FR = 120.000005 fps Duration = 8333333 ; Analog Gain range min 1.000000, max 10.625000; Exposure Range min 13000, max 683709000; GST_ARGUS: Running with following settings: Camera index = 0 Camera mode = 5 Output Stream W = 1280 H = 720 seconds to Run = 0 Frame Rate = 120.000005 GST_ARGUS: Setup Complete, Starting captures for 0 seconds GST_ARGUS: Starting repeat capture requests. [gstreamer] gstCamera::Capture() -- a timeout occurred waiting for the next image buffer Traceback (most recent call last): File "HelloV1.0.py", line 10, in detections = net.Detect(img) Exception: jetson.utils -- function wasn't passed a valid cudaImage or cudaMemory object [gstreamer] gstCamera -- stopping pipeline, transitioning to GST_STATE_NULL (Argus) Error InvalidState: (propagating from src/eglstream/FrameConsumerImpl.cpp, function streamEventThread(), line 135) (Argus) Error InvalidState: (propagating from src/eglstream/FrameConsumerImpl.cpp, function streamEventThreadStatic(), line 177) (Argus) Error FileOperationFailed: Failed socket read: Connection reset by peer (in src/rpc/socket/common/SocketUtils.cpp, function readSocket(), line 79) (Argus) Error FileOperationFailed: Unexpected error in reading socket (in src/rpc/socket/client/ClientSocketManager.cpp, function recvThreadCore(), line 266) (Argus) Error FileOperationFailed: Receive worker failure, notifying 3 waiting threads (in src/rpc/socket/client/ClientSocketManager.cpp, function recvThreadCore(), line 340) (Argus) Error InvalidState: Argus client is exiting with 3 outstanding client threads (in src/rpc/socket/client/ClientSocketManager.cpp, function recvThreadCore(), line 357) (Argus) Error FileOperationFailed: Receiving thread terminated with error (in src/rpc/socket/client/ClientSocketManager.cpp, function recvThreadWrapper(), line 368) (Argus) Error FileOperationFailed: Client thread received an error from socket (in src/rpc/socket/client/ClientSocketManager.cpp, function send(), line 145) (Argus) Error FileOperationFailed: (propagating from src/rpc/socket/client/SocketClientDispatch.cpp, function dispatch(), line 91) (Argus) Error InvalidState: Receive thread is not running cannot send. (in src/rpc/socket/client/ClientSocketManager.cpp, function send(), line 96) (Argus) Error InvalidState: (propagating from src/rpc/socket/client/SocketClientDispatch.cpp, function dispatch(), line 91) Error generated. /dvs/git/dirty/git-master_linux/multimedia/nvgstreamer/gst-nvarguscamera/gstnvarguscamerasrc.cpp, execute:1127 Failed to start capture request (Argus) Error FileOperationFailed: Client thread received an error from socket (in src/rpc/socket/client/ClientSocketManager.cpp, function send(), line 145) (Argus) Error FileOperationFailed: (propagating from src/rpc/socket/client/SocketClientDispatch.cpp, function dispatch(), line 91) (Argus) Error InvalidState: Receive thread is not running cannot send. (in src/rpc/socket/client/ClientSocketManager.cpp, function send(), line 96) (Argus) Error InvalidState: (propagating from src/rpc/socket/client/SocketClientDispatch.cpp, function dispatch(), line 91) Segmentation fault (core dumped) jet@jet-jetson:~/Desktop$