STARTING! Log parameter values verbosely: [0] Num threads: [4] Graph: [/home/coreycole/Workspace/kernellabs/denoise_deploy_v2/inference_module/exports/converted_model_float32.tflite] Enable op profiling: [1] #threads used for CPU inference: [4] Loaded model /home/coreycole/Workspace/kernellabs/denoise_deploy_v2/inference_module/exports/converted_model_float32.tflite The input model file size (MB): 292.44 Initialized session in 7.671ms. Running benchmark for at least 1 iterations and at least 0.5 seconds but terminate if exceeding 150 seconds. count=1 curr=10940593 Running benchmark for at least 50 iterations and at least 1 seconds but terminate if exceeding 150 seconds. count=14 first=10772580 curr=10781309 min=10735842 max=10838353 avg=1.07877e+07 std=28956 Inference timings in us: Init: 7671, First inference: 10940593, Warmup (avg): 1.09406e+07, Inference (avg): 1.07877e+07 Note: as the benchmark tool itself affects memory footprint, the following is only APPROXIMATE to the actual memory footprint of the model at runtime. Take the information at your discretion. Peak memory footprint (MB): init=8.59375 overall=771.133 Profiling Info for Benchmark Initialization: ============================== Run Order ============================== [node type] [start] [first] [avg ms] [%] [cdf%] [mem KB] [times called] [Name] AllocateTensors 0.000 0.077 0.077 100.000% 100.000% 0.000 1 AllocateTensors/0 ============================== Top by Computation Time ============================== [node type] [start] [first] [avg ms] [%] [cdf%] [mem KB] [times called] [Name] AllocateTensors 0.000 0.077 0.077 100.000% 100.000% 0.000 1 AllocateTensors/0 Number of nodes executed: 1 ============================== Summary by node type ============================== [Node type] [count] [avg ms] [avg %] [cdf %] [mem KB] [times called] AllocateTensors 1 0.077 100.000% 100.000% 0.000 1 Timings (microseconds): count=1 curr=77 Memory (bytes): count=0 1 nodes observed Operator-wise Profiling Info for Regular Benchmark Runs: ============================== Run Order ============================== [node type] [start] [first] [avg ms] [%] [cdf%] [mem KB] [times called] [Name] RESHAPE 0.000 0.070 0.038 0.000% 0.000% 0.000 1 [device_0/g_ae/ExpandDims1]:0 CONV_2D 0.039 28.720 28.855 0.267% 0.268% 0.000 1 [device_0/g_ae/enc_0/BiasAdd;device_0/g_ae/enc_0/Conv2D;g_ae/enc_0/b1]:2 RESHAPE 28.895 0.394 0.437 0.004% 0.272% 0.000 1 [device_0/g_ae/enc_0/Reshape_1;device_0/g_ae/enc_0/Reshape]:3 ABS 29.331 13.340 13.547 0.126% 0.397% 0.000 1 [device_0/g_ae/enc_prelu_0/Abs]:4 RELU 42.879 0.522 0.540 0.005% 0.402% 0.000 1 [device_0/g_ae/enc_prelu_0/Relu]:5 SUB 43.419 0.793 0.796 0.007% 0.410% 0.000 1 [device_0/g_ae/enc_prelu_0/sub]:6 MUL 44.216 0.743 0.793 0.007% 0.417% 0.000 1 [device_0/g_ae/enc_prelu_0/mul]:7 MUL 45.009 0.384 0.437 0.004% 0.421% 0.000 1 [device_0/g_ae/enc_prelu_0/mul_1]:8 ADD 45.447 0.527 0.570 0.005% 0.427% 0.000 1 [device_0/g_ae/enc_prelu_0/add]:9 RESHAPE 46.016 0.320 0.336 0.003% 0.430% 0.000 1 [device_0/g_ae/ExpandDims_110]:10 CONV_2D 46.353 320.419 321.972 2.985% 3.414% 0.000 1 [device_0/g_ae/enc_1/BiasAdd;device_0/g_ae/enc_2/Conv2D;device_0/g_ae/enc_1/Conv2D;g_ae/enc_1/b1]:11 RESHAPE 368.325 0.432 0.461 0.004% 3.419% 0.000 1 [device_0/g_ae/enc_1/Reshape_1;device_0/g_ae/enc_1/Reshape]:12 ABS 368.786 13.385 13.771 0.128% 3.546% 0.000 1 [device_0/g_ae/enc_prelu_1/Abs]:13 RELU 382.558 0.527 0.528 0.005% 3.551% 0.000 1 [device_0/g_ae/enc_prelu_1/Relu]:14 SUB 383.086 0.789 0.827 0.008% 3.559% 0.000 1 [device_0/g_ae/enc_prelu_1/sub]:15 MUL 383.913 0.600 0.620 0.006% 3.565% 0.000 1 [device_0/g_ae/enc_prelu_1/mul]:16 MUL 384.534 0.393 0.421 0.004% 3.568% 0.000 1 [device_0/g_ae/enc_prelu_1/mul_1]:17 ADD 384.955 0.544 0.556 0.005% 3.574% 0.000 1 [device_0/g_ae/enc_prelu_1/add]:18 RESHAPE 385.512 0.333 0.349 0.003% 3.577% 0.000 1 [device_0/g_ae/ExpandDims_22]:19 CONV_2D 385.861 319.630 319.599 2.963% 6.539% 0.000 1 [device_0/g_ae/enc_2/BiasAdd;device_0/g_ae/enc_2/Conv2D;g_ae/enc_2/b1]:20 RESHAPE 705.460 0.222 0.226 0.002% 6.542% 0.000 1 [device_0/g_ae/enc_2/Reshape_1;device_0/g_ae/enc_2/Reshape]:21 ABS 705.686 6.810 6.775 0.063% 6.604% 0.000 1 [device_0/g_ae/enc_prelu_2/Abs]:22 RELU 712.461 0.239 0.228 0.002% 6.606% 0.000 1 [device_0/g_ae/enc_prelu_2/Relu]:23 SUB 712.690 0.339 0.337 0.003% 6.610% 0.000 1 [device_0/g_ae/enc_prelu_2/sub]:24 MUL 713.027 0.257 0.290 0.003% 6.612% 0.000 1 [device_0/g_ae/enc_prelu_2/mul]:25 MUL 713.317 0.129 0.141 0.001% 6.614% 0.000 1 [device_0/g_ae/enc_prelu_2/mul_1]:26 ADD 713.459 0.212 0.227 0.002% 6.616% 0.000 1 [device_0/g_ae/enc_prelu_2/add]:27 RESHAPE 713.686 0.125 0.132 0.001% 6.617% 0.000 1 [device_0/g_ae/ExpandDims_31]:28 CONV_2D 713.818 308.578 312.870 2.900% 9.517% 0.000 1 [device_0/g_ae/enc_3/BiasAdd;device_0/g_ae/enc_4/Conv2D;device_0/g_ae/enc_3/Conv2D;g_ae/enc_3/b1]:29 RESHAPE 1026.688 0.212 0.227 0.002% 9.519% 0.000 1 [device_0/g_ae/enc_3/Reshape_1;device_0/g_ae/enc_3/Reshape]:30 ABS 1026.916 6.809 6.725 0.062% 9.582% 0.000 1 [device_0/g_ae/enc_prelu_3/Abs]:31 RELU 1033.641 0.224 0.208 0.002% 9.584% 0.000 1 [device_0/g_ae/enc_prelu_3/Relu]:32 SUB 1033.850 0.329 0.295 0.003% 9.586% 0.000 1 [device_0/g_ae/enc_prelu_3/sub]:33 MUL 1034.146 0.223 0.228 0.002% 9.588% 0.000 1 [device_0/g_ae/enc_prelu_3/mul]:34 MUL 1034.374 0.128 0.134 0.001% 9.590% 0.000 1 [device_0/g_ae/enc_prelu_3/mul_1]:35 ADD 1034.508 0.213 0.222 0.002% 9.592% 0.000 1 [device_0/g_ae/enc_prelu_3/add]:36 RESHAPE 1034.730 0.111 0.113 0.001% 9.593% 0.000 1 [device_0/g_ae/ExpandDims_41]:37 CONV_2D 1034.842 308.998 311.785 2.890% 12.483% 0.000 1 [device_0/g_ae/enc_4/BiasAdd;device_0/g_ae/enc_4/Conv2D;g_ae/enc_4/b1]:38 RESHAPE 1346.628 0.099 0.107 0.001% 12.484% 0.000 1 [device_0/g_ae/enc_4/Reshape_1;device_0/g_ae/enc_4/Reshape]:39 ABS 1346.735 3.524 3.376 0.031% 12.515% 0.000 1 [device_0/g_ae/enc_prelu_4/Abs]:40 RELU 1350.112 0.112 0.105 0.001% 12.516% 0.000 1 [device_0/g_ae/enc_prelu_4/Relu]:41 SUB 1350.217 0.162 0.160 0.001% 12.518% 0.000 1 [device_0/g_ae/enc_prelu_4/sub]:42 MUL 1350.377 0.095 0.093 0.001% 12.519% 0.000 1 [device_0/g_ae/enc_prelu_4/mul]:43 MUL 1350.470 0.058 0.059 0.001% 12.519% 0.000 1 [device_0/g_ae/enc_prelu_4/mul_1]:44 ADD 1350.529 0.105 0.108 0.001% 12.520% 0.000 1 [device_0/g_ae/enc_prelu_4/add]:45 RESHAPE 1350.637 0.045 0.047 0.000% 12.521% 0.000 1 [device_0/g_ae/ExpandDims_51]:46 CONV_2D 1350.685 306.962 308.863 2.863% 15.384% 0.000 1 [device_0/g_ae/enc_5/BiasAdd;device_0/g_ae/enc_6/Conv2D;device_0/g_ae/enc_5/Conv2D;g_ae/enc_5/b1]:47 RESHAPE 1659.548 0.110 0.109 0.001% 15.385% 0.000 1 [device_0/g_ae/enc_5/Reshape_1;device_0/g_ae/enc_5/Reshape]:48 ABS 1659.657 3.323 3.390 0.031% 15.416% 0.000 1 [device_0/g_ae/enc_prelu_5/Abs]:49 RELU 1663.047 0.088 0.089 0.001% 15.417% 0.000 1 [device_0/g_ae/enc_prelu_5/Relu]:50 SUB 1663.137 0.117 0.116 0.001% 15.418% 0.000 1 [device_0/g_ae/enc_prelu_5/sub]:51 MUL 1663.253 0.099 0.098 0.001% 15.419% 0.000 1 [device_0/g_ae/enc_prelu_5/mul]:52 MUL 1663.351 0.057 0.059 0.001% 15.419% 0.000 1 [device_0/g_ae/enc_prelu_5/mul_1]:53 ADD 1663.410 0.104 0.104 0.001% 15.420% 0.000 1 [device_0/g_ae/enc_prelu_5/add]:54 RESHAPE 1663.514 0.046 0.046 0.000% 15.421% 0.000 1 [device_0/g_ae/ExpandDims_61]:55 CONV_2D 1663.560 308.750 309.949 2.873% 18.294% 0.000 1 [device_0/g_ae/enc_6/BiasAdd;device_0/g_ae/enc_6/Conv2D;g_ae/enc_6/b1]:56 RESHAPE 1973.509 0.056 0.057 0.001% 18.295% 0.000 1 [device_0/g_ae/enc_6/Reshape_1;device_0/g_ae/enc_6/Reshape]:57 ABS 1973.567 1.693 1.680 0.016% 18.310% 0.000 1 [device_0/g_ae/enc_prelu_6/Abs]:58 RELU 1975.247 0.041 0.044 0.000% 18.311% 0.000 1 [device_0/g_ae/enc_prelu_6/Relu]:59 SUB 1975.291 0.051 0.057 0.001% 18.311% 0.000 1 [device_0/g_ae/enc_prelu_6/sub]:60 MUL 1975.348 0.047 0.049 0.000% 18.312% 0.000 1 [device_0/g_ae/enc_prelu_6/mul]:61 MUL 1975.397 0.028 0.031 0.000% 18.312% 0.000 1 [device_0/g_ae/enc_prelu_6/mul_1]:62 ADD 1975.428 0.048 0.051 0.000% 18.312% 0.000 1 [device_0/g_ae/enc_prelu_6/add]:63 RESHAPE 1975.479 0.029 0.030 0.000% 18.313% 0.000 1 [device_0/g_ae/ExpandDims_71]:64 CONV_2D 1975.509 307.209 308.035 2.855% 21.168% 0.000 1 [device_0/g_ae/enc_7/BiasAdd;device_0/g_ae/enc_8/Conv2D;device_0/g_ae/enc_7/Conv2D;g_ae/enc_7/b1]:65 RESHAPE 2283.544 0.055 0.057 0.001% 21.169% 0.000 1 [device_0/g_ae/enc_7/Reshape_1;device_0/g_ae/enc_7/Reshape]:66 ABS 2283.601 1.653 1.692 0.016% 21.184% 0.000 1 [device_0/g_ae/enc_prelu_7/Abs]:67 RELU 2285.293 0.041 0.042 0.000% 21.185% 0.000 1 [device_0/g_ae/enc_prelu_7/Relu]:68 SUB 2285.335 0.051 0.054 0.001% 21.185% 0.000 1 [device_0/g_ae/enc_prelu_7/sub]:69 MUL 2285.389 0.057 0.051 0.000% 21.186% 0.000 1 [device_0/g_ae/enc_prelu_7/mul]:70 MUL 2285.441 0.039 0.031 0.000% 21.186% 0.000 1 [device_0/g_ae/enc_prelu_7/mul_1]:71 ADD 2285.472 0.063 0.052 0.000% 21.186% 0.000 1 [device_0/g_ae/enc_prelu_7/add]:72 RESHAPE 2285.523 0.023 0.021 0.000% 21.187% 0.000 1 [device_0/g_ae/ExpandDims_81]:73 CONV_2D 2285.544 307.675 309.840 2.872% 24.059% 0.000 1 [device_0/g_ae/enc_8/BiasAdd;device_0/g_ae/enc_8/Conv2D;g_ae/enc_8/b1]:74 RESHAPE 2595.385 0.029 0.029 0.000% 24.059% 0.000 1 [device_0/g_ae/enc_8/Reshape_1;device_0/g_ae/enc_8/Reshape]:75 ABS 2595.414 0.820 0.845 0.008% 24.067% 0.000 1 [device_0/g_ae/enc_prelu_8/Abs]:76 RELU 2596.259 0.020 0.020 0.000% 24.067% 0.000 1 [device_0/g_ae/enc_prelu_8/Relu]:77 SUB 2596.279 0.025 0.025 0.000% 24.067% 0.000 1 [device_0/g_ae/enc_prelu_8/sub]:78 MUL 2596.304 0.022 0.022 0.000% 24.067% 0.000 1 [device_0/g_ae/enc_prelu_8/mul]:79 MUL 2596.326 0.014 0.015 0.000% 24.068% 0.000 1 [device_0/g_ae/enc_prelu_8/mul_1]:80 ADD 2596.341 0.022 0.024 0.000% 24.068% 0.000 1 [device_0/g_ae/enc_prelu_8/add]:81 RESHAPE 2596.365 0.015 0.015 0.000% 24.068% 0.000 1 [device_0/g_ae/ExpandDims_91]:82 CONV_2D 2596.380 309.958 310.332 2.877% 26.945% 0.000 1 [device_0/g_ae/enc_9/BiasAdd;device_0/g_ae/enc_9/Conv2D;g_ae/enc_9/b1]:83 RESHAPE 2906.713 0.031 0.032 0.000% 26.945% 0.000 1 [device_0/g_ae/enc_9/Reshape_1;device_0/g_ae/enc_9/Reshape]:84 ABS 2906.745 0.827 0.861 0.008% 26.953% 0.000 1 [device_0/g_ae/enc_prelu_9/Abs]:85 RELU 2907.607 0.019 0.020 0.000% 26.953% 0.000 1 [device_0/g_ae/enc_prelu_9/Relu]:86 SUB 2907.626 0.025 0.025 0.000% 26.953% 0.000 1 [device_0/g_ae/enc_prelu_9/sub]:87 MUL 2907.652 0.020 0.020 0.000% 26.954% 0.000 1 [device_0/g_ae/enc_prelu_9/mul]:88 MUL 2907.672 0.015 0.015 0.000% 26.954% 0.000 1 [device_0/g_ae/enc_prelu_9/mul_1]:89 ADD 2907.687 0.023 0.024 0.000% 26.954% 0.000 1 [device_0/g_ae/enc_prelu_9/add]:90 RESHAPE 2907.711 0.009 0.010 0.000% 26.954% 0.000 1 [device_0/g_ae/ExpandDims_101]:91 CONV_2D 2907.721 621.544 622.511 5.771% 32.725% 0.000 1 [device_0/g_ae/enc_10/BiasAdd;device_0/g_ae/enc_10/Conv2D;g_ae/enc_10/b1]:92 RESHAPE 3530.233 0.029 0.031 0.000% 32.725% 0.000 1 [device_0/g_ae/enc_10/Reshape_1;device_0/g_ae/enc_10/Reshape]:93 ABS 3530.264 0.867 0.834 0.008% 32.733% 0.000 1 [device_0/g_ae/enc_prelu_10/Abs]:94 RELU 3531.098 0.020 0.020 0.000% 32.733% 0.000 1 [device_0/g_ae/enc_prelu_10/Relu]:95 SUB 3531.118 0.024 0.025 0.000% 32.733% 0.000 1 [device_0/g_ae/enc_prelu_10/sub]:96 MUL 3531.143 0.019 0.020 0.000% 32.733% 0.000 1 [device_0/g_ae/enc_prelu_10/mul]:97 MUL 3531.164 0.014 0.015 0.000% 32.733% 0.000 1 [device_0/g_ae/enc_prelu_10/mul_1]:98 ADD 3531.179 0.022 0.025 0.000% 32.734% 0.000 1 [device_0/g_ae/enc_prelu_10/add]:99 TfLiteFlexDelegate 3531.204 0.484 0.484 0.004% 32.738% 0.000 1 [device_0/g_ae/z/RandomStandardNormal]:216 CONCATENATION 3531.689 0.049 0.054 0.001% 32.739% 0.000 1 [device_0/g_ae/concat]:100 RESHAPE 3531.743 0.030 0.031 0.000% 32.739% 0.000 1 [device_0/g_ae/ExpandDims_111]:101 TRANSPOSE_CONV 3531.774 1319.750 1320.312 12.239% 44.978% 0.000 1 [device_0/g_ae/dec_0/conv2d_transpose1]:102 ADD 4852.087 0.039 0.039 0.000% 44.978% 0.000 1 [device_0/g_ae/dec_0/BiasAdd]:103 RESHAPE 4852.127 0.012 0.012 0.000% 44.978% 0.000 1 [device_0/g_ae/dec_0/Reshape_1;device_0/g_ae/dec_0/Reshape]:104 ABS 4852.139 0.843 0.843 0.008% 44.986% 0.000 1 [device_0/g_ae/dec_prelu_0/Abs]:105 RELU 4852.982 0.021 0.021 0.000% 44.986% 0.000 1 [device_0/g_ae/dec_prelu_0/Relu]:106 SUB 4853.003 0.025 0.025 0.000% 44.987% 0.000 1 [device_0/g_ae/dec_prelu_0/sub]:107 MUL 4853.029 0.020 0.020 0.000% 44.987% 0.000 1 [device_0/g_ae/dec_prelu_0/mul]:108 MUL 4853.049 0.015 0.015 0.000% 44.987% 0.000 1 [device_0/g_ae/dec_prelu_0/mul_1]:109 ADD 4853.064 0.024 0.024 0.000% 44.987% 0.000 1 [device_0/g_ae/dec_prelu_0/add]:110 CONCATENATION 4853.088 0.043 0.045 0.000% 44.988% 0.000 1 [device_0/g_ae/concat_1]:111 RESHAPE 4853.133 0.025 0.025 0.000% 44.988% 0.000 1 [device_0/g_ae/ExpandDims_121]:112 TRANSPOSE_CONV 4853.158 637.947 641.441 5.946% 50.934% 0.000 1 [device_0/g_ae/dec_1/conv2d_transpose1]:113 ADD 5494.600 0.039 0.041 0.000% 50.934% 0.000 1 [device_0/g_ae/dec_1/BiasAdd]:114 RESHAPE 5494.642 0.013 0.014 0.000% 50.934% 0.000 1 [device_0/g_ae/dec_1/Reshape_1;device_0/g_ae/dec_1/Reshape]:115 ABS 5494.655 0.894 0.859 0.008% 50.942% 0.000 1 [device_0/g_ae/dec_prelu_1/Abs]:116 RELU 5495.515 0.025 0.021 0.000% 50.943% 0.000 1 [device_0/g_ae/dec_prelu_1/Relu]:117 SUB 5495.536 0.029 0.027 0.000% 50.943% 0.000 1 [device_0/g_ae/dec_prelu_1/sub]:118 MUL 5495.563 0.026 0.024 0.000% 50.943% 0.000 1 [device_0/g_ae/dec_prelu_1/mul]:119 MUL 5495.588 0.014 0.016 0.000% 50.943% 0.000 1 [device_0/g_ae/dec_prelu_1/mul_1]:120 ADD 5495.604 0.026 0.025 0.000% 50.943% 0.000 1 [device_0/g_ae/dec_prelu_1/add]:121 CONCATENATION 5495.628 0.036 0.035 0.000% 50.944% 0.000 1 [device_0/g_ae/concat_2]:122 RESHAPE 5495.664 0.021 0.020 0.000% 50.944% 0.000 1 [device_0/g_ae/ExpandDims_131]:123 TRANSPOSE_CONV 5495.684 627.682 631.041 5.850% 56.794% 0.000 1 [device_0/g_ae/dec_2/conv2d_transpose1]:124 ADD 6126.725 0.081 0.091 0.001% 56.795% 0.000 1 [device_0/g_ae/dec_2/BiasAdd]:125 RESHAPE 6126.816 0.034 0.036 0.000% 56.795% 0.000 1 [device_0/g_ae/dec_2/Reshape_1;device_0/g_ae/dec_2/Reshape]:126 ABS 6126.852 1.686 1.739 0.016% 56.811% 0.000 1 [device_0/g_ae/dec_prelu_2/Abs]:127 RELU 6128.592 0.042 0.043 0.000% 56.811% 0.000 1 [device_0/g_ae/dec_prelu_2/Relu]:128 SUB 6128.635 0.050 0.053 0.000% 56.812% 0.000 1 [device_0/g_ae/dec_prelu_2/sub]:129 MUL 6128.689 0.048 0.049 0.000% 56.812% 0.000 1 [device_0/g_ae/dec_prelu_2/mul]:130 MUL 6128.738 0.029 0.029 0.000% 56.813% 0.000 1 [device_0/g_ae/dec_prelu_2/mul_1]:131 ADD 6128.767 0.051 0.052 0.000% 56.813% 0.000 1 [device_0/g_ae/dec_prelu_2/add]:132 CONCATENATION 6128.819 0.072 0.074 0.001% 56.814% 0.000 1 [device_0/g_ae/concat_3]:133 RESHAPE 6128.893 0.051 0.051 0.000% 56.814% 0.000 1 [device_0/g_ae/ExpandDims_141]:134 TRANSPOSE_CONV 6128.944 622.775 623.345 5.778% 62.593% 0.000 1 [device_0/g_ae/dec_3/conv2d_transpose1]:135 ADD 6752.290 0.083 0.078 0.001% 62.593% 0.000 1 [device_0/g_ae/dec_3/BiasAdd]:136 RESHAPE 6752.368 0.033 0.033 0.000% 62.594% 0.000 1 [device_0/g_ae/dec_3/Reshape_1;device_0/g_ae/dec_3/Reshape]:137 ABS 6752.401 1.686 1.701 0.016% 62.609% 0.000 1 [device_0/g_ae/dec_prelu_3/Abs]:138 RELU 6754.102 0.040 0.044 0.000% 62.610% 0.000 1 [device_0/g_ae/dec_prelu_3/Relu]:139 SUB 6754.146 0.051 0.053 0.000% 62.610% 0.000 1 [device_0/g_ae/dec_prelu_3/sub]:140 MUL 6754.199 0.047 0.046 0.000% 62.611% 0.000 1 [device_0/g_ae/dec_prelu_3/mul]:141 MUL 6754.245 0.029 0.029 0.000% 62.611% 0.000 1 [device_0/g_ae/dec_prelu_3/mul_1]:142 ADD 6754.275 0.049 0.050 0.000% 62.611% 0.000 1 [device_0/g_ae/dec_prelu_3/add]:143 CONCATENATION 6754.324 0.073 0.072 0.001% 62.612% 0.000 1 [device_0/g_ae/concat_4]:144 RESHAPE 6754.396 0.050 0.044 0.000% 62.612% 0.000 1 [device_0/g_ae/ExpandDims_151]:145 TRANSPOSE_CONV 6754.440 628.852 630.597 5.846% 68.458% 0.000 1 [device_0/g_ae/dec_4/conv2d_transpose1]:146 ADD 7385.037 0.154 0.161 0.001% 68.459% 0.000 1 [device_0/g_ae/dec_4/BiasAdd]:147 RESHAPE 7385.198 0.082 0.084 0.001% 68.460% 0.000 1 [device_0/g_ae/dec_4/Reshape_1;device_0/g_ae/dec_4/Reshape]:148 ABS 7385.282 3.646 3.396 0.031% 68.492% 0.000 1 [device_0/g_ae/dec_prelu_4/Abs]:149 RELU 7388.678 0.104 0.094 0.001% 68.493% 0.000 1 [device_0/g_ae/dec_prelu_4/Relu]:150 SUB 7388.772 0.144 0.124 0.001% 68.494% 0.000 1 [device_0/g_ae/dec_prelu_4/sub]:151 MUL 7388.896 0.096 0.105 0.001% 68.495% 0.000 1 [device_0/g_ae/dec_prelu_4/mul]:152 MUL 7389.001 0.061 0.062 0.001% 68.495% 0.000 1 [device_0/g_ae/dec_prelu_4/mul_1]:153 ADD 7389.064 0.105 0.105 0.001% 68.496% 0.000 1 [device_0/g_ae/dec_prelu_4/add]:154 CONCATENATION 7389.169 0.161 0.159 0.001% 68.498% 0.000 1 [device_0/g_ae/concat_5]:155 RESHAPE 7389.329 0.108 0.111 0.001% 68.499% 0.000 1 [device_0/g_ae/ExpandDims_161]:156 TRANSPOSE_CONV 7389.440 628.827 630.081 5.841% 74.340% 0.000 1 [device_0/g_ae/dec_5/conv2d_transpose1]:157 ADD 8019.521 0.156 0.167 0.002% 74.341% 0.000 1 [device_0/g_ae/dec_5/BiasAdd]:158 RESHAPE 8019.688 0.088 0.091 0.001% 74.342% 0.000 1 [device_0/g_ae/dec_5/Reshape_1;device_0/g_ae/dec_5/Reshape]:159 ABS 8019.779 3.480 3.374 0.031% 74.373% 0.000 1 [device_0/g_ae/dec_prelu_5/Abs]:160 RELU 8023.154 0.103 0.091 0.001% 74.374% 0.000 1 [device_0/g_ae/dec_prelu_5/Relu]:161 SUB 8023.244 0.137 0.119 0.001% 74.375% 0.000 1 [device_0/g_ae/dec_prelu_5/sub]:162 MUL 8023.364 0.099 0.103 0.001% 74.376% 0.000 1 [device_0/g_ae/dec_prelu_5/mul]:163 MUL 8023.467 0.060 0.058 0.001% 74.377% 0.000 1 [device_0/g_ae/dec_prelu_5/mul_1]:164 ADD 8023.525 0.106 0.106 0.001% 74.378% 0.000 1 [device_0/g_ae/dec_prelu_5/add]:165 CONCATENATION 8023.631 0.148 0.138 0.001% 74.379% 0.000 1 [device_0/g_ae/concat_6]:166 RESHAPE 8023.770 0.093 0.087 0.001% 74.380% 0.000 1 [device_0/g_ae/ExpandDims_171]:167 TRANSPOSE_CONV 8023.857 651.548 646.604 5.994% 80.374% 0.000 1 [device_0/g_ae/dec_6/conv2d_transpose1]:168 ADD 8670.461 0.314 0.330 0.003% 80.377% 0.000 1 [device_0/g_ae/dec_6/BiasAdd]:169 RESHAPE 8670.792 0.189 0.197 0.002% 80.379% 0.000 1 [device_0/g_ae/dec_6/Reshape_1;device_0/g_ae/dec_6/Reshape]:170 ABS 8670.989 6.630 6.701 0.062% 80.441% 0.000 1 [device_0/g_ae/dec_prelu_6/Abs]:171 RELU 8677.691 0.197 0.223 0.002% 80.443% 0.000 1 [device_0/g_ae/dec_prelu_6/Relu]:172 SUB 8677.913 0.267 0.326 0.003% 80.446% 0.000 1 [device_0/g_ae/dec_prelu_6/sub]:173 MUL 8678.240 0.213 0.245 0.002% 80.448% 0.000 1 [device_0/g_ae/dec_prelu_6/mul]:174 MUL 8678.485 0.136 0.152 0.001% 80.449% 0.000 1 [device_0/g_ae/dec_prelu_6/mul_1]:175 ADD 8678.637 0.304 0.309 0.003% 80.452% 0.000 1 [device_0/g_ae/dec_prelu_6/add]:176 CONCATENATION 8678.947 0.502 0.511 0.005% 80.457% 0.000 1 [device_0/g_ae/concat_7]:177 RESHAPE 8679.458 0.293 0.300 0.003% 80.460% 0.000 1 [device_0/g_ae/ExpandDims_181]:178 TRANSPOSE_CONV 8679.759 654.751 646.659 5.994% 86.454% 0.000 1 [device_0/g_ae/dec_7/conv2d_transpose1]:179 ADD 9326.419 0.339 0.349 0.003% 86.458% 0.000 1 [device_0/g_ae/dec_7/BiasAdd]:180 RESHAPE 9326.768 0.193 0.189 0.002% 86.459% 0.000 1 [device_0/g_ae/dec_7/Reshape_1;device_0/g_ae/dec_7/Reshape]:181 ABS 9326.958 6.620 6.721 0.062% 86.522% 0.000 1 [device_0/g_ae/dec_prelu_7/Abs]:182 RELU 9333.680 0.203 0.222 0.002% 86.524% 0.000 1 [device_0/g_ae/dec_prelu_7/Relu]:183 SUB 9333.901 0.276 0.330 0.003% 86.527% 0.000 1 [device_0/g_ae/dec_prelu_7/sub]:184 MUL 9334.232 0.243 0.268 0.002% 86.529% 0.000 1 [device_0/g_ae/dec_prelu_7/mul]:185 MUL 9334.500 0.137 0.149 0.001% 86.531% 0.000 1 [device_0/g_ae/dec_prelu_7/mul_1]:186 ADD 9334.650 0.220 0.220 0.002% 86.533% 0.000 1 [device_0/g_ae/dec_prelu_7/add]:187 CONCATENATION 9334.870 0.490 0.516 0.005% 86.537% 0.000 1 [device_0/g_ae/concat_8]:188 RESHAPE 9335.386 0.452 0.454 0.004% 86.542% 0.000 1 [device_0/g_ae/ExpandDims_191]:189 TRANSPOSE_CONV 9335.840 680.204 677.907 6.284% 92.826% 0.000 1 [device_0/g_ae/dec_8/conv2d_transpose1]:190 ADD 10013.748 0.711 0.685 0.006% 92.832% 0.000 1 [device_0/g_ae/dec_8/BiasAdd]:191 RESHAPE 10014.433 0.428 0.430 0.004% 92.836% 0.000 1 [device_0/g_ae/dec_8/Reshape_1;device_0/g_ae/dec_8/Reshape]:192 ABS 10014.864 13.309 13.483 0.125% 92.961% 0.000 1 [device_0/g_ae/dec_prelu_8/Abs]:193 RELU 10028.347 0.538 0.541 0.005% 92.966% 0.000 1 [device_0/g_ae/dec_prelu_8/Relu]:194 SUB 10028.888 0.789 0.783 0.007% 92.973% 0.000 1 [device_0/g_ae/dec_prelu_8/sub]:195 MUL 10029.672 0.541 0.550 0.005% 92.978% 0.000 1 [device_0/g_ae/dec_prelu_8/mul]:196 MUL 10030.222 0.438 0.446 0.004% 92.983% 0.000 1 [device_0/g_ae/dec_prelu_8/mul_1]:197 ADD 10030.669 0.652 0.665 0.006% 92.989% 0.000 1 [device_0/g_ae/dec_prelu_8/add]:198 CONCATENATION 10031.334 0.927 0.923 0.009% 92.997% 0.000 1 [device_0/g_ae/concat_9]:199 RESHAPE 10032.257 0.668 0.685 0.006% 93.004% 0.000 1 [device_0/g_ae/ExpandDims_201]:200 TRANSPOSE_CONV 10032.943 678.263 680.223 6.306% 99.309% 0.000 1 [device_0/g_ae/dec_9/conv2d_transpose1]:201 ADD 10713.166 0.796 0.813 0.008% 99.317% 0.000 1 [device_0/g_ae/dec_9/BiasAdd]:202 RESHAPE 10713.979 0.429 0.438 0.004% 99.321% 0.000 1 [device_0/g_ae/dec_9/Reshape_1;device_0/g_ae/dec_9/Reshape]:203 ABS 10714.417 13.636 13.687 0.127% 99.448% 0.000 1 [device_0/g_ae/dec_prelu_9/Abs]:204 RELU 10728.104 0.549 0.535 0.005% 99.453% 0.000 1 [device_0/g_ae/dec_prelu_9/Relu]:205 SUB 10728.640 0.806 0.783 0.007% 99.460% 0.000 1 [device_0/g_ae/dec_prelu_9/sub]:206 MUL 10729.424 0.737 0.735 0.007% 99.467% 0.000 1 [device_0/g_ae/dec_prelu_9/mul]:207 MUL 10730.158 0.465 0.453 0.004% 99.471% 0.000 1 [device_0/g_ae/dec_prelu_9/mul_1]:208 ADD 10730.612 0.658 0.749 0.007% 99.478% 0.000 1 [device_0/g_ae/dec_prelu_9/add]:209 CONCATENATION 10731.361 1.066 1.035 0.010% 99.487% 0.000 1 [device_0/g_ae/concat_10]:210 RESHAPE 10732.396 0.672 0.690 0.006% 99.494% 0.000 1 [device_0/g_ae/ExpandDims_211]:211 TRANSPOSE_CONV 10733.086 54.263 54.331 0.504% 99.997% 0.000 1 [device_0/g_ae/dec_10/conv2d_transpose1]:212 ADD 10787.417 0.069 0.067 0.001% 99.998% 0.000 1 [device_0/g_ae/dec_10/BiasAdd]:213 TANH 10787.485 0.183 0.190 0.002% 100.000% 0.000 1 [device_0/g_ae/Tanh;device_0/g_ae/dec_10/Reshape_1;device_0/g_ae/dec_10/Reshape]:214 RESHAPE 10787.675 0.020 0.019 0.000% 100.000% 0.000 1 [device_0/g_ae/Tanh]:215 ============================== Top by Computation Time ============================== [node type] [start] [first] [avg ms] [%] [cdf%] [mem KB] [times called] [Name] TRANSPOSE_CONV 3531.774 1319.750 1320.312 12.239% 12.239% 0.000 1 [device_0/g_ae/dec_0/conv2d_transpose1]:102 TRANSPOSE_CONV 10032.943 678.263 680.223 6.306% 18.545% 0.000 1 [device_0/g_ae/dec_9/conv2d_transpose1]:201 TRANSPOSE_CONV 9335.840 680.204 677.907 6.284% 24.829% 0.000 1 [device_0/g_ae/dec_8/conv2d_transpose1]:190 TRANSPOSE_CONV 8679.759 654.751 646.659 5.994% 30.823% 0.000 1 [device_0/g_ae/dec_7/conv2d_transpose1]:179 TRANSPOSE_CONV 8023.857 651.548 646.604 5.994% 36.817% 0.000 1 [device_0/g_ae/dec_6/conv2d_transpose1]:168 TRANSPOSE_CONV 4853.158 637.947 641.441 5.946% 42.763% 0.000 1 [device_0/g_ae/dec_1/conv2d_transpose1]:113 TRANSPOSE_CONV 5495.684 627.682 631.041 5.850% 48.613% 0.000 1 [device_0/g_ae/dec_2/conv2d_transpose1]:124 TRANSPOSE_CONV 6754.440 628.852 630.597 5.846% 54.458% 0.000 1 [device_0/g_ae/dec_4/conv2d_transpose1]:146 TRANSPOSE_CONV 7389.440 628.827 630.081 5.841% 60.299% 0.000 1 [device_0/g_ae/dec_5/conv2d_transpose1]:157 TRANSPOSE_CONV 6128.944 622.775 623.345 5.778% 66.078% 0.000 1 [device_0/g_ae/dec_3/conv2d_transpose1]:135 Number of nodes executed: 216 ============================== Summary by node type ============================== [Node type] [count] [avg ms] [avg %] [cdf %] [mem KB] [times called] TRANSPOSE_CONV 11 7182.535 66.582% 66.582% 0.000 11 CONV_2D 11 3464.608 32.117% 98.698% 0.000 11 ABS 21 105.989 0.983% 99.681% 0.000 21 MUL 42 7.184 0.067% 99.748% 0.000 42 ADD 32 7.069 0.066% 99.813% 0.000 32 RESHAPE 44 6.927 0.064% 99.877% 0.000 44 SUB 21 5.332 0.049% 99.927% 0.000 21 RELU 21 3.670 0.034% 99.961% 0.000 21 CONCATENATION 11 3.556 0.033% 99.994% 0.000 11 TfLiteFlexDelegate 1 0.484 0.004% 99.998% 0.000 1 TANH 1 0.189 0.002% 100.000% 0.000 1 Timings (microseconds): count=14 first=10772507 curr=10781268 min=10735799 max=10838310 avg=1.07876e+07 std=28956 Memory (bytes): count=0 216 nodes observed Delegate internal: ============================== Run Order ============================== [node type] [start] [first] [avg ms] [%] [cdf%] [mem KB] [times called] [Name] DelegateOpInvoke 3531.205 0.469 0.473 100.000% 100.000% 0.000 1 Delegate/RandomStandardNormal:1 ============================== Top by Computation Time ============================== [node type] [start] [first] [avg ms] [%] [cdf%] [mem KB] [times called] [Name] DelegateOpInvoke 3531.205 0.469 0.473 100.000% 100.000% 0.000 1 Delegate/RandomStandardNormal:1 Number of nodes executed: 1 ============================== Summary by node type ============================== [Node type] [count] [avg ms] [avg %] [cdf %] [mem KB] [times called] DelegateOpInvoke 1 0.472 100.000% 100.000% 0.000 1 Timings (microseconds): count=14 first=469 curr=452 min=416 max=565 avg=472.643 std=43 Memory (bytes): count=0 1 nodes observed