&&&& RUNNING TensorRT.trtexec [TensorRT v8501] # /home/zhenghu/Downloads/TensorRT-8.5.1.7.Linux.x86_64-gnu.cuda-11.8.cudnn8.6/TensorRT-8.5.1.7/bin/trtexec --onnx=dsvt_blocks.onnx --saveEngine=dsvt_blocks.engine --device=0 --fp16 --tacticSources=+CUDNN,+CUBLAS,-CUBLAS_LT,+EDGE_MASK_CONVOLUTIONS --minShapes=src:1000x128,set_voxel_inds_tensor_shift_0:2x50x36,set_voxel_inds_tensor_shift_1:2x50x36,set_voxel_masks_tensor_shift_0:2x50x36,set_voxel_masks_tensor_shift_1:2x50x36,pos_embed_tensor:4x2x1000x128 --optShapes=src:24629x128,set_voxel_inds_tensor_shift_0:2x1156x36,set_voxel_inds_tensor_shift_1:2x834x36,set_voxel_masks_tensor_shift_0:2x1156x36,set_voxel_masks_tensor_shift_1:2x834x36,pos_embed_tensor:4x2x24629x128 --maxShapes=src:100000x128,set_voxel_inds_tensor_shift_0:2x5000x36,set_voxel_inds_tensor_shift_1:2x3200x36,set_voxel_masks_tensor_shift_0:2x5000x36,set_voxel_masks_tensor_shift_1:2x3200x36,pos_embed_tensor:4x2x100000x128
[07/07/2023-11:07:31] [I] === Model Options ===
[07/07/2023-11:07:31] [I] Format: ONNX
[07/07/2023-11:07:31] [I] Model: dsvt_blocks.onnx
[07/07/2023-11:07:31] [I] Output:
[07/07/2023-11:07:31] [I] === Build Options ===
[07/07/2023-11:07:31] [I] Max batch: explicit batch
[07/07/2023-11:07:31] [I] Memory Pools: workspace: default, dlaSRAM: default, dlaLocalDRAM: default, dlaGlobalDRAM: default
[07/07/2023-11:07:31] [I] minTiming: 1
[07/07/2023-11:07:31] [I] avgTiming: 8
[07/07/2023-11:07:31] [I] Precision: FP32+FP16
[07/07/2023-11:07:31] [I] LayerPrecisions: 
[07/07/2023-11:07:31] [I] Calibration: 
[07/07/2023-11:07:31] [I] Refit: Disabled
[07/07/2023-11:07:31] [I] Sparsity: Disabled
[07/07/2023-11:07:31] [I] Safe mode: Disabled
[07/07/2023-11:07:31] [I] DirectIO mode: Disabled
[07/07/2023-11:07:31] [I] Restricted mode: Disabled
[07/07/2023-11:07:31] [I] Build only: Disabled
[07/07/2023-11:07:31] [I] Save engine: dsvt_blocks.engine
[07/07/2023-11:07:31] [I] Load engine: 
[07/07/2023-11:07:31] [I] Profiling verbosity: 0
[07/07/2023-11:07:31] [I] Tactic sources: cublas [ON], cublasLt [OFF], cudnn [ON], edge mask convolutions [ON], 
[07/07/2023-11:07:31] [I] timingCacheMode: local
[07/07/2023-11:07:31] [I] timingCacheFile: 
[07/07/2023-11:07:31] [I] Heuristic: Disabled
[07/07/2023-11:07:31] [I] Preview Features: Use default preview flags.
[07/07/2023-11:07:31] [I] Input(s)s format: fp32:CHW
[07/07/2023-11:07:31] [I] Output(s)s format: fp32:CHW
[07/07/2023-11:07:31] [I] Input build shape: set_voxel_inds_tensor_shift_0=2x50x36+2x1156x36+2x5000x36
[07/07/2023-11:07:31] [I] Input build shape: src=1000x128+24629x128+100000x128
[07/07/2023-11:07:31] [I] Input build shape: set_voxel_inds_tensor_shift_1=2x50x36+2x834x36+2x3200x36
[07/07/2023-11:07:31] [I] Input build shape: set_voxel_masks_tensor_shift_0=2x50x36+2x1156x36+2x5000x36
[07/07/2023-11:07:31] [I] Input build shape: pos_embed_tensor=4x2x1000x128+4x2x24629x128+4x2x100000x128
[07/07/2023-11:07:31] [I] Input build shape: set_voxel_masks_tensor_shift_1=2x50x36+2x834x36+2x3200x36
[07/07/2023-11:07:31] [I] Input calibration shapes: model
[07/07/2023-11:07:31] [I] === System Options ===
[07/07/2023-11:07:31] [I] Device: 0
[07/07/2023-11:07:31] [I] DLACore: 
[07/07/2023-11:07:31] [I] Plugins:
[07/07/2023-11:07:31] [I] === Inference Options ===
[07/07/2023-11:07:31] [I] Batch: Explicit
[07/07/2023-11:07:31] [I] Input inference shape: set_voxel_masks_tensor_shift_1=2x834x36
[07/07/2023-11:07:31] [I] Input inference shape: pos_embed_tensor=4x2x24629x128
[07/07/2023-11:07:31] [I] Input inference shape: set_voxel_masks_tensor_shift_0=2x1156x36
[07/07/2023-11:07:31] [I] Input inference shape: set_voxel_inds_tensor_shift_1=2x834x36
[07/07/2023-11:07:31] [I] Input inference shape: set_voxel_inds_tensor_shift_0=2x1156x36
[07/07/2023-11:07:31] [I] Input inference shape: src=24629x128
[07/07/2023-11:07:31] [I] Iterations: 10
[07/07/2023-11:07:31] [I] Duration: 3s (+ 200ms warm up)
[07/07/2023-11:07:31] [I] Sleep time: 0ms
[07/07/2023-11:07:31] [I] Idle time: 0ms
[07/07/2023-11:07:31] [I] Streams: 1
[07/07/2023-11:07:31] [I] ExposeDMA: Disabled
[07/07/2023-11:07:31] [I] Data transfers: Enabled
[07/07/2023-11:07:31] [I] Spin-wait: Disabled
[07/07/2023-11:07:31] [I] Multithreading: Disabled
[07/07/2023-11:07:31] [I] CUDA Graph: Disabled
[07/07/2023-11:07:31] [I] Separate profiling: Disabled
[07/07/2023-11:07:31] [I] Time Deserialize: Disabled
[07/07/2023-11:07:31] [I] Time Refit: Disabled
[07/07/2023-11:07:31] [I] NVTX verbosity: 0
[07/07/2023-11:07:31] [I] Persistent Cache Ratio: 0
[07/07/2023-11:07:31] [I] Inputs:
[07/07/2023-11:07:31] [I] === Reporting Options ===
[07/07/2023-11:07:31] [I] Verbose: Disabled
[07/07/2023-11:07:31] [I] Averages: 10 inferences
[07/07/2023-11:07:31] [I] Percentiles: 90,95,99
[07/07/2023-11:07:31] [I] Dump refittable layers:Disabled
[07/07/2023-11:07:31] [I] Dump output: Disabled
[07/07/2023-11:07:31] [I] Profile: Disabled
[07/07/2023-11:07:31] [I] Export timing to JSON file: 
[07/07/2023-11:07:31] [I] Export output to JSON file: 
[07/07/2023-11:07:31] [I] Export profile to JSON file: 
[07/07/2023-11:07:31] [I] 
[07/07/2023-11:07:31] [I] === Device Information ===
[07/07/2023-11:07:31] [I] Selected Device: Quadro P4000
[07/07/2023-11:07:31] [I] Compute Capability: 6.1
[07/07/2023-11:07:31] [I] SMs: 14
[07/07/2023-11:07:31] [I] Compute Clock Rate: 1.48 GHz
[07/07/2023-11:07:31] [I] Device Global Memory: 8106 MiB
[07/07/2023-11:07:31] [I] Shared Memory per SM: 96 KiB
[07/07/2023-11:07:31] [I] Memory Bus Width: 256 bits (ECC disabled)
[07/07/2023-11:07:31] [I] Memory Clock Rate: 3.802 GHz
[07/07/2023-11:07:31] [I] 
[07/07/2023-11:07:31] [I] TensorRT version: 8.5.1
[07/07/2023-11:07:31] [I] [TRT] [MemUsageChange] Init CUDA: CPU +207, GPU +0, now: CPU 220, GPU 4040 (MiB)
[07/07/2023-11:07:33] [I] [TRT] [MemUsageChange] Init builder kernel library: CPU +121, GPU +22, now: CPU 394, GPU 4081 (MiB)
[07/07/2023-11:07:33] [W] [TRT] CUDA lazy loading is not enabled. Enabling it can significantly reduce device memory usage. See `CUDA_MODULE_LOADING` in https://docs.nvidia.com/cuda/cuda-c-programming-guide/index.html#env-vars
[07/07/2023-11:07:33] [I] Start parsing network model
[07/07/2023-11:07:33] [I] [TRT] ----------------------------------------------------------------
[07/07/2023-11:07:33] [I] [TRT] Input filename:   dsvt_blocks.onnx
[07/07/2023-11:07:33] [I] [TRT] ONNX IR version:  0.0.7
[07/07/2023-11:07:33] [I] [TRT] Opset version:    14
[07/07/2023-11:07:33] [I] [TRT] Producer name:    pytorch
[07/07/2023-11:07:33] [I] [TRT] Producer version: 1.13.1
[07/07/2023-11:07:33] [I] [TRT] Domain:           
[07/07/2023-11:07:33] [I] [TRT] Model version:    0
[07/07/2023-11:07:33] [I] [TRT] Doc string:       
[07/07/2023-11:07:33] [I] [TRT] ----------------------------------------------------------------
[07/07/2023-11:07:33] [W] [TRT] onnx2trt_utils.cpp:377: Your ONNX model has been generated with INT64 weights, while TensorRT does not natively support INT64. Attempting to cast down to INT32.
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [W] [TRT] onnx2trt_utils.cpp:403: One or more weights outside the range of INT32 was clamped
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [W] [TRT] onnx2trt_utils.cpp:403: One or more weights outside the range of INT32 was clamped
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:33] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [W] [TRT] onnx2trt_utils.cpp:403: One or more weights outside the range of INT32 was clamped
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [W] [TRT] onnx2trt_utils.cpp:403: One or more weights outside the range of INT32 was clamped
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:34] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [W] [TRT] onnx2trt_utils.cpp:403: One or more weights outside the range of INT32 was clamped
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [W] [TRT] onnx2trt_utils.cpp:403: One or more weights outside the range of INT32 was clamped
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:35] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_3/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_3/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_3/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_3/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_3/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_3/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_3/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_3/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_3/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_3/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_3/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_3/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_3/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_3/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_3/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_3/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_3/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_3/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_3/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_3/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_3/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_3/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_3/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_3/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_3/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_3/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_3/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_3/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_3/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_3/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_3/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_3/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_3/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_3/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_3/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_3/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_3/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_3/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_3/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_3/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_3/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_3/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [W] [TRT] onnx2trt_utils.cpp:403: One or more weights outside the range of INT32 was clamped
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_3/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_3/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_3/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_3/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_3/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_3/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_3/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_3/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_3/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_3/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_3/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_3/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_3/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_3/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_3/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_3/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_3/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.0/win_attn/self_attn_3/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_3/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_3/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:36] [I] [TRT] /encoder_list.1/win_attn/self_attn_3/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn_3/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn_3/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn_3/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn_3/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn_3/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn_3/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn_3/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn_3/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn_3/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn_3/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn_3/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn_3/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn_3/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn_3/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn_3/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn_3/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn_3/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn_3/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn_3/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn_3/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn_3/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn_3/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn_3/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn_3/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn_3/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn_3/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn_3/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn_3/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn_3/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn_3/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn_3/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn_3/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn_3/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn_3/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn_3/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn_3/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn_3/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn_3/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn_3/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn_3/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn_3/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn_3/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn_3/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn_3/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn_3/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn_3/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn_3/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn_3/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn_3/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn_3/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn_3/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn_3/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn_3/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn_3/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn_3/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn_3/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn_3/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn_3/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn_3/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn_3/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn_3/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn_3/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn_3/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn_3/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn_3/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn_3/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn_3/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn_3/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn_3/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn_3/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn_3/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn_3/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [W] [TRT] onnx2trt_utils.cpp:403: One or more weights outside the range of INT32 was clamped
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn_3/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn_3/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn_3/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn_3/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn_3/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn_3/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] Finish parsing network model
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn_1/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn_2/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn_2/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn_3/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn_3/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.0/win_attn/self_attn_3/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn_3/MatMul_2: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn_3/MatMul: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:37] [I] [TRT] /encoder_list.1/win_attn/self_attn_3/MatMul_1: broadcasting input1 to make tensors conform, dims(input0)=[36,-1,128][NONE] dims(input1)=[1,128,128][NONE].
[07/07/2023-11:07:38] [I] [TRT] [MemUsageChange] Init cuBLAS/cuBLASLt: CPU +195, GPU +76, now: CPU 603, GPU 4111 (MiB)
[07/07/2023-11:07:38] [I] [TRT] [MemUsageChange] Init cuDNN: CPU +111, GPU +48, now: CPU 714, GPU 4159 (MiB)
[07/07/2023-11:07:38] [I] [TRT] Local timing cache in use. Profiling results in this builder pass will not be stored.
[07/07/2023-11:07:38] [W] [TRT] Myelin graph with multiple dynamic values may have poor performance if they differ. Dynamic values are: 
[07/07/2023-11:07:38] [W] [TRT]  voxel_number
[07/07/2023-11:07:38] [W] [TRT]  set_number_shift_1
[07/07/2023-11:07:38] [W] [TRT]  set_number_shift_0
[07/07/2023-11:07:57] [W] [TRT] Myelin graph with multiple dynamic values may have poor performance if they differ. Dynamic values are: 
[07/07/2023-11:07:57] [W] [TRT]  voxel_number
[07/07/2023-11:07:57] [W] [TRT]  set_number_shift_1
[07/07/2023-11:07:57] [W] [TRT]  set_number_shift_0
[07/07/2023-11:10:27] [I] [TRT] Total Activation Memory: 8499760640
[07/07/2023-11:10:27] [I] [TRT] Detected 6 inputs and 1 output network tensors.
[07/07/2023-11:10:27] [W] [TRT] Myelin graph with multiple dynamic values may have poor performance if they differ. Dynamic values are: 
[07/07/2023-11:10:27] [W] [TRT]  voxel_number
[07/07/2023-11:10:27] [W] [TRT]  set_number_shift_1
[07/07/2023-11:10:27] [W] [TRT]  set_number_shift_0
[07/07/2023-11:10:29] [I] [TRT] Total Host Persistent Memory: 224
[07/07/2023-11:10:29] [I] [TRT] Total Device Persistent Memory: 0
[07/07/2023-11:10:29] [I] [TRT] Total Scratch Memory: 1937192448
[07/07/2023-11:10:29] [I] [TRT] [MemUsageStats] Peak memory usage of TRT CPU/GPU memory allocators: CPU 5 MiB, GPU 2344 MiB
[07/07/2023-11:10:29] [I] [TRT] [BlockAssignment] Started assigning block shifts. This will take 8 steps to complete.
[07/07/2023-11:10:29] [I] [TRT] [BlockAssignment] Algorithm ShiftNTopDown took 0.065529ms to assign 7 blocks to 8 nodes requiring 1937195520 bytes.
[07/07/2023-11:10:29] [I] [TRT] Total Activation Memory: 1937195520
[07/07/2023-11:10:29] [W] [TRT] TensorRT encountered issues when converting weights between types and that could affect accuracy.
[07/07/2023-11:10:29] [W] [TRT] If this is not the desired behavior, please modify the weights or retrain with regularization to adjust the magnitude of the weights.
[07/07/2023-11:10:29] [W] [TRT] Check verbose logs for the list of affected weights.
[07/07/2023-11:10:29] [W] [TRT] - 8 weights are affected by this issue: Detected FP32 infinity values and converted them to corresponding FP16 infinity.
[07/07/2023-11:10:29] [W] [TRT] - 116 weights are affected by this issue: Detected subnormal FP16 values.
[07/07/2023-11:10:29] [W] [TRT] - 2 weights are affected by this issue: Detected values less than smallest positive FP16 subnormal value and converted them to the FP16 minimum subnormalized value.
[07/07/2023-11:10:29] [I] [TRT] [MemUsageChange] TensorRT-managed allocation in building engine: CPU +5, GPU +8, now: CPU 5, GPU 8 (MiB)
[07/07/2023-11:10:29] [I] Engine built in 177.526 sec.
[07/07/2023-11:10:29] [I] [TRT] Loaded engine size: 8 MiB
[07/07/2023-11:10:29] [I] [TRT] [MemUsageChange] TensorRT-managed allocation in engine deserialization: CPU +0, GPU +5, now: CPU 0, GPU 5 (MiB)
[07/07/2023-11:10:29] [I] Engine deserialized in 0.00458442 sec.
[07/07/2023-11:10:29] [I] [TRT] [MemUsageChange] TensorRT-managed allocation in IExecutionContext creation: CPU +0, GPU +1847, now: CPU 0, GPU 1852 (MiB)
[07/07/2023-11:10:29] [W] [TRT] CUDA lazy loading is not enabled. Enabling it can significantly reduce device memory usage. See `CUDA_MODULE_LOADING` in https://docs.nvidia.com/cuda/cuda-c-programming-guide/index.html#env-vars
[07/07/2023-11:10:29] [I] Setting persistentCacheLimit to 0 bytes.
[07/07/2023-11:10:29] [I] Using random values for input src
[07/07/2023-11:10:29] [I] Created input binding for src with dimensions 24629x128
[07/07/2023-11:10:29] [I] Using random values for input set_voxel_inds_tensor_shift_0
[07/07/2023-11:10:29] [I] Created input binding for set_voxel_inds_tensor_shift_0 with dimensions 2x1156x36
[07/07/2023-11:10:29] [I] Using random values for input set_voxel_inds_tensor_shift_1
[07/07/2023-11:10:29] [I] Created input binding for set_voxel_inds_tensor_shift_1 with dimensions 2x834x36
[07/07/2023-11:10:29] [I] Using random values for input set_voxel_masks_tensor_shift_0
[07/07/2023-11:10:29] [I] Created input binding for set_voxel_masks_tensor_shift_0 with dimensions 2x1156x36
[07/07/2023-11:10:29] [I] Using random values for input set_voxel_masks_tensor_shift_1
[07/07/2023-11:10:29] [I] Created input binding for set_voxel_masks_tensor_shift_1 with dimensions 2x834x36
[07/07/2023-11:10:29] [I] Using random values for input pos_embed_tensor
[07/07/2023-11:10:30] [I] Created input binding for pos_embed_tensor with dimensions 4x2x24629x128
[07/07/2023-11:10:30] [I] Using random values for output output
[07/07/2023-11:10:30] [I] Created output binding for output with dimensions 24629x128
[07/07/2023-11:10:30] [I] Starting inference
[07/07/2023-11:10:33] [I] Warmup completed 1 queries over 200 ms
[07/07/2023-11:10:33] [I] Timing trace has 11 queries over 3.54909 s
[07/07/2023-11:10:33] [I] 
[07/07/2023-11:10:33] [I] === Trace details ===
[07/07/2023-11:10:33] [I] Trace averages of 10 runs:
[07/07/2023-11:10:33] [I] Average on 10 runs - GPU latency: 313.144 ms - Host latency: 324.287 ms (enqueue 323.046 ms)
[07/07/2023-11:10:33] [I] 
[07/07/2023-11:10:33] [I] === Performance summary ===
[07/07/2023-11:10:33] [I] Throughput: 3.09938 qps
[07/07/2023-11:10:33] [I] Latency: min = 314.565 ms, max = 336.497 ms, mean = 323.728 ms, median = 322.719 ms, percentile(90%) = 336.08 ms, percentile(95%) = 336.497 ms, percentile(99%) = 336.497 ms
[07/07/2023-11:10:33] [I] Enqueue Time: min = 313.293 ms, max = 335.226 ms, mean = 322.506 ms, median = 321.51 ms, percentile(90%) = 334.868 ms, percentile(95%) = 335.226 ms, percentile(99%) = 335.226 ms
[07/07/2023-11:10:33] [I] H2D Latency: min = 9.95068 ms, max = 10.0598 ms, mean = 10.0055 ms, median = 10.0078 ms, percentile(90%) = 10.0544 ms, percentile(95%) = 10.0598 ms, percentile(99%) = 10.0598 ms
[07/07/2023-11:10:33] [I] GPU Compute Time: min = 303.366 ms, max = 325.33 ms, mean = 312.6 ms, median = 311.615 ms, percentile(90%) = 324.887 ms, percentile(95%) = 325.33 ms, percentile(99%) = 325.33 ms
[07/07/2023-11:10:33] [I] D2H Latency: min = 0.961914 ms, max = 1.14014 ms, mean = 1.12219 ms, median = 1.13843 ms, percentile(90%) = 1.13916 ms, percentile(95%) = 1.14014 ms, percentile(99%) = 1.14014 ms
[07/07/2023-11:10:33] [I] Total Host Walltime: 3.54909 s
[07/07/2023-11:10:33] [I] Total GPU Compute Time: 3.4386 s
[07/07/2023-11:10:33] [W] * Throughput may be bound by Enqueue Time rather than GPU Compute and the GPU may be under-utilized.
[07/07/2023-11:10:33] [W]   If not already in use, --useCudaGraph (utilize CUDA graphs where possible) may increase the throughput.
[07/07/2023-11:10:33] [W] * GPU compute time is unstable, with coefficient of variance = 2.41462%.
[07/07/2023-11:10:33] [W]   If not already in use, locking GPU clock frequency or adding --useSpinWait may improve the stability.
[07/07/2023-11:10:33] [I] Explanations of the performance metrics are printed in the verbose logs.
[07/07/2023-11:10:33] [I] 
&&&& PASSED TensorRT.trtexec [TensorRT v8501] # /home/zhenghu/Downloads/TensorRT-8.5.1.7.Linux.x86_64-gnu.cuda-11.8.cudnn8.6/TensorRT-8.5.1.7/bin/trtexec --onnx=dsvt_blocks.onnx --saveEngine=dsvt_blocks.engine --device=0 --fp16 --tacticSources=+CUDNN,+CUBLAS,-CUBLAS_LT,+EDGE_MASK_CONVOLUTIONS --minShapes=src:1000x128,set_voxel_inds_tensor_shift_0:2x50x36,set_voxel_inds_tensor_shift_1:2x50x36,set_voxel_masks_tensor_shift_0:2x50x36,set_voxel_masks_tensor_shift_1:2x50x36,pos_embed_tensor:4x2x1000x128 --optShapes=src:24629x128,set_voxel_inds_tensor_shift_0:2x1156x36,set_voxel_inds_tensor_shift_1:2x834x36,set_voxel_masks_tensor_shift_0:2x1156x36,set_voxel_masks_tensor_shift_1:2x834x36,pos_embed_tensor:4x2x24629x128 --maxShapes=src:100000x128,set_voxel_inds_tensor_shift_0:2x5000x36,set_voxel_inds_tensor_shift_1:2x3200x36,set_voxel_masks_tensor_shift_0:2x5000x36,set_voxel_masks_tensor_shift_1:2x3200x36,pos_embed_tensor:4x2x100000x128