v15.1: latest TensorRT library

TRT

• Upgraded to TensorRT 10.2.0.

• Add TensorRT release package (vsmlrt-windows-x64-tensorrt). #102

  This package is a strict subset of the CUDA release package, with cuDNN, cuBLAS libraries and support for ORT_CUDA backend removed.

  It supports TRT, OV_*, ORT_CPU, ORT_DML and NCNN_VK backends.

known issue

• Accoding to the documentation,

  There is an up to 4x performance regression for networks containing "GridSample" ops compared to TensorRT 9.2.

  This affects RIFE and SAFA models.

  vs-mlrt v14.test3 is the latest one that is not affected. This will be fixed in the next release by TensorRT 10.3.0.

General

• Upgraded to CUDA 12.5.0.

vsmlrt.py

• Added support for RIFE v4.17 lite and v4.18 models.

Full Changelog: v15...v15.1