You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
For Triton Nvidia Inference Server version bigger than 24.01 (started with 24.02) the supported version of tensorrt is 8.6.3.1. I am using tensorrt python package and script to convert onnx weights to trt engine, but the last available version in pypy is 8.6.1.6 and because of this I can't use tensorrt_backend in triton and got this error:
The engine plan file is not compatible with this version of TensorRT,
expecting library version 8.6.3.1 got 8.6.1.6, please rebuild.
Is it possible to upload this package version (8.6.3.1) to pypy? Or how can I rewrite this script using other tools?
The text was updated successfully, but these errors were encountered:
aptmess
changed the title
TensorRT 8.6.3.1 package in Python for Triton Nvidia Inference Server version > 24.01
TensorRT 8.6.3.1 package in Python PyPy for Triton Nvidia Inference Server version > 24.01
May 13, 2024
Description
For Triton Nvidia Inference Server version bigger than
24.01
(started with24.02
) the supported version of tensorrt is8.6.3.1
. I am using tensorrt python package and script to convertonnx
weights totrt
engine, but the last available version in pypy is8.6.1.6
and because of this I can't usetensorrt_backend
in triton and got this error:Is it possible to upload this package version (
8.6.3.1
) to pypy? Or how can I rewrite this script using other tools?Steps To Reproduce
pip install tensorrt==8.6.1.6
Linked issue
Tasks
The text was updated successfully, but these errors were encountered: