Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

TensorRT no longer has NvUtils.h - build from source is failing #68360

Open
BAlmeidaS opened this issue May 21, 2024 · 0 comments
Open

TensorRT no longer has NvUtils.h - build from source is failing #68360

BAlmeidaS opened this issue May 21, 2024 · 0 comments
Assignees
Labels
comp:gpu:tensorrt Issues specific to TensorRT stat:awaiting tensorflower Status - Awaiting response from tensorflower TF 2.16 type:build/install Build and install issues

Comments

@BAlmeidaS
Copy link

BAlmeidaS commented May 21, 2024

Issue type

Build/Install

Have you reproduced the bug with TensorFlow Nightly?

No

Source

source

TensorFlow version

tf 2.16.1

Custom code

Yes

OS platform and distribution

Linux Arch

Mobile device

No response

Python version

3.12.3

Bazel version

6.5.0

GCC/compiler version

14.1.1

CUDA/cuDNN version

12.4

GPU model and memory

RTX 4090 - 24gb

Current behavior?

While building from source, when I specify to use Tensorrt 10.0.1, the bazel configuration uses the header files from version 8 (https://github.com/tensorflow/tensorflow/blob/master/third_party/tensorrt/tensorrt_configure.bzl#L50-L65), which were changed in major 9 of Tensorrt (https://github.com/NVIDIA/TensorRT/tree/v9.1.0/include).

There is no longer NvUtils.h and a new header NvOnnxConfig.h (since 9.x.x and still like this on TensorRT 10).

I believe that either a new configuration must be created to support TensorRT 9.x.x and 10.x.x, or you should specify that Tensorflow only accepts TensortRT <= 8.6.

Standalone code to reproduce the issue

USE_BAZEL_VERSION=6.5.0 bazel build //tensorflow/tools/pip_package/v2:wheel --repo_env=WHEEL_NAME=tensorflow --config=cuda --jobs=30 --verbose_failuresj

Relevant log output

No response

@google-ml-butler google-ml-butler bot added the type:build/install Build and install issues label May 21, 2024
@SuryanarayanaY SuryanarayanaY added TF 2.16 comp:gpu:tensorrt Issues specific to TensorRT labels May 22, 2024
@tilakrayal tilakrayal added the stat:awaiting tensorflower Status - Awaiting response from tensorflower label Jun 14, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
comp:gpu:tensorrt Issues specific to TensorRT stat:awaiting tensorflower Status - Awaiting response from tensorflower TF 2.16 type:build/install Build and install issues
Projects
None yet
Development

No branches or pull requests

5 participants