Skip to content

A tutorial for TensorRT overall pipeline optimization from ONNX, TensorFlow Frozen Graph, pth, UFF, or PyTorch TRT) framework.

Notifications You must be signed in to change notification settings

jetson-tx2/NVIDIA-TensorRT-Tutorial

Repository files navigation

pipeline

For conversion to RT we have the following models:

  • model1 = old school tensorflow convolutional network with no concat and no batch-norm
  • model2 = pre-trained resnet50 keras model with tensorflow backend and added shortcuts
  • model3 = modified resnet50 implemented in tensorflow and trained from scratch
  • model4 = pre-trained resnet50 in pytorch

I have added for each a minimalist script which loads the graphs and inferences a random image. One should be able to deduce the name of input/output nodes and related sizes from the scripts.

For the first three scripts, our ML engineers tell me that the errors relate to the incompatibility between RT and the following blocks:

  • Cast
  • Concat
  • Batch_norm

About

A tutorial for TensorRT overall pipeline optimization from ONNX, TensorFlow Frozen Graph, pth, UFF, or PyTorch TRT) framework.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published