TensorRT Samples

Contents

1. "Hello World" Samples

Sample	Language	Format	Description
sampleOnnxMNIST	C++	ONNX	“Hello World” For TensorRT With ONNX
network_api_pytorch_mnist	Python	INetwork	“Hello World” For TensorRT Using Pytorch

2. TensorRT API Samples

Sample	Language	Format	Description
sampleCharRNN	C++	INetwork	Building An RNN Network Layer By Layer
sampleDynamicReshape	C++	ONNX	Digit Recognition With Dynamic Shapes In TensorRT
sampleEditableTimingCache	C++	INetwork	Create a deterministic build using editable timing cache
sampleINT8API	C++	ONNX	Performing Inference In INT8 Precision
sampleNamedDimensions	C++	ONNX	Working with named input dimensions
sampleNonZeroPlugin	C++	INetwork	Adding plugin with data-dependent output shapes
sampleOnnxMnistCoordConvAC	C++	ONNX	Implementing CoordConv with a custom plugin
sampleIOFormats	C++	ONNX	Specifying TensorRT I/O Formats
sampleProgressMonitor	C++	ONNX	Progress Monitor API usage
trtexec	C++	All	TensorRT Command-Line Wrapper: trtexec
engine_refit_onnx_bidaf	Python	ONNX	refitting an engine built from an ONNX model via parsers.
introductory_parser_samples	Python	ONNX	Introduction To Importing Models Using TensorRT Parsers
onnx_packnet	Python	ONNX	TensorRT Inference Of ONNX Models With Custom Layers
simpleProgressMonitor	Python	ONNX	Progress Monitor API usage
python_plugin	Python	INetwork/ONNX	Python-based TRT plugins
non_zero_plugin	Python	INetwork/ONNX	Python-based TRT plugin for NonZero op

3. Application Samples

Sample	Language	Format	Description
detectron2	Python	ONNX	Support for Detectron 2 Mask R-CNN R50-FPN 3x model in TensorRT
efficientdet	Python	ONNX	EfficientDet Object Detection with TensorRT
efficientnet	Python	ONNX	EfficientNet V1 and V2 Classification with TensorRT
tensorflow_object_detection_api	Python	ONNX	TensorFlow Object Detection API Models in TensorRT
yolov3_onnx	Python	ONNX	Object Detection Using YOLOv3 With TensorRT ONNX Backend