Pinned

1. NVIDIA/TensorRT NVIDIA/TensorRT Public

   NVIDIA® TensorRT™ is an SDK for high-performance deep learning inference on NVIDIA GPUs. This repository contains the open source components of TensorRT.

   C++ 9.3k 2k

2. dnn-cookbook dnn-cookbook Public

   Network Interpretation, include deploy

   Jupyter Notebook 3

3. tensorrt-insight tensorrt-insight Public

   deep insight tensorrt

   C++ 1

4. xinfer xinfer Public

   infer engine

   C++ 3

5. NVIDIA/FasterTransformer NVIDIA/FasterTransformer Public

   Transformer related optimization, including BERT, GPT

   C++ 5.5k 864

6. pytorch-quantization pytorch-quantization Public

   QAT

   Python 1