INT8 calibrator for ONNX model with dynamic batch_size at the input and NMS module at the output. C++ Implementation.

NCNN+Int8+YOLOv4 quantitative modeling and real-time inference

nanodet int8 量化，实测推理2ms一帧！

TensorRT int8 量化部署 yolov5s 模型，实测3.3ms一帧！

Reimplement RetinaFace use C++ and TensorRT

An innovative library for efficient LLM inference via low-bit quantization