int8
Here are 11 public repositories matching this topic...
development quantization framework
-
Updated
Sep 9, 2023 - Python
quantization example for pqt & qat
-
Updated
Jul 24, 2023 - Python
A LLaMA2-7b chatbot with memory running on CPU, and optimized using smooth quantization, 4-bit quantization or Intel® Extension For PyTorch with bfloat16.
-
Updated
Feb 27, 2024 - Python
TensorRT Int8 Python version sample. TensorRT Int8 Python 实现例子。TensorRT Int8 Pythonの例です
-
Updated
Jan 28, 2019 - Python
👀 Apply YOLOv8 exported with ONNX or TensorRT(FP16, INT8) to the Real-time camera
-
Updated
May 23, 2024 - Python
a simple pipline of int8 quantization based on tensorrt.
-
Updated
Oct 14, 2022 - Python
SOTA low-bit LLM quantization (INT8/FP8/INT4/FP4/NF4) & sparsity; leading model compression techniques on TensorFlow, PyTorch, and ONNX Runtime
-
Updated
Jul 22, 2024 - Python
Improve this page
Add a description, image, and links to the int8 topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the int8 topic, visit your repo's landing page and select "manage topics."