Skip to content

intel/neural-compressor

Error
Looks like something went wrong!

About

SOTA low-bit LLM quantization (INT8/FP8/INT4/FP4/NF4) & sparsity; leading model compression techniques on TensorFlow, PyTorch, and ONNX Runtime

intel.github.io/neural-compressor/

Topics

sparsity pruning quantization knowledge-distillation auto-tuning int8 low-precision quantization-aware-training post-training-quantization awq int4 large-language-models gptq smoothquant sparsegpt fp4 mxformat

Resources

Readme

License

Apache-2.0 license

Security policy

Security policy
Activity
Custom properties

Stars

2.4k stars

Watchers

32 watching

Forks

270 forks
Report repository

Releases 43

Intel Neural Compressor Release 3.4 Latest
May 23, 2025
+ 42 releases

Contributors 140

+ 126 contributors

Languages