v3.3.0

• Features:
  • Enabled data-aware compression methods (AWQ, GPTQ, Scale Estimation, and LoRA Correction) for all bit widths < 4, including INT2 and INT3 (#4131).
  • (OpenVINO) Added INT2 and INT3 symmetric compression types (#4123).
  • (OpenVINO) Added the GroupedMatMul operation support for data-free weight compression (#4130).
  • (ONNX) Added FP8 support for the ONNX backend (#4072).
• Fixes:
  • Fixed the aggregator formula for the HAWQ sensitivity metric used in mixed-precision weight compression (#4106).
  • Fixed the compression range for asymmetric compression when all weight values are positive or negative (#4074).
  • Fixed weight serialization to support safetensors >= 0.8.0 by converting NumPy scalars to arrays before saving (#4094).
• Tutorials:
  • Post-Training Optimization of OmniVoice Model
  • Post-Training Optimization of HunyuanOCR Model
  • Post-Training Optimization of Unlimited-OCR Model
  • Post-Training Optimization of Bernini-R
• Deprecations/Removals:
  • Removed unused code, including the Statistics, NNCFDataLoader, QuantizersCounter, and QuantizationStatistics classes, and the PyTorch patch_torch_operators, register_module, and PTInitializingDataLoader (#4093).
  • (PyTorch) Removed the unused CompressionParameter class (#4108).
• Requirements:
  • Updated onnx to 1.22.0 (#4101).
  • Updated networkx to <= 3.6.1 (#4059).