V0.14.0 release

Highlights

• [Model Free] Add MXFP mix-precision quantization and support RoutedExperts by @xin3he in #1921
• [Model Free] Implement AutoScheme support for model-free packing by @xin3he in #1990
• Support Wan2.2 S2V Quantization by @changwangss in #1924
• Add other non-integer scheme support for AWQ by @WeiweiZhang1 in #1892
• DDP for multiple cards by @yiliu30 in #1897

Bug fixes and Improvements

• Refine code to support all devices in torch and hot fix for gemma4-unified by @wenhuach21 in #1879
• Feat: add MXFP4/MXFP8 quantization support (llmc_compressor format) and related tests by @xin3he in #1865
• Fix slow startup time of pytest coverage for unit tests by @XuehaoSun in #1899
• Feat: improve review-pr skill score from 76% to 90% by @yogesh-tessl in #1901
• Fix rotation issue by @wenhuach21 in #1903
• Enable MXFP clamp for model free by @xin3he in #1914
• Refactor and support for multi algorithms fusion by @n1ck-guo in #1920
• Enhance b70 check by @yiliu30 in #1937
• Refine AutoScheme logic for gguf, reduce memory consumption and improve speed by @wenhuach21 in #1916
• Fix SIGSEGV in pack-weight unpack/GEMM on malformed blob by @luoyu-intel in #1928
• Update PyTorch and torchvision versions to 2.12.1 and 0.27.1 by @XuehaoSun in #1943
• Fix few gguf bugs of hf-name and checkpoint name by @n1ck-guo in #1939
• Fix saving hadamard rotation model without rotation config by @lkk12014402 in #1933
• Implement shard parallelism configuration and update documentation by @xin3he in #1942
• Use shared tokenizer save helper in exporters by @changwangss in #1951
• Fix auto_scheme gguf format wrong bits if use tiny model by @n1ck-guo in #1953
• Adapt the latest sglang integration test Engine kwargs. by @changwangss in #1964
• [ARK] Add varlen support for sdpa and update tests by @luoyu-intel in #1957
• Add the wrapper for woqgemm by @Zhenzhong1 in #1965
• Skip fused_moe replacement when llm-compressor oneshot already linearizes experts by @changwangss in #1966
• Fix layer_config bug and CI unstable issue by @xin3he in #1949
• Fix gguf cuda ut by @n1ck-guo in #1975
• Rename the base rotation (deterministic/random hadamard) directory name. by @lkk12014402 in #1956
• Fix: avoid silent weight loss when OffloadManager fails to save a block by @xin3he in #1982
• Fix: promote None-initialized kwarg to list in forward_capture by @ramkrishs in #1979
• Fix few bugs cause less accuracy of gguf format by @n1ck-guo in #1960
• Fix: use spawn instead of fork for dataset subprocess on macOS by @ramkrishs in #1980
• [AutoScheme] Fix lm_head no_grad issue and support MOE model with shared mix_score by @xin3he in #1971
• Update CUDA UT to cu130 by @XuehaoSun in #1992
• Enable auto-round-bot for CI comments by @chensuyue in #1993
• Feat: add return_lse support for SDPA and SAGEV1 kernel — enable sequence-parallel (Ring Attention) merge by @luoyu-intel in #1991
• Fix cuda ut fail caused by used instructions for base model by @n1ck-guo in #1994
• Update rotation doc. by @lkk12014402 in #1999

New Contributors

• @yogesh-tessl made their first contribution in #1901
• @Entrpi made their first contribution in #1909
• @ramkrishs made their first contribution in #1979

Full Changelog: v0.13.1...v0.14.0