v0.7.0

🚀 Liger-Kernel Now Fully Supports Transformers v5

We’ve added full support for Transformers v5!
🔗 #994

Liger now supports all 🤗 Transformers versions ≥ 4.52.0, including the latest v5 release.

Broader compatibility. Seamless upgrades. No version headaches.

Thanks to all the contributors!

What's Changed

• Add CISPO loss type support for LigerFusedLinearGRPOLoss by @yukiu00 in #1054
• Update checkstyle and fix the format issue by @xuedinge233 in #1071
• Add SAPO loss type support for LigerFusedLinearGRPOLoss by @yukiu00 in #1073
• [NPU]: Adaptive modification of NPU by @TianHao324 in #1055
• [NPU] Frequencies fusion for Llama4_rope on NPU by @lowdy1 in #1053
• Add CISPO and SAPO loss type support for Triton GRPO loss kernel by @yukiu00 in #1074
• Add vLLM importance sampling ratio support for GRPO loss by @yukiu00 in #1088
• Relaxing logp relative tolerances for mini-llama4 to fix flaky test. by @kolehma8 in #1089
• Moving unit testing to a merge queue. by @kolehma8 in #1069
• Fixing unit tests. by @kolehma8 in #1092
• Merge queue test. by @kolehma8 in #1095
• Changes to the nvidia tests in merge queue. by @kolehma8 in #1097
• Support transfomers v5 by @Tcc0403 in #994
• Remove latest v4 test to reduce cost by @Mecoli1219 in #1098
• [Model] Pixtral Support by @AndreSlavescu in #253
• [NPU]: NPU-optimized rms_norm kernel by @TianHao324 in #1099
• [NPU]: NPU-optimized fused_add_rms_norm kernel by @TianHao324 in #1070
• [NPU]: add support for grpo loss by @TianHao324 in #1049
• Update pyproject.toml for v0.7.0 release by @vaibhavjindal in #1102

New Contributors

• @xuedinge233 made their first contribution in #1071

Full Changelog: v0.6.5...v0.7.0