v0.6.3 release

Highlights in this release:

New model architecture supports:
SmolVLM2, GLM4.5V, InternVL3, Falcon-H1, Qwen-Next

New algorithm:
GSPO

What's Changed

• [cross-entropy-loss] Added support for DFT flag by @kashif in #860
• fix(test): update assertions in GLM4 instance patching tests by @vvvdwbvvv in #859
• Fix nan loss error for LigerFusedLinearJSDLoss by @ParagEkbote in #862
• [Cross-entropy] get valid predicted probabilities by @kashif in #864
• Enhance Docs by @ParagEkbote in #867
• Add Classifiers for Liger-Kernel by @ParagEkbote in #869
• docs(mta): suppress invalid sequence syntax warning by @Tcc0403 in #870
• Add GSPO by @BjarniHaukur in #845
• Add GLM4.5V support by @vvvdwbvvv in #863
• A Fix for Issue #872 by @yshenaw in #879
• Add pytest coverage for liger-kernel by @ParagEkbote in #876
• Replace all torch_dtype with dtype by @Tcc0403 in #881
• Update Dev Dependencies by @ParagEkbote in #886
• Fixed AMD CI issue #793 by @DevManpreet5 in #887
• fix(layernorm): remove n_cols upcasting for for torch.compile by @Tcc0403 in #884
• Fix tests and CI by @vaibhavjindal in #882
• Remove daily test cron job by @vaibhavjindal in #890
• [UT] [XPU] Modify the test cases of XPU for triton3.5 by @YangKai0616 in #889
• Add InternVL3 support by @MilkClouds in #878
• fix(flce): add shift_labels as eval mode loss condition by @Tcc0403 in #888
• Add support of Falcon-H1 models for liger kernels by @puneeshkhanna in #900
• Don't deploy mkdocs to fix benchmarking by @vaibhavjindal in #904
• Disable mllama multimodal test in transformers<4.51.0 by @Tcc0403 in #899
• Add flce forward for FalconH1ForCausalLM and missing tests by @Tcc0403 in #903
• feat(ce,flce): decouple gradients computation for no_grad mode by @Tcc0403 in #894
• fix(llama4): Get correct swiglu patch target for llama4 moe layer by @alenawang in #907
• Add PolyNorm operator by @0xtoward in #901
• Copy and paste benchmarks before and after gh-pages deployment by @vaibhavjindal in #909
• Filter out redundant ops/allocations in no_grad mode by @Tcc0403 in #906
• Add support for Qwen3Next model with Liger kernels by @vvvdwbvvv in #912
• refactor(convergence-test): remove unnecessary print by @Tcc0403 in #913
• Enabled the tests glm4v/glm4v_moe for XPU and Fixed the monkey patch error by @YangKai0616 in #914
• [Test][XPU] Added gpu cache cleaning for XPU devices by @Egor-Krivov in #917
• Add SmolVLM2 support by @MilkClouds in #919

New Contributors

• @BjarniHaukur made their first contribution in #845
• @yshenaw made their first contribution in #879
• @DevManpreet5 made their first contribution in #887
• @MilkClouds made their first contribution in #878
• @puneeshkhanna made their first contribution in #900
• @alenawang made their first contribution in #907
• @0xtoward made their first contribution in #901

Full Changelog: v0.6.2...v0.6.3