xInfer v0.14.2

github-actions released this 02 Aug 12:24

· 11 commits to main since this release

5665c22

What's Changed

Support per-tensor fp8 weight scale by @guoqingbao in #457
Support quant_method of modelopt_mixed by @guoqingbao in #458
Improve ISQ and nvfp4 model precision & add kernel precision test suite by @guoqingbao in #464

Full Changelog: v0.14.1...v0.14.2

Contributors

guoqingbao

Assets 29