1.1.0

github-actions released this 18 Jul 12:15

29e57d3

Support HYV3ForCausalLM
Reduced CPU overhead for TP mode and improved prefill performance in native backend
Adjust top-P=1 sampling to match implicit truncating behavior of torch.multinomial
Banned strings now supported for recurrent models
Bugfixes and QoL improvements

Full Changelog: v1.0.0...v1.1.0

Assets 52