Release 1.8.1

wenmengzhou released this 03 Aug 08:47

· 1019 commits to master since this release

65d4f07

bugfix for qwen

streamer pass error
check flash attention installation even if use_fast_att is set True
fix quantization model run failed

Assets 2