Add support for pure bf16 training.

TYTTYTTYT released this 02 Dec 23:04

· 47 commits to main since this release

8ffdd2f

bf16 training convert all parameters into bfloat16, saving memory significantly.

Assets 2