Skip to content

v1.6.0

Choose a tag to compare

@DimensionSTP DimensionSTP released this 19 Jul 22:01
· 38 commits to main since this release

Adapt weight decay at deepspeed Adam optimizers.
Weight decay hparams tuning.
Model safetensors keep trained dtype.