v0.2.9
What's Changed
- [LoRA] Support
modules_to_saveby @jcao-ai in #213 - fix: exit issue when replica unregister to make total steps larger. by @lfengad in #214
- minor fix: only report val_score if validation is enabled by @jcao-ai in #215
- fix: use kaiming init for lora by @jcao-ai in #216
- chore: pass use_rslora config by @xlu451 in #217
- Refactor activation checkpointing by @jcao-ai in #218
- HF VLMs Support by @kane-vln in #165
- feat: add
deterministicfeature by @jcao-ai in #220 - fix: slurm launch code root found issue. by @lfengad in #221
Full Changelog: v0.2.8...v0.2.9