ArcticTraining v0.0.5
What's Changed
- bump to v0.0.5.dev0 by @sfc-gh-mwyatt in #194
- add openorca and acemath datasets by @sfc-gh-aqiao in #198
- fix lr scheduler for sequence parallel by @sfc-gh-aqiao in #199
- Add random sampling from data sources by @sfc-gh-aqiao in #197
- s/UlyssesPlus/Arctic Long Sequence Training (ALST)/ by @sfc-gh-sbekman in #202
- Fix custom code import error by @sfc-gh-mwyatt in #204
- Fix malformed pyproject.toml by @sfc-gh-mwyatt in #205
- Remove unnecessary assertion by @sfc-gh-jaelee in #206
- Long-context SwiftKV training by @sfc-gh-aqiao in #196
- add ALST paper reference by @sfc-gh-sbekman in #208
- Update SwiftKV configs and data by @sfc-gh-aqiao in #209
- Generalize support for instruct datasets by @sfc-gh-mwyatt in #211
- bump v0.0.5 by @sfc-gh-mwyatt in #212
Full Changelog: v0.0.4...v0.0.5