v1.3.0
What's new
Added π
- Added
torchaoto the Docker/Beaker images. - Added support for
torchaofloat8training via theFloat8HandlerCallback. - Added
Callback.post_attach()method.
Commits
8c03ca8 Add support for float8 training via torchao (#54)
2f253f8 Minor updates to precision settings for official configs, add torchao to Docker/Beaker image (#53)
7e3ddd4 increase batch size for 13B