Skip to content

v0.1.3
Compare
Choose a tag to compare
@warner-benjamin warner-benjamin released this 07 Jun 16:44
· 67 commits to main since this release
v0.1.3
7c5f557

Optimizers

  • Adds Sophia & StableAdam optimizers
  • Adds native fastai support for bitsandbytes 8-bit optimizers
  • Reduce ForEach L2 weight decay and RAdam, LAMB, & Ranger optimizer memory usage
  • Increase LAMB step speed

Other Features

  • Add asynchronous fastai batch transforms to the FFCV Loader
  • Add DynamoExplain callback for diagnosing torch.compile results

Full Changelog: v0.1.2...v0.1.3

Assets 2