Skip to content

v0.1.0

Choose a tag to compare

View all tags
@briney briney released this 08 Jun 18:12
· 54 commits to main since this release
v0.1.0
0f348e2
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

What's Changed

  • HF-compatible OPLM rewrite: model, training/eval/data tooling, and e2e test suite by @briney in #1
  • Replace flex_attention with SDPA as the sole attention path by @briney in #2
  • Add torch.compile support with DDP crash fix by @briney in #3
  • Add selective activation checkpointing mode by @briney in #4
  • Lower torch floor to >=2.10 by @briney in #5

New Contributors

  • @briney made their first contribution in #1

Full Changelog: v0.0.1...v0.1.0

Contributors

briney
Assets 2
Loading