Skip to content

v0.7.0

Choose a tag to compare

@danny-mio danny-mio released this 12 Feb 23:21
· 4 commits to main since this release
Immutable release. Only release title and notes can be modified.
v0.7.0
42ecebb

Fixes

  • Restore R1 penalty gradients for discriminator regularization
  • Fix gradient accumulation to zero grads only at accumulation boundaries
  • Add tokenizer fallback for batch_encode_plus compatibility

Testing

  • Stabilize dataset tests by ensuring tokenizer call returns tensor encodings