Skip to content
This repository was archived by the owner on Apr 12, 2026. It is now read-only.

Now with mBART translations!

Choose a tag to compare

View all tags
@LoicGrobol LoicGrobol released this 24 Feb 23:01
· 248 commits to main since this release
v0.7.0
21746b0
This commit was signed with the committer’s verified signature.
LoicGrobol L. Grobol
GPG key ID: 0C865B19680C88E9
Verified
Learn about vigilant mode.

The main highlight of this release is the addition of mBART training as a task, so far slightly different from the original one, but similar enough to work in our tests.

Added

  • The --tf32-mode option allows to select the level of NVidia Ampère matmul otpimisations.
  • The --seed option allows to fix a random seed.
  • The mbart task allows training general seq2seq and translation models.
  • A zeldarose command that serves as entry point for both tokenizer and transformer training.

Changed

  • BREAKING --use-fp16 has been replaced by --precision, which allows to also use fp64 and
    bfloat. Previous behaviour can be emulated with --precision 16.
  • Remove the GPU stats logging from the profile mode since Lightning stopped supporting it
  • Switched TOML library from toml to
    tomli
  • BREAKING Bumped the min version of several dependency
    • pytorch-lightning >= 1.8.0
    • torch >= 1.12
  • Bumped max version of several dependency
    • datasets < 2.10
    • pytorch-lightning < 1.9
    • tokenizers < 0.14
Assets 2
Loading