Skip to content

4x speed-up using NVIDIA apex, new multi-choice classifier and example for SWAG-like dataset, pytorch v1.0, improved model loading, improved examples...

Compare
Choose a tag to compare
@thomwolf thomwolf released this 14 Dec 14:21
e1bfad4

New:

  • 3-4 times speed-ups in fp16 (versus fp32) thanks to NVIDIA's work on apex (by @FDecaYed)
  • new sequence-level multiple-choice classification model + example fine-tuning on SWAG (by @rodgzilla)
  • improved backward compatibility to python 3.5 (by @hzhwcmhf)
  • bump up to PyTorch 1.0
  • load fine-tuned model with from_pretrained
  • add examples on how to save and load fine-tuned models.