Skip to content

v0.2.2 - RoBERTa support

Choose a tag to compare

@nreimers nreimers released this 19 Aug 14:38

Updated pytorch-transformers to v1.1.0. Adding support for RoBERTa model.

Bugfixes:

  • Critical bugfix for SoftmaxLoss: Classifier weights were not optimized in previous version
  • Minor fix for including the timestamp of the output folders