You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
We found that in the version of transformers>=4.25.1, the first entry of objectives' evaluation loss gets a value of 0 (zero). This can cause preliminary early stopping in training configuration with StoppingStrategy.FIRST_OBJECTIVE_CONVERGED where no Evaluator(decides_convergence=True) is given among the Objective(val_evaluators).
Subsequently, the evaluation loss, logged with any training objective will look like on the picture below.
This behaviour is likely caused by a change in the implementation of transformers' Trainer after version 4.19.1 (where this issue does not occur) and before 4.25.1 where it has been registered.
After the issue is fixed, do not forget to open the required version of transformers in the adapter's setup.cfg; We temporarily fix it to version 4.19.1.
The text was updated successfully, but these errors were encountered:
We found that in the version of
transformers>=4.25.1
, the first entry of objectives' evaluation loss gets a value of 0 (zero). This can cause preliminary early stopping in training configuration withStoppingStrategy.FIRST_OBJECTIVE_CONVERGED
where noEvaluator(decides_convergence=True)
is given among theObjective(val_evaluators)
.Subsequently, the evaluation loss, logged with any training objective will look like on the picture below.
This behaviour is likely caused by a change in the implementation of transformers'
Trainer
after version 4.19.1 (where this issue does not occur) and before 4.25.1 where it has been registered.After the issue is fixed, do not forget to open the required version of
transformers
in theadapter
'ssetup.cfg
; We temporarily fix it to version 4.19.1.The text was updated successfully, but these errors were encountered: