Issue: IndexError: index out of range in self

[alxhrzg]

Seems to be related to the added special tokens, can be fixed by adding:
model.resize_token_embeddings(len(tokenizer))
See a related issue with BERT: huggingface/transformers#4153

[NONOThingC]

This is aso helpful for
IndexError: index out of range in self
But it is strange that training in gpu seems dont have this problem.

[alxhrzg]

Yes indeed, I opened this issue in a hurry (before I forget) and actually meant IndexError: index out of range in self. I will adjust it accordingly!