This is a collection of work pertinent to tutorials I have authored for integrating Roberta with fast.ai:
https://medium.com/@devkosal/using-roberta-with-fastai-for-nlp-7ed3fed21f6c
https://medium.com/@devkosal/superglue-roberta-with-fastai-for-rte-task-c362961be957
Python >= 3.7.5
fastai == 1.0.60
transformers == 2.3.0
Update 2020.11: fast.ai has upgraded to v2 since the last update to this repo. For compatibility with the steps below, v2 remains untested. Therefore, usage of v1 is recommended for this repo.