The requirements are listed in the requirements.txt file.
$ conda create -n thunder python=3.8 anaconda
$ conda activate thunder
$ pip install -r requirements.txt
Download the pretrained RoBERTa-base using the script.
./clone.sh
- Anaconda Python 3.8.5
- Pytorch 2.0.1
- NVIDIA RTX 3090 GPU
The datasets are in the data directory.
The scripts are in the scripts directory.