Requirements

Tested on Python 3.11. Create an environment and install the requirements with:

pip install -r requirements.txt

Data

Download the dataset and extract it into a folder called data in the root of the project.

Model checkpoints

Please send a request to the author to obtain the model checkpoints.

Training

To train the LSTM and transformer models, run the following commands:

python train.py --model [lstm|transformer] 

To train the N-gram model, run the following command:

python ngram_classifier.py

Experiments

To run the experiments, run the following command:

python experiments.py --model [lstm|transformer] --experiment [experiment_name]