Transformer encoder-decoder for emotion detection in dialogues
To run the model on test sets of four datasets,
- Download the pre-trained models save.zip , unzip the zip file to ./TodKat/save
- Locate to the ./TodKat/src and execute the following command in terminal:
python TodKat_dd.pyfor DailyDialogue.python TodKat_emory.pyfor EmoryNLP.python TodKat_iemocap.pyfor IEMOCAP.python TodKat_meld.pyfor MELD.
Bug fix: the sklearn was used erroneously, causing the unusual high macro-F1s of MELD and EMORY. A hot fix is provided. Below lists the updated performance:
| MELD | EMORY | ||
|---|---|---|---|
| avg-macro-F1 | micro-F1 | avg-macro-F1 | micro-F1 |
| 0.6547 | 0.6724 | 0.3869 | 0.4238 |
To validate, simply download the saved model and run the code.
Here comes the detailed instructions on how to perform training, testing and prediction.
torch==1.7.0 transformers==4.0.0 csv typing numpy tqdm pandas ipython ftfy==5.1
Model runs on GPU by default with cuda:0. Please change device if going to train on CPU. Saved models are trained with cuda:0, change the configurations in the saved model if you want to run them on another device.
Download the save.zip and put the 'topic-language-model-<dd|emory|iemocap|meld>' folder in the '../datasets/' directory.
Uncomment TodKat_dd line 613 - line 705 to train model on DailyDialog.
Uncomment TodKat_emory line 613 - line 705 to train model on EmoryNLP.
Uncomment TodKat_iemocap line 614 - line 708 to train model on IEMOCAP.
Uncomment TodKat_meld line 614 - line 708 to train model on MELD.
Comment TodKat_dd line 613 - line 705 and uncomment line 707 - 738 on DailyDialog.
Comment TodKat_emory line 613 - line 705 and uncomment line 707 - 744 on EmoryNLP.
Comment TodKat_iemocap line 614 - line 708 and uncomment line 710 - 741 on IEMOCAP.
Comment TodKat_meld line 614 - line 708 and uncomment line 710 - 742 on MELD.
Comment TodKat_dd line 613 - line 705 and uncomment line 707 - 742 on DailyDialog.
Comment TodKat_emory line 613 - line 705 and uncomment line 707 - 748 on EmoryNLP.
Comment TodKat_iemocap line 614 - line 708 and uncomment line 710 - 745 on IEMOCAP.
Comment TodKat_meld line 614 - line 708 and uncomment line 710 - 746 on MELD.