Use BERT for event extraction and Use R_drop for data augmentation dateset:ACE 2005 corpus
1.ACE 2005 dataset in the same format as the [data/sample.json]
2.Install the packages.
pip install pytorch==1.0 pytorch_pretrained_bert==0.6.1 numpy
python train.py
python eval.py --model_path=latest_model.pt
Method | Trigger Classification (%) | Argument Classification (%) | ||||
---|---|---|---|---|---|---|
Precision | Recall | F1 | Precision | Recall | F1 | |
JRNN | 66.0 | 73.0 | 69.3 | 54.2 | 56.7 | 55.5 |
JMEE | 76.3 | 71.3 | 73.7 | 66.8 | 54.9 | 60.3 |
BERT base | 63.4 | 71.1 | 67.7 | 48.5 | 34.1 | 40.0 |
This model (BERT base + R_Drop) | 64.8 | 74.6 | 69.4 | 52.1 | 35.0 | 41.9 |