Skip to content
master
Switch branches/tags
Code

Latest commit

 

Git stats

Files

Permalink
Failed to load latest commit information.
Type
Name
Latest commit message
Commit time
 
 
 
 
 
 
 
 
 
 
 
 
 
 

An Empirical Study of Content Understanding in Conversational Question Answering

This is the repository for the AAAI 2020 paper An Empirical Study of Content Understanding in Conversational Question Answering.

Get Dataset

To get the original CoQA/QuAC dataset and the attacked CoQA/QuAC dataset, run

bash get-dataset.sh

Then the attacked dataset can be found at

data/coqa/dev-attack.json
data/quac/val_v0.2-attack.json

Or one can simply use the scripts to apply the attacked dataset:

python3 scripts/attack_quac.py [input path] [output path]
python3 scripts/attack_coqa.py [input path] [output path]

Prepare GloVe

mkdir glove
wget http://nlp.stanford.edu/data/glove.840B.300d.zip -O glove/glove.840B.300d.zip
unzip glove/glove.840B.300d.zip -d glove

BERT Experiments

Preprocess

cd BERT/src/
python make_dataset.py ../data/quac-bert
python make_dataset.py ../data/quac-bert-attack

Train & Predict & Calculate Score

To train:

cd BERT/src/
bash train.sh

To predict:

cd BERT/src/
bash predict.sh

To calculate score:

cd BERT/src/
bash score.sh

FlowQA Experiments

Prepreocess

bash preprocess_QuAC.sh
bash preprocess_CoQA.sh

Train & Predict & Calculate Score

To train:

cd FlowQA/
bash train_QuAC.sh
bash train_CoQA.sh

To predict:

cd FlowQA
bash predict-coqa.sh
bash predict-quac.sh

SDNet Experiments

SDNet training/model code is modified from the official repo.

Preparation

Download BERT model from here, extract it and move it under SDNet/bert-base-cased.

wget https://s3.amazonaws.com/models.huggingface.co/bert/bert-base-cased.tar.gz
tar -zxvf bert-base-cased.tar.gz -C SDNet/bert-base-cased

Train & Predict & Calculate Score

To train:

cd SDNet/
bash train.sh

To predict:

cd SDNet/
bash predict.sh

To calculate score:

cd SDNet/
bash score.sh

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published