Skip to content
No description, website, or topics provided.
Branch: master
Clone or download
Latest commit 08a17a7 Feb 6, 2019
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
LICENSE Create LICENSE Feb 6, 2019
README.md add eval script Jul 24, 2018
analyze.sh fixing some formatting Jun 12, 2018
anonymization.py clean up anonymization.py Jun 13, 2018
anonymization.txt anon files Jun 12, 2018
atis_batch.py method name mismatch Oct 15, 2018
atis_data.py atis data Jun 18, 2018
atis_vocab.py more files Jun 12, 2018
attention.py more files Jun 12, 2018
cpu_full_interactions.txt list of interaction IDs that can only run on (my) CPU as opposed to G… Jul 24, 2018
dataset_split.py more files Jun 12, 2018
decoder.py more files Jun 12, 2018
delete_all_experiments.py scripts for removing/deleting experiments from crayon Jul 24, 2018
dynet_utils.py more files Jun 12, 2018
embedder.py more files Jun 12, 2018
encoder.py more files Jun 12, 2018
entities.py more files Jun 12, 2018
entities.txt more files Jun 12, 2018
eval.sh add eval script Jul 24, 2018
interaction.py more files Jun 12, 2018
interaction_model.py atis data Jun 18, 2018
logger.py lgoger Jun 18, 2018
metric_averages.py add eval script Jul 24, 2018
metrics.py more files Jun 12, 2018
model.py small lint errors Jun 12, 2018
model_util.py edits Jun 18, 2018
params_util.py more files Jun 12, 2018
parse_args.py Fixed mistake where it was only updating on one interaction! Oct 11, 2018
remove_experiment.py scripts for removing/deleting experiments from crayon Jul 24, 2018
run.py Remove break after first epoch... Oct 12, 2018
snippets.py more files Jun 12, 2018
sql_util.py more files Jun 12, 2018
token_predictor.py more files Jun 12, 2018
tokenizers.py more files Jun 12, 2018
train.sh separate train/val sh Jul 24, 2018
util.py more files Jun 12, 2018
utterance.py
utterance_model.py more files Jun 12, 2018
visualize_attention.py fixing some formatting Jun 12, 2018
vocabulary.py Clean up vocabulary.py Jun 13, 2018

README.md

atis

This is the code associated with the paper:

Learning to map context dependent sentences to executable formal queries. Alane Suhr, Srinivasan Iyer, and Yoav Artzi. In NAACL, 2018. paper bib

I will be slowly adding and documenting the code. Please open an issue if you have any questions about the code or getting it to run.

If you want access to the data, code for preprocessing it, and the database to execute the queries, please email me (suhr@cs.cornell.edu). ATIS comprises LDC93S5, LDC94S19, and LDC95S26.

The main file is run.py. You can train with my parameters by calling train.sh, and evaluate by calling eval.sh (but will need to provide the save file name, and you can edit this script so that it selects segments from gold queries instead, as well as evaluating on different splits of the data).

Memory

Depending on your machine setup, you might not be able to run evaluation on all of the interactions on the GPU. The file cpu_full_interactions.txt contains the list of interactions that will only fit on CPU memory for an NVIDIA Tesla V100 GPU (16GB of RAM per GPU). You can add to this list if you are running into memory problems, and these interactions will be ignored during training and evalution. To predict on them, run evaluation with the --no_gpus flag set to true, and only these interactions will be evaluated (you can concatenate the output files for both runs to evaluate predictions on both sets of interactions).

Prerequisites

You need Crayon installed and running. See this page for details. If you don't want to use Crayon, you can comment it out. You can use the provided scripts remove_experiments.py and delete_all_experiments.py in order to remove old experiments.

You can’t perform that action at this time.