This repo contains the analysis results reported in the paper "Grammar Induction with Neural Language Models: An Unusual Replication"
Switch branches/tags
Nothing to show
Clone or download
Latest commit 7fffbe3 Aug 31, 2018
Permalink
Failed to load latest commit information.
data added code Aug 27, 2018
.gitignore added gitignore Aug 27, 2018
LICENSE added code Aug 27, 2018
LSTMCell.py added code Aug 27, 2018
ParsingNetwork.py added code Aug 27, 2018
PredictNetwork.py added code Aug 27, 2018
README.md Added link to arXiv paper Aug 31, 2018
ReadingNetwork.py added code Aug 27, 2018
blocks.py added code Aug 27, 2018
data.py added code Aug 27, 2018
data_ptb.py added code Aug 27, 2018
demo.py added code Aug 27, 2018
hinton.py added code Aug 27, 2018
main_LM.py added code Aug 27, 2018
main_UP.py added code Aug 27, 2018
model_PRPN.py added code Aug 27, 2018
parse_data.py added code Aug 27, 2018
process_input.py added code Aug 27, 2018
test_phrase_grammar.py added code Aug 27, 2018

README.md

PRPN Analysis

This repo contains the output files and analysis results reported in the paper "Grammar Induction with Neural Language Models: An Unusual Replication" [1], where we perform an in-depth analysis of the Parsing Reading Predict Networks [2].

The parsed files can be downloaded here. The parsed files are named in the following way:

  • parsed_{parsed-dataset}{model-type}{train-data}_{earlystop-criterion}.jsonl
  • Example: parsed_WSJ_PRPNUP_WSJFull_ESUP.jsonl

We also share the pretrained model that provides the best F-1 score (PRPN-LM trained on AllNLI with language modeling criterion) which can be downloaded here.

To produce parses using pretrained model: python parse_data.py --data path_to_data --checkpoint path_to_model/model_lm.pt --seed 1111 --eval_data path_to_multinli/multinli_1.0_dev_matched.jsonl --save_eval_path save_path/parsed_MNLI.jsonl

References

[1] Phu Mon Htut, Kyunghyun Cho, Samuel R. Bowman. Grammar Induction with Neural Language Models: An Unusual Replication. To appear in Proceedings of the EMNLP. 2018.

[2] Yikang Shen, Zhouhan Lin, Chin wei Huang, and Aaron Courville. Neural language modeling by jointly learning syntax and lexicon. Proceedings International Conference on Learning Representations. 2018. [code]