Code of Retrofitting Contextualized Word Embeddings with Paraphrases.
Make sure your local environment has the following installed:
Python3
tensorflow >= 1.5.0
h5py==2.8.0
Install the dependents using:
pip install -r requirements.txt
To run the experiments, use:
python ./run/run.py --data_path data.pk --options_file elmo_option_file
--weight_file elmo_weight_file --vocab_file elmo_vocabulary_file --token_emb_file elmo_token_embedding_file
Dataset used in experiements:
Microsoft paraphrase dataset: https://www.microsoft.com/en-us/download/details.aspx?id=52398
Quora paraphrase dataset: https://www.quora.com/q/quoradata/First-Quora-Dataset-Release-Question-Pairs
Please use src/data.py to generate data pickle.
TBC