An implementation of baselines for multimodal utterance embedding, as described in https://www.aclweb.org/anthology/N19-1267.
Based on original SIF implementation) by Arora et al. (2016, 2017).
Requires Python 3.
configs/ contains JSON files that holds the hyperparameters of the model. To generate some config files, run
python configs/make_configs.py. These will be saved in
Then, to run MMB2,
python simplesif.py configs/multimodal_search/config_0.json $DATASET
For MMB1, set the
python simplesif.py configs/multimodal_search/config_0.json $DATASET --unimodal
python simplesif.py --help for more options`.
This code is released under the MIT License. See LICENSE for more details.