Cross-situational word learning model, learning the meanings of words from image features
Python
Switch branches/tags
Nothing to show
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Failed to load latest commit information.
datasets
ibm_model
.gitignore
README.md
example.py
ibm_utils.py
train.py

README.md

IBMVisual

Cross-situational word learning model, learning the meanings of words from image features.

Usage

First you will need to download the image vectors from the image-caption data sets and their corresponding captions. These are made available on http://cs.stanford.edu/people/karpathy/deepimagesent/ and detailed instructions can be found in the /dataset/ subfolder of this repo.

To create the visual word-vectors from the publication [coming up] from the Flickr8k data set you need to run

python train.py vector online f8k train test