word2vec in Chapel
Chapel C Shell Python Makefile
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Failed to load latest commit information.
scripts
src
word2vec
.gitignore
README.md

README.md

Chord

Chord is a distributed (using Downpour) implementation of Google's word2vec using Chapel. The project contains both a 'lexical' port of the original word2vec code (word2vec_classic.chpl) and a distributed variant which takes advantage of Chapel's locality features (word2vec_dsgd.chpl).

Setup

Install Chapel. All demo scripts expect a multi-node Chapel installation.

Visit http://chapel.cray.com/download.html and download

To setup Chapel to run locally, add this to your ~/.bash_profile

cd $CHAPEL_HOME
source ./util/setchplenv.sh

export CHPL_COMM=gasnet
export GASNET_SPAWNFN=L
export CHPL_TARGET_ARCH=native

Build Chapel

cd $CHAPEL_HOME
make
make check

Run demo-word.sh on multiple locales:

cd scripts
./demo-word.sh

Run word2vec_classic in local mode:

cd scripts
./demo-word-classic.sh

References

word2vec: https://code.google.com/p/word2vec/ OSX friendly word2vec: https://github.com/dav/word2vec