Example demo hanging

[loretoparisi]

I have installed all dependencies, and

cd examples/
./demo.sh

The script has downloaded GloVe glove.840B.300d.txt, but it seems to hangs. No files written in the log folder and no python running on top. Any hint?

[YingyuLiang]

-- Are you using Python 2 or 3? The code only runs under 2.
-- make the folder log

[loretoparisi]

@YingyuLiang By defaults 2.7.10. I have realized and created the log/ folder within the examples/ folder. Is that right?

[YingyuLiang]

Yes I think so.

[loretoparisi]

@YingyuLiang uhm maybe this is the problem:

(.env) [loretoparisi@:mbploreto log]$ ls -l
total 8
-rw-r--r--  1 loretoparisi  staff   0 19 Lug 17:56 output_sim_sif.txt
-rw-r--r--  1 loretoparisi  staff   0 19 Lug 17:56 output_sim_tfidf.txt
-rw-r--r--  1 loretoparisi  staff  64 19 Lug 17:56 output_supervised_sif_proj.txt
(.env) [loretoparisi@:mbploreto log]$ cat output_supervised_sif_proj.txt 
./demo.sh: line 19: ./supervised_sif_proj.sh: Permission denied

I have changes permissions then (.env) [loretoparisi@:mbploreto examples]$ chmod +x supervised_sif_proj.sh

Let's see what happens.

[loretoparisi]

@YingyuLiang It seems it still hangs. I'm running on macOS. I bid that this could be the issue. I'm wondering if it takes time to load the model here

(words, We) = data_io.getWordmap(wordfile)

In other projects I'm using gensim to load glove vectors and it does not take too long normally, but of course the two things can be different.

[YingyuLiang]

Yes, loading the word vectors takes time, especially because the full glove vector file is quite large. You can try to use only a subset of that file, using only the words with large enough frequency.

[loretoparisi]

@YingyuLiang You were right...it's working

word vectors loaded from ../data/glove.840B.300d.txt
word weights computed from ../auxiliary_data/enwiki_vocab_min200.txt using parameter a=-1.000000
remove the first 0 principal components
                    MSRpar2012   0.454328

word vectors loaded from ../data/glove.840B.300d.txt
word weights computed from ../auxiliary_data/enwiki_vocab_min200.txt using parameter a=-1.000000
remove the first 1 principal components
                    MSRpar2012   0.364071

word vectors loaded from ../data/glove.840B.300d.txt
word weights computed from ../auxiliary_data/enwiki_vocab_min200.txt using parameter a=0.001000
remove the first 0 principal components
                    MSRpar2012   0.436383

word vectors loaded from ../data/glove.840B.300d.txt
word weights computed from ../auxiliary_data/enwiki_vocab_min200.txt using parameter a=0.001000
remove the first 1 principal components
                    MSRpar2012   0.356372
...

Closing this then.

[loretoparisi]

NOTE Just for the records, I had an issue with lasagne and theano version
ImportError: cannot import name downsample

that I have solved in this way:

(.env) [loretoparisi@:mbploreto SIF]$ pip install --upgrade https://github.com/Lasagne/Lasagne/archive/master.zip
Collecting https://github.com/Lasagne/Lasagne/archive/master.zip
  Downloading https://github.com/Lasagne/Lasagne/archive/master.zip
     | 235kB 905kB/s
Requirement already up-to-date: numpy in ./.env/lib/python2.7/site-packages (from Lasagne==0.2.dev1)
Installing collected packages: Lasagne
  Found existing installation: Lasagne 0.1
    Uninstalling Lasagne-0.1:
      Successfully uninstalled Lasagne-0.1
  Running setup.py install for Lasagne ... done
Successfully installed Lasagne-0.2.dev1
(.env) [loretoparisi@:mbploreto SIF]$ python -c "import lasagne; print lasagne .__version__"
0.2.dev1

I'm using

(.env) [loretoparisi@:mbploreto SIF]$ python -c "import theano; print theano .__version__"
0.9.0

This because published lasagne has not been updated already to the master, that has been refactored to support the changes in theano module downsample to pool module.