Error on fresh install of latest version

[bornakke]

Cloning the last github version, running build_release and starting hyphe keeps giving me the following error:

Starting Hyphe's Java Memory Structure...
...started...
ERROR: Could not start Hyphe's backend server properly. See log below:

at fr.sciencespo.medialab.hci.memorystructure.thrift.ThriftServer.initializeMemoryStructure(ThriftServer.java:138)
at fr.sciencespo.medialab.hci.memorystructure.thrift.ThriftServer.main(ThriftServer.java:49)

2014-03-29 20:36:27.553/CET [main] WARN fr.sciencespo.medialab.hci.memorystructure.thrift.ThriftServer - Could not find log.level either from memorystructure.properties or from command line arguments.
2014-03-29 20:36:27.553/CET [main] WARN fr.sciencespo.medialab.hci.memorystructure.thrift.ThriftServer - Using default: log.level is INFO
2014-03-29 20:36:27.553/CET [main] ERROR fr.sciencespo.medialab.hci.memorystructure.thrift.ThriftServer - Internal server error: null, shutting down
java.lang.NumberFormatException: null
at java.lang.Integer.parseInt(Integer.java:443)
at java.lang.Integer.parseInt(Integer.java:514)
at fr.sciencespo.medialab.hci.memorystructure.thrift.ThriftServer.initializeMemoryStructure(ThriftServer.java:159)
at fr.sciencespo.medialab.hci.memorystructure.thrift.ThriftServer.main(ThriftServer.java:49)

[bornakke]

PS: bin/install.sh results in the same error.

[inactinique]

Hi.
I currently have the same problem. Did you solved this?
Best,
FC

[boogheta]

Hi there and sorry for the delay, I apparently never saw this issue and just discovered it from @inactinique 's comment

I just did as a tryout a fresh install from the repo and installed without any issues.
I suspect this was due to some ongoing development fixed since then? In which case:

@bornakke : why do you run build_release ? As the name of this script expresses, it is meant to build a new release version, which no user should have to run. Maybe you meant build_thrift?

@inactinique (are you Éric?) : Is your problem only an apache 404 one or do you have exactly the same outputs as @bornakke?

[inactinique]

Hi

I have two installations and two problems. Both are installed on Ubuntu 14.04, the first one on the server version, the second on on a desktop version. I'd like to focus on the server version and installed on the desktop version only to see if there was some strong differences.

Server install is the install.sh bash log:

Install for Debian/Ubuntu
-----------------------
Install dependencies...
-----------------------
Add source repositories...
--------------------------
OK
Install and start ScrapyD...
----------------------------
scrapyd stop/waiting
scrapyd start/running, process 13192
Check JAVA and install OpenJDK if necessary...
----------------------------------------------
Install Thrift...
-----------------
Install from source requires Thrift & Maven install to build Lucene Java server and Python API
Trying now. Please install from releases for faster install or to avoid this

Install VirtualEnv...
---------------------

And here is the error it does on hyphe startup (sudo ./bin/hyphe start)

Starting Hyphe's Java Memory Structure...
...started...
ERROR: Could not start Hyphe's backend server properly. See log below:
    at fr.sciencespo.medialab.hci.memorystructure.thrift.ThriftServer.initializeMemoryStructure(ThriftServer.java:138)
at fr.sciencespo.medialab.hci.memorystructure.thrift.ThriftServer.main(ThriftServer.java:49)
2014-06-20 12:06:23.065/CEST [main] WARN fr.sciencespo.medialab.hci.memorystructure.thrift.ThriftServer  - Could not find log.level either from memorystructure.properties or from command line arguments.
2014-06-20 12:06:23.065/CEST [main] WARN  fr.sciencespo.medialab.hci.memorystructure.thrift.ThriftServer  - Using default: log.level is INFO
2014-06-20 12:06:23.066/CEST [main] ERROR fr.sciencespo.medialab.hci.memorystructure.thrift.ThriftServer  - Internal server error: null, shutting down
java.lang.NumberFormatException: null
at java.lang.Integer.parseInt(Integer.java:443)
at java.lang.Integer.parseInt(Integer.java:514)
at fr.sciencespo.medialab.hci.memorystructure.thrift.ThriftServer.initializeMemoryStructure(ThriftServer.java:159)
at fr.sciencespo.medialab.hci.memorystructure.thrift.ThriftServer.main(ThriftServer.java:49)

Desktop install

I had no big problem installing it, just a python dependencies to install independantly. Then I had an Apache config problem that I solved. Then, I Could access localhost/hyphe and start a crawl. But the crawl does not crawl anything in fact.

Best,
Frédéric

[boogheta]

@inactinique Is your install.sh log complete? There should be a bunch more lines after Install VirtualEnv

Also you say you ran sudo bin/install.sh. You should not use sudo for such command. Can you try without? (but now that you've used sudo you probably created a bunch of files which only root will have the right to modify and it may complain it cannot work on these, making it hard to debug for you...)

[inactinique]

Yes, it is complete. I suppose that it failed installing thrift. I'll start from scratch again, without sudoing things. I think that this is the key: the difference between the desktop and server installations is that there is a thrift-8.0 folder in the desktop HCI folder that is not in the server version => it has no right to write in the HCI directory on the server. I'll change that.

[boogheta]

The script install.sh includes sudo commands and will ask for your password once. If you use it you should not bother using sudo for anything yourself. As I said for rights issues, I'd recommand you start over in a clean directory or start by sudo chown/chmod -R the whole dir and hidden files

[boogheta]

Another option is to use the release instead of the git repo: it includes the compiled thrift resulting lib making the installation of thrift unnecessary and the whole install faster. But it is not totally up to date with the repo though. I will probably push a new release by the end of the summer after the ongoing phantom crawl option development.

[inactinique]

It doesn't work with the release either.

I installed viertualenv manually and the install.sh process worked up to
the end. BUT Thrift does not seem to compile correctly, notably because of
Haskell. I'll see if it can work with the haskell-platform that goes with
Ubuntu 14.04.

I'll keep you informed.

Best.

2014-06-20 12:42 GMT+02:00 boogheta notifications@github.com:

Another option is to use the release instead of the git repo: it includes
the compiled thrift resulting lib making the installation of thrift
unnecessary and the whole install faster. But it is not totally up to date
with the repo though. I will probably push a new release by the end of the
summer after the ongoing phantom crawl option development.

[boogheta]

This is really surprising: I did a fresh install without any problem on an Ubuntu server 14.04 from the git repo last week.

Moreover I do not understand why haskell would be at stake here: nothing in hyphe is related in any way to haskell.

Also, as expressed earlier, when starting from the release, you do not have to compile or build anything java or thrift related,it is already built, included and deployed within the zip of the release. So after the install.sh from the release ran correctly you only need to configure and run hyphe with the "bin/hyphe start" command.

[inactinique]

I must have misunderstood something somewhere. I’ll start from scratch, but with a release version and will keep you informed.
Best,
Frédéric Clavert

Docteur en histoire contemporaine
Ingénieur de recherche - LabEx EHNE

Hjalmar Schacht, financier et diplomate
Les banquiers centraux dans la construction européenne
L'histoire contemporaine à l'ère numérique

[bornakke]

The install error seem to have disappeeared, but starting hypher now gives me another error.

Since this is a new error I will start a new issue and close this one.

[boogheta]

Hey @inactinique, FYI, we finally released a new version with a more generic installation process which should allow you to easily install Hyphe now.