omorfi-ftb3.lexc didn't compile cleanly?

[TuulaP]

On centos6, got the source code from github, installed the HFST 3.8.3 and did configure:

./configure --prefix=/work/bin/omorfiversiot/151015 --with-hfst=/work/bin/hfst_v383/bin

When doing make (it goes fine for a while), but then...

make
...
420000...
 424254  entries in master db
Reading from generated/stemparts.tsv
Reading from generated/inflections.tsv
/work/bin/hfst_v383/bin/hfst-lexc --Werror -o generated/omorfi-ftb3.lexc.hfst generated/omorfi-ftb3.lexc
/work/bin/hfst_v383/bin/hfst-lexc: warning: Defaulting to OpenFst tropical type
Root...21 ADJ...18294 ADP...413 ADV...8313 CONJ...6 CONJ|VERB...8 INTJ...367 NOUN...108725 NUM...901 PRON...85 PROPN...271518 PUNCT...64 SCONJ...19 SYM...24 VERB...10953 
<clipclip>  ...3 DIGITS_MILJARDI...33 DIGITS_MILJOONA...33 DIGITS_NELJÄ...32 *DIGITS_NELJÄS...
generated/omorfi-ftb3.lexc:428970.1-22: Sublexicon defined more than once. [near: `LEXICON DIGITS_NELJÄ']
/work/bin/hfst_v383/bin/hfst-lexc: The file generated/omorfi-ftb3.lexc did not compile cleanly.*
(if there are no error messages above, try -v or -d to get more info)
make[1]: *** [generated/omorfi-ftb3.lexc.hfst] Error 1
make[1]: Leaving directory `/work/tmp/omorfi_uusin/omorfi/src'
make: *** [all-recursive] Error 1

Not sure if related, but for some reason hfst-installation created hfst-proc as a link to a non-existant file. However, then just replaced that link with real 'hfst-proc' from the precompiled binaries.

Before that change, the omorfi configuration stopped to this:

checking for /work/bin/hfst_v383/bin/hfst-split... yes
checking for /work/bin/hfst_v383/bin/hfst-conjunct... yes
checking for /work/bin/hfst_v383/bin/hfst-proc... no
configure: error: HFST commandline tools are needed in /work/bin/hfst_v383/bin

ls -la /work/bin/hfst_v383/bin/hfst-proc
/work/bin/hfst_v383/bin/hfst-proc -> hfst-apertium-proc
ls -la /work/bin/hfst_v383/bin/hfst-apertium-proc
ls: cannot access /work/bin/hfst_v383/bin/hfst-apertium-proc: No such file or directory

and the precompiled version is, which now exists in the hfst-directory

./hfst-proc --version
hfst-proc 0.0 (hfst 3.8.2)

[flammie]

Interesting..., the source files for the lexicon definitions did get out of order in the development version, however, make does do sort -k 1,1 for them before reading anyways. I suspect doing simple make clean and make might solve it, but the current git version has also the data sorted in the right order.

[flammie]

As for the HFST problem, it is unrelated but I have reported it it to HFST at sf.net

[TuulaP]

Continuing with this one, hfst problem solved by installing bison, and just got new sources of omorfi from here (git clone...) , but still same thing

JARDI...33 DIGITS_MILJOONA...33 DIGITS_NELJÄ...32 DIGITS_NELJÄS...generated/omorfi-ftb3.lexc:429350.1-22: Sublexicon defined more than once. [near: `LEXICON DIGITS_NELJÄ']
/tmp/git_asennuksia/hfst_383/bin/hfst-lexc: The file generated/omorfi-ftb3.lexc did not compile cleanly.
(if there are no error messages above, try -v or -d to get more info)
make[1]: *** [generated/omorfi-ftb3.lexc.hfst] Error 1

 ./configure --prefix=/tmp/git_asennuksia/omorfi_uusin --with-hfst=/tmp/git_asennuksia/hfst_383/bin

The hfst was compiled with ./configure --prefix=/tmp/git_asennuksia/hfst_383 --enable-proc
so maybe I am missing something from its installation?

[TuulaP]

Just to store this info also here. After some recent centos updates, and recompiling hfst, it seems that everything works.

hfst compilation:

./configure --prefix=$HFSTLOC --enable-proc --without-foma
and then omorfi:
./configure --prefix=$OMORFILOC --with-hfst=$HFSTLOC --enable-ftb3

omorfi's make check still complains of one thing, which I'm not sure how significant it is:

omorfi 20160000_alpha: src/test-suite.log
===============================================

# TOTAL: 1
# PASS:  0
# SKIP:  0
# XFAIL: 0
# FAIL:  1
# XPASS: 0
# ERROR: 0

.. contents:: :depth: 2

FAIL: bash/validate-database.bash
=================================

checking for duplicate unique keys in lexemes (word_id, homonym)
lexemes.tsv...
lexemes.tsv has duplicate keys in /tmp/omorfi-validate-database.KzQQgw0Iee/duplicate-keys

more /tmp/omorfi-validate-database.KzQQgw0Iee/duplicate-keys
2 suom. 1