Error when parsing multiword expressions in conllu file

[sb-b]

Hi,

I am trying to train this parser on Turkish UD Treebank. When I run this command:

java -jar ParserOracleArcStdWithSwap.jar -t -1 -l 1 -c training.conll > trainingOracle.txt

I got the following error:

java.lang.NumberFormatException: For input string: "2-3"
        at java.lang.NumberFormatException.forInputString(NumberFormatException.java:65)
        at java.lang.Integer.parseInt(Integer.java:580)
        at java.lang.Integer.parseInt(Integer.java:615)
        at arc_std_swap.Oracle.getTransition(Oracle.java:41)
        at arc_std_swap.Parser.printOracle(Parser.java:366)
        at arc_std_swap.Parser.main(Parser.java:270)

The conllu parse the lstm parser gives error is the one below:

# sent_id = mst-0003
# text = Sanal parçacıklarsa bunların hiçbirini yapamazlar.
1	Sanal	sanal	ADJ	Adj	_	2	amod	_	_
2-3	parçacıklarsa	_	_	_	_	_	_	_	_
2	parçacıklar	parçacık	NOUN	Noun	Case=Nom|Number=Plur|Person=3	6	csubj	_	_
3	sa	i	AUX	Zero	Aspect=Perf|Mood=Cnd|Number=Sing|Person=3|Tense=Pres	2	cop	_	_
4	bunların	bu	PRON	Demons	Case=Gen|Number=Plur|Person=3|PronType=Dem	5	nmod:poss	_	_
5	hiçbirini	hiçbiri	PRON	Quant	Case=Acc|Number=Sing|Number[psor]=Sing|Person=3|Person[psor]=3|PronType=Ind	6	obj	_	_
6	yapamazlar	yap	VERB	Verb	Aspect=Imp|Mood=Pot|Number=Plur|Person=3|Polarity=Neg|Tense=Aor	0	root	_	SpaceAfter=No
7	.	.	PUNCT	Punc	_	6	punct	_	_

The word 'parçacıklarsa' is a multiword token, so it is numbered as '2-3'. Does lstm parser have a mechanism to deal with multiword tokens? How can I solve this issue?

Thanks,

Betul

[miguelballesteros]

Hi! This is conllu format, the parser only handles conll format. Please see the universal dependencies scripts.

Miguel

[sb-b]

Hi, I couldn't find an appropriate script for converting conll-u files to conll files. I will be glad if you can suggest me a script for this task. Thanks, Betul

…

On Wed, Feb 14, 2018 at 3:18 PM, Miguel Ballesteros < ***@***.***> wrote: Hi! This is conllu format, the parser only handles conll format. Please see the universal dependencies scripts. Miguel — You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub <#26 (comment)>, or mute the thread <https://github.com/notifications/unsubscribe-auth/AEEx3sCE39H-ErylAeEh8S8zfF5aX8w3ks5tUs7_gaJpZM4SFE1v> .

[miguelballesteros]

I believe this is the one: https://github.com/UniversalDependencies/tools/blob/f21108176ff431ebbab4c9414d6e0345e62d3995/conllu_to_conllx.pl

[sb-b]

It worked, thank you!

…

On Wed, Feb 14, 2018 at 8:57 PM, Miguel Ballesteros < ***@***.***> wrote: I believe this is the one: https://github.com/UniversalDependencies/tools/ blob/f21108176ff431ebbab4c9414d6e0345e62d3995/conllu_to_conllx.pl — You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub <#26 (comment)>, or mute the thread <https://github.com/notifications/unsubscribe-auth/AEEx3n2nfnstJ8In9Wb0pu41MXnGbx9_ks5tUx6QgaJpZM4SFE1v> .