Skip to content

Commit

Permalink
Updated treebank evaluation.
Browse files Browse the repository at this point in the history
  • Loading branch information
dan-zeman committed Apr 11, 2018
1 parent 4e1641b commit 584fd13
Showing 1 changed file with 9 additions and 9 deletions.
18 changes: 9 additions & 9 deletions eval.log
Original file line number Diff line number Diff line change
@@ -1,11 +1,11 @@
Running the following version of tools/evaluate_treebank.pl:
commit 95f84696ecc537764b7772395d073132bd715b77
commit 87d374bbd458d29331d76014d05c52eaac32518d
Author: Dan Zeman <zeman@ufal.mff.cuni.cz>
Date: Wed Apr 11 08:54:01 2018 +0200
Date: Wed Apr 11 09:21:53 2018 +0200
Evaluating the following revision of UD_Catalan-AnCora:
commit 28f748fdd6b2b58bcdf6ad5a1332066717163be9
Merge: 54868dc e11c84f
commit 4e1641ba6bfe3436c4c8d64c47c434703919f45f
Author: Dan Zeman <zeman@ufal.mff.cuni.cz>
Date: Wed Apr 11 09:15:12 2018 +0200
Size: counted 531971 of 531971 words (nodes).
Size: min(0, log((N/1000)**2)) = 12.5531779531553.
Size: maximum value 13.815511 is for 1000000 words or more.
Expand All @@ -19,7 +19,7 @@ Features: 431877 out of 531971 total words have one or more features.
Features: source of annotation (from README) factor is 0.8.
Universal relations: 30 out of 37 found in the corpus.
Universal relations: source of annotation (from README) factor is 0.8.
Udapi: found 0 bugs.
Udapi: found 20056 bugs.
Udapi: worst expected case (threshold) is one bug per 10 words. There are 531971 words.
Genres: found 1 out of 14 known.
validate.py --lang ca --max-err=10 UD_Catalan-AnCora/ca_ancora-ud-dev.conllu
Expand All @@ -35,8 +35,8 @@ Validity: 1
(weight=0.256410256410256) * (score{size}=0.908629319234152) = 0.232981876726706
(weight=0.0512820512820513) * (score{split}=1) = 0.0512820512820513
(weight=0.0769230769230769) * (score{tags}=0.8) = 0.0615384615384615
(weight=0.307692307692308) * (score{udapi}=1) = 0.307692307692308
(weight=0.307692307692308) * (score{udapi}=0.622986967334686) = 0.191688297641442
(weight=0.0769230769230769) * (score{udeprels}=0.648648648648649) = 0.0498960498960499
(TOTAL score=0.831962175707004) * (availability=1) * (validity=1) = 0.831962175707004
STARS = 4
UD_Catalan-AnCora 0.831962175707004 4
(TOTAL score=0.715958165656138) * (availability=1) * (validity=1) = 0.715958165656138
STARS = 3.5
UD_Catalan-AnCora 0.715958165656138 3.5

0 comments on commit 584fd13

Please sign in to comment.