Latvian UD Treebank v2.4 consists of 13,026 sentences (208,438 tokens), and it has been obtained by automatic conversion of both the morphological and the syntactic annotations of the original LVTB treebank. LVTB data contains manually verified syntactic annotation according to a hybrid dependency-constituency schema, as well as manually verified morphological tags and lemmas. LVTB is released in parallel with Latvian UD Treebank since v2.2 and features the same version numbers. Corresponding LVTB versions are listed (here). Key
LvtbNodeId in Latvian UD Treebank CoNLL-U field
MISC provides the mapping from Latvian UD Treebank to LVTB. Each LVTB version is superset of the corresponding Latvian UD Treebank version in terms of included sentences.
This work is supported by European Regional Development Fund under the grant agreement No. 22.214.171.124/16/A/219 (Full Stack of Language Resources for Natural Language Understanding and Generation in Latvian, data). The pilot project was supported by State Research Programme "National Identity".
Pretkalniņa L., Rituma L., Saulīte B. Deriving enhanced Universal Dependencies from a hybrid dependency-constituency treebank. Proceedings of the 21sh International Conference Text, Speech, and Dialogue, LNCS, Vol. 11107, Springer Link, 2018, pp. 95-105
Grūzītis N., Pretkalniņa L., Saulīte B., Rituma L., Nešpore-Bērzkalne G., Znotiņš A., Paikens P. Creation of a Balanced State-of-the-Art Multilayer Corpus for NLU. Proceedings of the 11th International Conference on Language Resources and Evaluation (LREC). Miyazaki, Japan, 2018, pp. 4506-4513
Pretkalniņa L., Rituma L., Saulīte B. Universal Dependency Treebank for Latvian: A Pilot. Human Language Technologies - The Baltic Perspective, Frontiers in Artificial Intelligence and Applications, Vol. 289, IOS Press, 2016, pp. 136-143
Pretkalniņa L., Rituma L. Constructions in Latvian Treebank: The Impact of Annotation Decisions on the Dependency Parsing Performance. Human Language Technologies - The Baltic Perspective, Frontiers in Artificial Intelligence and Applications, Vol. 268, IOS Press, 2014, pp. 219-226
Pretkalniņa L., Nešpore G., Levāne-Petrova K., and Saulīte B. Towards a Latvian Treebank. Actas del III Congreso Internacional de Lingüística de Corpus. Valencia, Spain, 2011, pp. 119-127
Pretkalniņa L., Nešpore G., Levāne-Petrova K., and Saulīte B. A Prague Markup Language profile for the SemTi-Kamols grammar model. Proceedings of the 18th Nordic Conference of Computational Linguistics. Riga, Latvia, 2011, pp. 303-306
The data set is licensed under the Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License. Please contact us if you are interested in acquiring a commercial licence.
The training data covers various text types: news, fiction, academic texts, legal texts, transcripts of spoken language, etc. The development and test sets are carefully split out to cover all those types.
Train: 9664 sentences
Dev: 1622 sentences
Test: 1740 sentences
- Added more data.
- Participle voice fixed.
- Issues #5, #6, #7, #8 fixed in original data.
- Fixed annotation errors according to new, more strict validator.
- Added more data.
- Negative verbs and participles now have lemmas without the prefix 'ne'.
- Both masculine and feminine adjectives have the same lemma (masculine).
- Fixed varios annotation errors.
- Repository renamed from UD_Latvian to UD_Latvian-LVTB.
- Fixed tokenization for text errors.
- Added notifications in the MISC field for corrected text errors.
- Improved enhanced dependencies.
- Added more data.
- Removed duplicated and artificially constructed sentences.
- Fixed a bug producing Evident=Fh,Nfh where Evident=Fh should be.
- Added significantly more data.
- Added enhanced dependencies.
- Annotation changed according to UD v2 guidelines.
- Lots of new data.
- Some annotation errors corrected.
- Corrected a number of syntactic annotation mistakes.
- Multi-word conjunctions: first part is now tagged PART.
- Added new sentences.
=== Machine-readable metadata ================================================= Data available since: UD v1.3 License: CC BY-NC-SA 4.0 Includes text: yes Genre: news fiction legal spoken academic Lemmas: manual native UPOS: converted from manual XPOS: manual native Features: converted from manual Relations: converted from manual Contributors: Pretkalniņa, Lauma; Rituma, Laura; Saulīte, Baiba; Nešpore-Bērzkalne, Gunta; Grūzītis, Normunds Contributing: elsewhere Contact: firstname.lastname@example.org, email@example.com ===============================================================================