/
README.md
146 lines (114 loc) · 6.36 KB
/
README.md
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
# Summary
UD_Faroese-FarPaHC is a conversion of the [Faroese Parsed Historical Corpus (FarPaHC)](https://github.com/einarfs/farpahc) to the Universal Dependencies scheme.
The conversion was done using [UDConverter](https://github.com/thorunna/UDConverter).
# Introduction
The Faroese Parsed Historical Corpus (FarPaHC) is a 53,000 word corpus which includes three texts from the 19th and 20th centuries. These texts were originally manually parsed according to the Penn Parsed Corpora of Historical English (PPCHE) annotation scheme. Two of these parsed texts have been automatically converted to the Universal Dependencies scheme to create the 40,000 word UD_Faroese-FarPaHC.
## Contents
### Files
UD_Faroese-FarPaHC consists of two Faroese texts:
- `NTACTS` - Acts of the Apostles. Edition: 1937.
Author: Jákup Dahl
Birthdate: 1878, died 1944 on his birthday, 5 June
TextId: ntacts
Textname: Ápostlasögan (Acts of the Apostles)[Originally published in Varðin 8, 1928,
as Ápostlasögan og hini almennu brævini (Acts of the Apostles and the Letters)]
Edition: "1937. Nýggja Testamenti. [The New Testament]
Givið út hevur Det danske Bibelselskab. [Published by the Danish Bible Society]
P. Haase og söns boghandel, Keypmannahavn. [Copenhagen]"
Text online: http://old.bibelselskabet.dk/farbib/web/bibelen.htm
Translation: From Greek
Date: 1928
Text genre: Bible translation
Wordcount: 17758
Sample: Sample is from Acts 1:1-17:34, pp. 251-295
- `NTJOHN` - Gospel of St. John. Edition: 1937.
Author: Jákup Dahl
Birthdate: 1878, died 1944 on his birthday, 5 June
TextId: ntjohn
Textname: Evangeliið eftir Jóhannes, (Gospel of St. John) [Originally published in Varðin 16, 1936.]
Edition: "1937. Nýggja Testamenti. [The New Testament]
Givið út hevur Det danske Bibelselskab. [Published by the Danish Bible Society]
P. Haase og söns boghandel, Keypmannahavn. [Copenhagen]"
Text online: http://old.bibelselskabet.dk/farbib/web/bibelen.htm
Translation: From Greek
Date: 1936
Text genre: Bible translation
Wordcount: 23873
Sample: Exhaustive sample of John, pp. 196-250
### Sentences
Each sentence ID in UD_Faroese-FarPaHC carries the following information:
Example ID: `1928.NTACTS.REL-BIB,1.1`
- Publication year of the text (`1928`)
- Name of the text (`NTACTS`)
- Text genre (`REL-BIB`)
- Index within text (`1`)
- Index within file (`1`)
As all the texts in the corpus are excerpts from the Bible, the only text genre present in the sentence IDs is `REL-BIB`, i.e., _religious text, biblical_.
### Additional notes: Morphological Features
The UD morphological features in the corpus were converted from the FarPaHC PoS tags, which do not encode all possible grammatical categories for the language as described by the [UD language documentation for Faroese](https://universaldependencies.org/is/index.html). The features that do appear in UD_Faroese-FarPaHC are shown below, organised by grammatical category.
- Nouns: `Case`, `Definite`, `Number`
- Verbs: `Tense`, `Mood`, `Verbform`, `Case`
- Pronouns: `Case`, `Gender`, `Number`
- Numerals: `Case`
- Adjectives: `Case`, `Degree`
- Adverbs: `Case`, `Degree`, (`Definite`, `Number`)
- Determiners: `Case`
- Other: `Foreign`
## Data split
**TRAIN:**
- `1936.NTJOHN.REL-BIB`
**DEV:**
- First 300 sentences from `1928.NTACTS.REL-BIB`
**TEST:**
- Last 300 sentences from `1928.NTACTS.REL-BIB`
# Acknowledgments
This project was funded by The Icelandic Student Innovation Fund, grant no. 206457-0091. Thanks are due to Örvar Kárason, whose previous work was used as a basis for the conversion.
The Faroese Parsed Historical Corpus (FarPaHC) is available at https://repository.clarin.is/repository/xmlui/handle/20.500.12537/92.
## References
```
@inproceedings{arnardottir-etal-2020-universal,
title = "A {U}niversal {D}ependencies Conversion Pipeline for a {P}enn-format Constituency Treebank",
author = "Arnard{\'o}ttir, {\TH}{\'o}runn and
Hafsteinsson, Hinrik and
Sigur{\dh}sson, Einar Freyr and
Bjarnad{\'o}ttir, Krist{\'\i}n and
Ingason, Anton Karl and
J{\'o}nsd{\'o}ttir, Hildur and
Steingr{\'\i}msson, Stein{\th}{\'o}r",
booktitle = "Proceedings of the Fourth Workshop on Universal Dependencies (UDW 2020)",
month = dec,
year = "2020",
address = "Barcelona, Spain (Online)",
publisher = "Association for Computational Linguistics",
url = "https://www.aclweb.org/anthology/2020.udw-1.3",
pages = "16--25",
abstract = "The topic of this paper is a rule-based pipeline for converting constituency treebanks based on the Penn Treebank format to Universal Dependencies (UD). We describe an Icelandic constituency treebank, its annotation scheme and the UD scheme. The conversion is discussed, the methods used to deliver a fully automated UD corpus and complications involved. To show its applicability to corpora in different languages, we extend the pipeline and convert a Faroese constituency treebank to a UD corpus. The result is an open-source conversion tool, published under an Apache 2.0 license, applicable to a Penn-style treebank for conversion to a UD corpus, along with the two new UD corpora.",
}
```
# Changelog
* 2023-11-15 v2.13
* Fixed incorrect subjunctive marking.
* 2023-05-15 v2.12
* Systematically added definiteness to nouns where missing.
* 2022-11-15 v2.11
* Validation syntax errors.
* 2021-11-15 v2.9
* Modified sentence ids in dev and test to make them unique corpus-wide.
* 2020-11-15 v2.7
* Initial release in Universal Dependencies.
<pre>
=== Machine-readable metadata (DO NOT REMOVE!) ================================
Data available since: UD v2.7
License: CC BY-SA 4.0
Includes text: yes
Genre: fiction bible nonfiction
Lemmas: converted from manual
UPOS: converted from manual
XPOS: manual native
Features: converted from manual
Relations: converted from manual
Contributors: Arnardóttir, Þórunn; Hafsteinsson, Hinrik; Sigurðsson, Einar Freyr; Ingason, Anton Karl; Rögnvaldsson, Eiríkur; Wallenberg, Joel C.
Contributing: elsewhere
Contact: thar@hi.is, hinrik.hafst@gmail.com, einar.freyr.sigurdsson@arnastofnun.is
===============================================================================
</pre>