Add AQMAR NER modified corpus

[megantosh]

Draft of a Modern Standard Arabic dataset from 28 Wikipedia articles used in https://www.aclweb.org/anthology/W19-4607/

[alanakbik]

@megantosh why "draft"? Looks good ;)

[megantosh]

thought I would mark as draft since this is not the original dataset. Subsequent edits possible (i.e. split corpus into docs, split MISC into MIS0, MIS1, MIS2, MIS3).

Just tested branch after uploading now. PR ready for merge 👍

[alanakbik]

A few potential issues with the dataset:

corpus = AQMAR()
corpus.make_label_dictionary()

prints the following label dictionary:

[b'B-PER', b'I-PER', b'O', b'B-MISC', b'I-MISC', b'B-ORG', b'I-ORG', b'B-LOC', b'I-LOC', b'B-SPANISH', b'B-ENGLISH']

I.e. it includes the labels B-SPANISH and B-ENGLISH, but they only occur twice in the corpus and seem to be wrong?

Another potential problem are sentences like this one:

ستالمان I-PER
( O
بالإنجليزية O
: O
Richard B-MISC
Stallman I-MISC
) O
( O

Why is Richard Stallman marked as MISC. Shouldn't it be a person?

[megantosh]

according to the original dataset's README.txt:
Richard_Stallman.txt
MIS-1: Name of software or hardware (e.g. Emacs, Kernel)
MIS-2: English entities
appears later as mistagged once all MIS-1, -2 etc are merged into only MISC.
Hence it looks like an error, however the name in arabic
ريتشارد B-PER
ستالمان I-PER
is tagged correctly as PER.

Problem is, that in another file, MIS-2 represents something else.
E.g. in atom.txt >> MIS-2: Name of theories (e.g. Dalton Theory)

The dataset has indeed a few issues beyond that, too. I thought, however, to keep these "mistakes" for the sake of comparability with the published scores in https://www.aclweb.org/anthology/W19-4607/ (same paper as above).

Alternatively, we can establish different versions of the dataset if that helps.. What do you think?

[megantosh]

for clarification:

ريتشارد B-PER
ستالمان I-PER
is a transliteration of the english name
Richard B-MISC
Stallman I-MISC

[alanakbik]

Good question, but I think merging them into one MISC label for now is a good way to go.

What about the issue of the B-ENGLISH and B-SPANISH tag? Is this an error in the conversion script?

I.e.:

كان O
الفريق O
يستخدم O
بعض O
الملاعب O
البسيطة O
في O
مدريد B-LOC
للعب O
المباريات O
حتى O
انتقل O
لأول O
ملعب O
كان O
اسمه O
ملعب O
O'Donnell B-SPANISH
في O
عام O

[megantosh]

that is my assumption yes. Same issue exists in original corpus.

[alanakbik]

@megantosh thanks for adding this - will merge this version now!