Permalink
Switch branches/tags
Find file Copy path
Fetching contributors…
Cannot retrieve contributors at this time
78 lines (60 sloc) 3.88 KB
# Summary
UD English-ESL / Treebank of Learner English (TLE) contains manual POS tag and dependency annotations for 5,124 English as a Second Language (ESL) sentences drawn from the Cambridge Learner Corpus First Certificate in English (FCE) dataset.
# Introduction
UD English-ESL/TLE is a collection of 5,124 English as a Second Language (ESL) sentences (97,681 words), manually annotated with POS tags and dependency trees in the Universal Dependencies formalism. Each sentence is annotated both in its original and error corrected forms. The annotations follow the standard English UD guidelines, along with a set of supplementary guidelines for ESL. The dataset represents upper-intermediate level adult English learners from 10 native language backgrounds, with over 500 sentences for each native language. The sentences were randomly drawn from the Cambridge Learner Corpus First Certificate in English (FCE) corpus. The treebank is split randomly to a training set of 4,124 sentences, development set of 500 sentences and a test set of 500 sentences. Further information is available at esltreebank.org
# Acknowledgments
The dataset and the annotation guidelines were developed at MIT by Yevgeni Berzak, Jessica Kenney, Carolyn Spadine, Jing Xian Wang, Lucia Lam, Keiko Sophie Mori, Sebastian Garza and Boris Katz.
# Obtaining the text
Due to FCE licensing restrictions, the annotations are released without
the text. To merge the annotations with the corresponding FCE sentences,
please follow these steps (require python).
1) Download the FCE dataset from https://www.ilexir.co.uk/datasets/index.html
to the current directory, thereby signing the FCE license agreement.
2) Unzip the downloaded file fce-released-dataset.zip.
3) Run "python merge.py" to obtain annotation files with the FCE sentences.
# Metadata
#ID=[document_id] [sent_id]: sentence identifier.
doc_id is the path to the FCE document from which the sentence was obtained.
sent_id is the sentence number (with respect to the automatic sentence tokenization).
#SENT=[sentence]: the error annotated xml version of the FCE sentence.
Available only in the merged version.
# Changelog
v1.4
--changed UPOS of indefinite, totality and negative pronouns from NOUN to PRON
--changed UPOS of demonstrative pronouns from DET to PRON
# Citation
You are encouraged to cite the following papers when using the TLE:
@inproceedings{berzak2016tle,
author = {Berzak, Yevgeni and Kenney, Jessica and Spadine, Carolyn and Wang, Jing Xian
and Lam, Lucia and Mori, Keiko Sophie and Garza, Sebastian and Katz, Boris},
title = {Universal Dependencies for Learner English},
booktitle = {Proceedings of the 54th Annual Meeting of the Association for Computational
Linguistics (Volume 1: Long Papers)},
year = {2016},
publisher = {Association for Computational Linguistics},
pages = {737--746},
url = {http://www.aclweb.org/anthology/P16-1070}
}
@inproceedings{yannakoudakis2011fce,
title={A new dataset and method for automatically grading ESOL texts},
author={Yannakoudakis, Helen and Briscoe, Ted and Medlock, Ben},
booktitle={Proceedings of the 49th Annual Meeting of the Association for Computational
Linguistics: Human Language Technologies-Volume 1},
pages={180--189},
year={2011},
organization={Association for Computational Linguistics}
}
=== Machine-readable metadata (DO NOT REMOVE!) ================================
Data available since: UD v1.3
License: CC BY-SA 4.0
Includes text: no
Genre: learner-essays
Lemmas: not available
UPOS: manual native
XPOS: manual native
Features: not available
Relations: manual native
Contributors: Berzak, Yevgeni; Kenney, Jessica; Spadine, Carolyn; Wang, Jing Xian; Lam, Lucia; Mori, Keiko Sophie; Garza, Sebastian; Katz, Boris
Contributing: elsewhere
Contact: berzak@mit.edu
===============================================================================