UniteD-SRL: A unified dataset for span- and dependency-based multilingual and cross-lingual Semantic Role Labeling
This is the repository for the paper UniteD-SRL: A unified dataset for span- and dependency-based multilingual and cross-lingual Semantic Role Labeling, to be presented at EMNLP 2021 by Rocco Tripodi, Simone Conia and Roberto Navigli.
Multilingual and cross-lingual Semantic Role Labeling (SRL) have recently garnered increasing attention as multilingual text representation techniques have become more effective and widely available. While recent work has attained growing success, results on gold multilingual benchmarks are still not easily comparable across languages, making it difficult to grasp where we stand. For example, in CoNLL-2009, the standard benchmark for multilingual SRL, language-to-language comparisons are affected by the fact that each language has its own dataset which differs from the others in size, domains, sets of labels and annotation guidelines. In this paper, we address this issue and propose UNITED-SRL, a new benchmark for multilingual and cross-lingual, span-and dependency-based SRL. UNITED-SRL provides expert-curated parallel annotations using a common predicate-argument structure inventory, allowing direct comparisons across languages and encouraging studies on cross-lingual transfer in SRL.
You can download a copy of all the files in this repository by cloning the git repository:
git clone https://github.com/SapienzaNLP/united-srl.gitThe latest version of UniteD-SRL is freely available for research purposes at https://nlp.uniroma1.it/resources. A request may take a few days to process: feel free to contact us if you experience any problems.
The data is available in a format that is very similar to the CoNLL-U format. Here is an example:
# document_id = 1996/a/50/18_supp
# sentence_id = _574:1
# text = The Committee insists that all perpetrators of violations of the Convention be brought to justice.
0 The the _ B-agent _
1 Committee committee _ I-agent _
2 insists insist CAUSE-MENTAL-STATE B-V _
3 that that _ B-theme _
4 all all _ I-theme B-theme
5 perpetrators perpetrator _ I-theme I-theme
6 of of _ I-theme I-theme
7 violations violation _ I-theme I-theme
8 of of _ I-theme I-theme
9 the the _ I-theme I-theme
10 Convention Convention _ I-theme I-theme
11 be be _ I-theme _
12 brought bring BRING I-theme B-V
13 to to _ I-theme B-destination
14 justice justice _ I-theme I-destination
15 . . _ _ _
- Column 1: token index in the sentence.
- Column 2: tokens in the sentence.
- Column 3: lemma of each token in the sentence.
- Column 4: VerbAtlas frame of a predicate. If the token is not a predicate, then
_. - Column 4 + i: Roles of predicate
i. E.g. Column 5 lists the roles for the first predicate, i.e.,insists.
If you use any part of this work, please cite our reference paper.
Plaintext:
Rocco Tripodi, Simone Conia and Roberto Navigli, 2021. UniteD-SRL: Unified Dataset for Span- and Dependency-based Multilingual and Cross-Lingual Semantic Role Labeling. In Findings of the Association for Computational Linguistics: EMNLP 2021. Punta Cana, Dominican Republic. Association for Computational Linguistics.
Bibtex:
@inproceedings{tripodi-etal-2021-united-srl,
title = "{UniteD-SRL}: {A} Unified Dataset for Span- and Dependency-Based Multilingual and Cross-Lingual {S}emantic {R}ole {L}abeling",
author = "Tripodi, Rocco and
Conia, Simone and
Navigli, Roberto",
booktitle = "Findings of the Association for Computational Linguistics: EMNLP 2021",
month = nov,
year = "2021",
address = "Punta Cana, Dominican Republic",
publisher = "Association for Computational Linguistics",
url = "https://aclanthology.org/2021.findings-emnlp.197",
pages = "2293--2305",
}
}In our experiments, we used the model from Bridging the Gap in Multilingual Semantic Role Labeling: a Language-Agnostic Approach.
@inproceedings{conia-navigli-2020-bridging,
title = "Bridging the Gap in Multilingual Semantic Role Labeling: a Language-Agnostic Approach",
author = "Conia, Simone and
Navigli, Roberto",
booktitle = "Proceedings of the 28th International Conference on Computational Linguistics (COLING 2020)",
month = dec,
year = "2020",
address = "Barcelona, Spain (Online)",
publisher = "International Committee on Computational Linguistics",
url = "https://www.aclweb.org/anthology/2020.coling-main.120",
pages = "1396--1410"
}Read more about VerbAtlas, the Semantic Role Labeling inventory we used to tag UniteD-SRL.
@inproceedings{di-fabio-etal-2019-verbatlas,
title = "{V}erb{A}tlas: {A} Novel Large-Scale Verbal Semantic Resource and Its Application to Semantic Role Labeling",
author = "Di Fabio, Andrea and
Conia, Simone and
Navigli, Roberto",
booktitle = "Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP)",
month = nov,
year = "2019",
address = "Hong Kong, China",
publisher = "Association for Computational Linguistics",
url = "https://www.aclweb.org/anthology/D19-1058",
doi = "10.18653/v1/D19-1058",
pages = "627--637"
}UniteD-SRL is licensed under Creative Commons Attribution-NonCommercial-ShareAlike 4.0.