ACL 2015 paper dataset
This repository contains the dataset for the ACL 2015 paper "Learning to Explain Entity Relationships in Knowledge Graphs" by Nikos Voskarides, Edgar Meij, Manos Tsagkias, Maarten de Rijke and Wouter Weerkamp. This paper presents a method for automatically explaining relationships between entities.
ACL2015-dataset.csv contains the annotated sentences and it has the following format :
QueryIDthe query id
Entity1URLthe url of entity1
Entity2URLthe url of entity2
RelationshipThe automatically produced relationship between the two entities, with the form [Entity1Type, Relationship, Entity2Type].
RelevanceThe relevance judgement for the sentence with respect to the two entities and the relationship. We use a five-level graded relevance scale (perfect, excellent, good, fair, bad). The annotators also marked sentences that did not fit in that scale because of different issues (wrong entities, same entities/different relationship, wrong relationship, other). In our experiments we treated all the sentences with such issues as bad sentences.
DescriptionThe automatically extracted wikipedia candidate sentence.
For more details about the dataset, please refer to the paper.
If you have any questions, please contact n.voskarides AT uva.nl