Skip to content
CITE: A Corpus of Image-Text Discourse Relations
Branch: master
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
code
data
README.md

README.md

CITE: A Corpus of Image-Text Discourse Relations

by Malihe Alikhani, Sreyasi Nag Chowdhury, Gerard de Melo, Matthew Stone

Introduction

This work presents a novel crowd-sourced resource for multimodal discourse: our resource characterizes inferences in image-text contexts in the domain of cooking recipes in the form of coherence relations.

Like previous corpora annotating discourse structure between text arguments, such as the Penn Discourse Treebank, our new corpus aids in establishing a better understanding of natural communication and common-sense reasoning, while our findings have implications for a wide range of applications, such as understanding and generation of multimodal documents.

Citing CITE

If you use this data or code, please cite the following paper:

Malihe Alikhani, Sreyasi Nag Chowdhury, Gerard de Melo, Matthew Stone. CITE: A Corpus of Image-Text Discourse Relations. Proceedings of 17th Annual Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT 2019)

BibTeX entry:

@InProceedings{AlikhaniEtAl2019CITETextImageDiscourse,
  author       = {Alikhani, Malihe and {Nag Chowdhury}, Sreyasi and {de Melo}, Gerard and Stone, Matthew},
  title        = {CITE: A Corpus Of Text-Image Discourse Relations},
  booktitle    = {Proceedings of 17th Annual Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (NAACL-HLT 2019)},
  year         = {2019},
  publisher    = {Association for Computational Linguistics},
  address      = {Stroudsburg, PA, USA},
  location     = {Minneapolis, MN, USA},
}
You can’t perform that action at this time.