Crowdsourced data for semantic frame disambiguation from sentences.
Switch branches/tags
Nothing to show
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Failed to load latest commit information.
CrowdTruth metrics.ipynb

Frame Disambiguation with CrowdTruth

Crowdsourced dataset of 433 sentence-word pairs from the FrameNet corpus v1.7, annotated for frame disambiguation.

The corpus has been referenced in the following paper:

To replicate the data processing from the paper, use the Jupyter Notebook file CrowdTruth metrics.ipynb. It requires the installation of the CrowdTruth metrics Python package (v >= 2.0).

The data aggregated with CrowdTruth metrics is available in folder data/output/

The raw crowdsourcing data is available in folder data/input/

If you find this data useful in your research, please consider citing:

  Author = {Anca Dumitrache and Lora Aroyo and Chris Welty},
  Title = {Capturing Ambiguity in Crowdsourcing Frame Disambiguation},
  Booktitle = {The sixth AAAI Conference on Human Computation and Crowdsourcing},
  Year = {2018}