Character Coreference Resolution in Movie Screenplays

This repository contains the source code and data for training a coreference resolution model for characters in movie screenplays.

The work has been accepted to ACL Findings 2023. You can read the paper Character Coreference Resolution in Movie Screenplays to get more details.
This builds upon our prior work in Annotation and Evaluation of Coreference Resolution in Screenplays.

Data

The MovieCoref corpus is saved to the data directory.

The MovieCoref coreference annotations and screenplay documents can be found in the data/labels and data/screenplay directories, respectively. data/movies.txt contains the name of the movies and their raters. data/parse.csv contains the line-level structural tags of the screenplays, obtained after screenplay parsing.

The data/addsays, data/nocharacters, and data/regular are JSON-preprocessed versions of the MovieCoref corpus, which are more convenient for programmatic usage.

• The addsays version adds the word "says" between speakers and their utterance.
• The nocharacters version omits the speakers entirely from the screenplay.
• The regular version does not make any changes.

We recommend using the regular version.

Training

Set up

Create a python 3 conda environment from the env.yml file.

conda env create --file env.yml

Inter-rater Agreement

Find the interrater agreement of the annotators that labeled the MovieCoref corpus. The annotations on the validation set used to calculate the interrater agreement scores can be found in the data/validation directory.

python rater.py

Training

Preprocess the screenplay documents and the annotation labels. This creates preprocessed JSON files.

python preprocess.py --gold
bash train.sh

Prediction

Given a movie script for which you want to find the character coreference clusters, you need to first parse it to get the line-level tags. You can use the Movie Screenplay Parser to do this task. Refer to its repository regarding how to use it.

from movie_coref import preprocess
from movie_coref.movie_coref import MovieCoreference

# SCRIPT_FILE and PARSE_FILE are the filepaths to the script and parse file
# you can preprocess more than one movie by providing multiple script and parse files
# movie_data will be a list of processed movie scripts
movie_data = preprocess([SCRIPT_FILE], [PARSE_FILE])

# Instantiate the coreference model and pass the preprocessed data
movie_coref = MovieCoreference(
        preprocessed_data=movie_data,
        weights_file=WEIGHTS_FILE,
        hierarchical=HIERARCHICAL,
        document_len=SUBDOC_LEN,
        overlap_len=OVERLAP_LEN,
        n_representative_mentions=REPK,
        )

# Perform the inference
# movie_data will contain the predicted clusters
movie_data = movie_coref.predict()

Set WEIGHTS_FILE to data/Mar09_01:31:43PM_24839/movie_coref.pt.
Set HIERARCHICAL to True if you wish to use the hierarchical mode, otherwise the fusion-based mode will be used (refer to the paper).

SUBDOC_LEN is the length of the subdocuments into which the movie script is split.
OVERLAP_LEN is the overlap length between the subdocuments for the fusion mode.
REPK is the number of representatives per cluster for the hierarchical mode. All details of these hyperparameters can be found in the paper.

Default values of SUBDOC_LEN, OVERLAP_LEN, and REPK are 5120, 2048, and 3.

Citation

Please cite the following papers if you use our work.

Character Coreference Resolution in Movie Screenplays

Sabyasachee Baruah and Shrikanth Narayanan. 2023. Character Coreference Resolution in Movie Screenplays.
In Findings of the Association for Computational Linguistics: ACL 2023, pages 10300–10313, Toronto, Canada.
Association for Computational Linguistics.

The bibtex is:

@inproceedings{baruah-narayanan-2023-character,
    title = "Character Coreference Resolution in Movie Screenplays",
    author = "Baruah, Sabyasachee  and
      Narayanan, Shrikanth",
    editor = "Rogers, Anna  and
      Boyd-Graber, Jordan  and
      Okazaki, Naoaki",
    booktitle = "Findings of the Association for Computational Linguistics: ACL 2023",
    month = jul,
    year = "2023",
    address = "Toronto, Canada",
    publisher = "Association for Computational Linguistics",
    url = "https://aclanthology.org/2023.findings-acl.654",
    doi = "10.18653/v1/2023.findings-acl.654",
    pages = "10300--10313",
}

Annotation and Evaluation of Coreference Resolution in Screenplays

Sabyasachee Baruah, Sandeep Nallan Chakravarthula, and Shrikanth Narayanan. 2021. 
Annotation and Evaluation of Coreference Resolution in Screenplays. 
In Findings of the Association for Computational Linguistics: ACL-IJCNLP 2021, pages 2004–2010, Online. 
Association for Computational Linguistics.

The bibtex is:

@inproceedings{baruah-etal-2021-annotation,
    title = "Annotation and Evaluation of Coreference Resolution in Screenplays",
    author = "Baruah, Sabyasachee  and
      Nallan Chakravarthula, Sandeep  and
      Narayanan, Shrikanth",
    editor = "Zong, Chengqing  and
      Xia, Fei  and
      Li, Wenjie  and
      Navigli, Roberto",
    booktitle = "Findings of the Association for Computational Linguistics: ACL-IJCNLP 2021",
    month = aug,
    year = "2021",
    address = "Online",
    publisher = "Association for Computational Linguistics",
    url = "https://aclanthology.org/2021.findings-acl.176",
    doi = "10.18653/v1/2021.findings-acl.176",
    pages = "2004--2010",
}