DeMET Prompts

This repository contains the gender bias scenarios datasets, DeMET Prompts, from the paper "Gender Bias in Decision-Making with Large Language Models: A Study of Relationship Conflicts". The "human_written_scenarios.csv" file contains human-written scenarios and the "final_gpt4_scenarios.csv" file contains GPT-4 generated scenarios. Each scenario is labeled with a corresponding topic and differentiation between egaltiarian, traditional, or other (mix of both) relationship.

If you use this dataset, please cite our paper:

@article{levy-gender-scenarios,
    title = {Gender Bias in Decision-Making with Large Language Models: A Study of Relationship Conflicts},
    author = {Levy, Sharon  and
      Adler, William D.  and
      Karver, Tahilin Sanchez  and
      Dredze, Mark  and
      Kaufman, Michelle R.},
    year = {2024},
    booktitle = {Findings of the Association for Computational Linguistics: EMNLP 2024},
}