MalAlgoQA: A Pedagogical Approach for Evaluating Counterfactual Reasoning Abilities (Accepted at EMNLP 2024)

This repository contains code and dataset for the paper: MalAlgoQA: A Pedagogical Approach for Evaluating Counterfactual Reasoning Abilities .

Request for Data

Please fill out this google form to request the MalAlgoQA dataset.

If you use the dataset please add the citation:

@misc{liu2024malalgoqa,
      title={MalAlgoQA: A Pedagogical Approach for Evaluating Counterfactual Reasoning Abilities}, 
      author={Naiming Liu and Shashank Sonkar and Myco Le and Richard Baraniuk},
      year={2024},
      eprint={2407.00938},
      archivePrefix={arXiv},
      primaryClass={cs.CL},
      url={https://arxiv.org/abs/2407.00938}, 
}