This repo stores the data and evaluation scripts for the contrast sets paper.
| Dataset | Contrast Sets | Type of NLP Task |
|---|---|---|
| BoolQ (Clark et al., 2019) | Data | Reading Comprehension |
| DROP (Dua et al., 2019) | Data | Reading Comprehension |
| MC-TACO (Zhou et al., 2019) | Data | Reading Comprehension |
| ROPES (Lin et al., 2019) | Data | Reading Comprehension |
| Quoref (Dasigi et al., 2019) | Data | Reading Comprehension |
| IMDb Sentiment Analysis (Maas et al., 2011) | Data | Classification |
| MATRES (Ning et al., 2018) | Data | Classification |
| NLVR2 (Suhr et al., 2019) | Data | Classification |
| PERSPECTRUM (Chen et al., 2019) | Data | Classification |
| UD English (Nivre et al., 2016) | Data | Parsing |