A Targeted Assessment of Incremental Processing in Neural LanguageModels and Humans
Ethan Gotlieb Wilcox, Pranali Vani and Roger Levy (ACL 2021)
Scripts
-- analysis.Rmd contains all analysis and statistical tests reported in the paper
Data
-- model_surprisals.csv contains word-by-word surprisal values for each of the models tested in the work.
-- syntaxgym_imaze_results.csv contains iMaze data collected over the web for our syntactic test suites.
Images
-- /region_by_region/ contains region-by-region plots for human read-times for each of our test suites.