Skip to content
No description, website, or topics provided.
Python Shell
Branch: master
Clone or download
Fetching latest commit…
Cannot retrieve the latest commit at this time.
Type Name Latest commit message Commit time
Failed to load latest commit information.

Generalised Contextual Decomposition for Language Models

This repository contains the scripts to run the experiments described in the CoNLL 2019 paper Analysing Neural Language Models: Contextual Decomposition Reveals Default Reasoning in Number and Gender Assignment.

The code is built upon the neural net analysis library diagnnose that can be installed using pip.

The 4 scripts in this repo correspond to the 4 experiments that were performed in the paper.

Run first to import the language model of Gulordava et al. (2018). This script will download the model state dict and vocab file to the model directory.

After the model has been downloaded each script can be run as python3 -c foo.json.

You can’t perform that action at this time.