PCEE-BERT

This repository contains the code for our work PCEE-BERT.

**************************** Updates ****************************

• 2022/05/01: upload repo;

datasets

We use the glue benchmark datasets, which are accessible online;

How to run

First, you should finetune a multi-exit BERT on a glue task, say MRPC:

./scripts/mrpc/train.sh

Then, run inference with our PCEE-BERT early exiting mechanism, with different patience parameter and threshold parameter:

./scripts/mrpc/inference_ee_mechanism_V1.sh

reference

TBD