Skip to content
/ MPMP Public

ACL'2023: Multi-Task Pre-Training of Modular Prompt for Few-Shot Learning

Notifications You must be signed in to change notification settings

Hzfinfdu/MPMP

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

70 Commits
 
 
 
 
 
 
 
 

Repository files navigation

Multi-Task Pre-Training of Modular Prompt for Few-Shot Learning

Implementation of Multi-Task Pre-Training of Modular Prompt for Few-Shot Learning (https://arxiv.org/abs/2210.07565).

Release

Oct 22, 2022. Released the first version of MPMP and the 45 datasets on Google Drive.

Installation

python 3.7 is recommended.

pip install transformers==4.11.3
pip install datasets
pip install cma
pip install fastNLP
pip install sklearn
pip install bayesian-optimization
pip install scipy

Training

Please modify the meta path to the directory that contains the datasets in dataconfig.py.

Use the default parameters in run.py to reproduce the training of MPMP.

sh run.sh