Official code for PARADISE: Exploiting Parallel Data for Multilingual Sequence-to-Sequence Pretraining by Machel Reid and Mikel Artetxe (NAACL 2022)
(More detailed README coming soon!)
Example scripts:
code/paradise_pretrain.sh
Pre-training scriptcode/paradise_mt.sh
Machine Translation fine-tuning scriptcode/paradise_xnli.sh
Classification fine-tuning script