This Repo conduct three NLP task: Neural Machine Translation, Abstractive Summarization, and Language Modeling.
- PyTorch version == 1.8
- Python version >= 3.6
To install fairseq from source and develop locally:
git clone https://github.com/dropreg/R-Drop.git
cd R-Drop/fairseq_src/
pip install --editable .
- Nerual Translation Task: R-Drop transformer models are available
- Abstractive Summarization Task: R-Drop transformer models are available
- Language Modeling Task: R-Drop transformer models are available