Links
Models
MASS (Song et al., 2019) https://github.com/microsoft/MASS
Moses toolkit https://github.com/moses-smt/mosesdecoder
UniLM (Dong et al., 2019) https://github.com/microsoft/unilm
RoBERTa (Liu et al., 2019) https://github.com/pytorch/fairseq
RoBERTa-UniLM datasets
https://dumps.wikimedia.org/enwiki/latest/enwiki-latestpages-articles.xml.bz2
https://www.smashwords.com/books/category/1/downloads/0/free
http://data.statmt.org/news-crawl/en-doc
https://github.com/huggingface/transformers -- for fine tuning