Transfer Learning in NLP

• Lecture
• Video(rus)
• Video seminar(rus)

Practice

Open seminar.ipynb and follow the instructions here.

Materials

• ULMFit arxiv
• ELMo arxiv
• GPT article
• BERT arxiv
• Domain Adaptation:
  • A theory of learning from different domains article
  • Don't Stop Pretraining: Adapt Language Models to Domains and Tasks arxiv
  • Instance Weighting for Domain Adaptation in NLP article
  • Asymmetric Tri-training for Unsupervised Domain Adaptation arxiv
  • Strong Baselines for Neural Semi-supervised Learning under Domain Shift arxiv