nlp_course/week04_seq2seq at 2021 · kirillsulim/nlp_course · GitHub

Name		Name	Last commit message	Last commit date
parent directory ..
README.md		README.md
data.txt		data.txt
practice_and_homework_pytorch.ipynb		practice_and_homework_pytorch.ipynb
practice_and_homework_tf.ipynb		practice_and_homework_tf.ipynb
utils.py		utils.py
vocab.py		vocab.py

README.md

Materials

Lecture slides
Our videos (russian): lecture, seminar
Stanford lecture on seq2seq and MT (english) - video
Alternative CMU lectures - seq2seq and attention

Practice

This time we're gonna use a shared practice_and_homework_pytorch.ipynb for both seminar and homework. (use _tf for tensorflow version)

Seminar .

Lecture-blog, research thinking exercises, related papers and fun:

NLP Course For You

More on RNN

Distill.pub post on attention and augmentations for RNN - post
Seq2seq lecture - video
BLEU and CIDEr articles.
Image captioning
- MSCOCO captioning challenge
- Captioning baseline notebook

More on Transformer

Illustrated transformer post