Vocab size: 29769
Vocab size: 25000 with an unknow token
1.1 Text preprocessing: creating pairs took around 1/5 of time; index words took 4/5 of time 1.2 Training: decoding took around 5/6 of time; optimization took around 1/6 of time
- RNN training optimization
- Multi-GPU
- Professor-forcing