Transformer has achieved state-of-the-art results on many natural language processing tasks. In this work, we revisit Transformer from the following aspects:
- An introduction of Transformer
- A study on IWSLT 2014 German-to-English
- A study on WMT 2014 English-to-French
- A study on WMT 2014 English-to-German
We summarize the previous baselines on several benchmark datasets:
This is only a draft and will be kept updating. Use github to track revisions.