m3yrin/aligned-cross-entropy [WIP]

Test implementation of "Aligned Cross Entropy for Non-Autoregressive Machine Translation" https://arxiv.org/abs/2004.01655

• Built on PyTorch 1.5.0
• code is in axe/axe.py

Demo

Model

• CTC model of https://arxiv.org/abs/2004.07437
• Implementation is based on https://github.com/m3yrin/nar-latent-alignment

Dataset

• A small parallel corpus for English-Japanese translation task provided by @odashi
• see detail at https://github.com/odashi/small_parallel_enja

Example

Please see detail at my colaboratory notebook.

https://colab.research.google.com/github/m3yrin/aligned-cross-entropy/blob/master/demo.ipynb