The relationship between AR model and the NAR model

[Maggione]

Hi! Thank you for you code! But I am confused that the input of NAR model is the discrete tokens in the paper while in this repo the input of NAR model are the hidden state of AR model. Besides, the gradients will backward from the NAR model to the AR model. Have I misunderstand it?

[lifeiteng]

you must convert discrete token to its embedding.