Can this be used for ASR?

[InnovativeCoder]

No description provided.

[kimiyoung]

Good question. I believe it is not straightforward yet, and it's an interesting research problem. An obvious thing is that at least we can use a Transformer-XL as the LM in ASR.

[lukemelas]

Also just wanted to say that if you're looking to modify this architecture for ASR, you can take a look at the transformer-based models in https://github.com/tensorflow/tensor2tensor.