Skip to content
This repository has been archived by the owner on Aug 3, 2021. It is now read-only.

Allow RNN decoders to tie embedding and projection weights #68

Closed
okuchaiev opened this issue Apr 26, 2018 · 0 comments
Closed

Allow RNN decoders to tie embedding and projection weights #68

okuchaiev opened this issue Apr 26, 2018 · 0 comments

Comments

@okuchaiev
Copy link
Member

RNNDecoderWithAttention and BeamSearchRNNDecoderWithAttention classes should be able to use transpose of elf._dec_emb_w in the self._output_projection_layer. This will probably require changing self._output_projection_layer to a function which does simple matmul, instead of using tf.layers.Dense

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Projects
None yet
Development

No branches or pull requests

1 participant