Skip to content

fix padding tags don't get masked by encoder

Choose a tag to compare

@EslamTarekFarouk EslamTarekFarouk released this 30 Sep 23:23
· 2 commits to main since this release
64f4666

Padding tags don't get masked by the transformer, to fix this problem I edited the embedding function to give padding tags zero embeddings.