This repository has been archived by the owner on Nov 22, 2022. It is now read-only.

Mask is not using in the attention calculation #1436

Open

haowang1992 opened this issue Aug 30, 2020 · 0 comments

haowang1992 commented Aug 30, 2020

pytext/pytext/models/representations/transformer/multihead_linear_attention.py

Line 60 in 49a45b7

), "query and key_padding_mask batch sizes differed"

How to use the mask in Linformer?@sinonwang

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.