No release notes? What is "MultiHeadAttention to return qk as well"

[turnkit]

This update was pushed last week as well as another but there are no announcements, no release notes.

Would someone explain what these changes do?

"MultiHeadAttention to return qk as well"

• 5380767

Also:
"word-level timestamps in Multilingual_ASR notebook"

• 28769fc

[glangford]

It looks like the "MultiHeadAttention to return qk as well" change enables the demo code in the Multilingual_ASR notebook. This is mentioned (briefly) in #332.

A comment in the notebook describes the purpose as

...we use the cross-attention weights to determine more granular, word-level timestamps. It uses a set of heuristics and dynamic time warping (DTW) to find the alignment between the audio and the transcript.

The accuracy of timestamps has been discussed in #3 and #435 .

[glangford]

The inspiration for the notebook probably goes back to this comment from a few months ago
#3 (comment)