Some questions in the paper

[liqiokkk]

Hi, Author.
I want to know are EV and EV(hat) equivalent or approximate in the paper?
Are EV(hat)^l in the second half of formula 7 and formula 8 equivalent or approximate？
Thank you, looking forward to your answer.

[xwjabc]

Hi @liqi520, thank you for your interest in our work!
(1) \hat{EV} is an approximation of EV by considering each channel in the query, key and value vectors as internal heads.
(2) \hat{EV}^l in equation (7) and (8) are equivalent.
Hope it helps!