Attention view for single plots

[catherinesyeh]

Left sidebar:

• when user clicks on a point (right side), show attention plot for sentence on left sidebar:
  • right now, code for these plots is here: att.html
  • original bertviz repo: https://github.com/jessevig/bertviz
• highlight token corresponding to point in attention plot (see below)
• allow user to toggle lines off and on in attention plot to more clearly observe attn patterns
  • currently, i do this by letting people click on the token text in the attention plot
• renormalize line weights after toggling
• label q + k columns
• potentially also add more complex features (e.g., input box) like in matrix view? will ask martin...

current attn view for reference:

Main panel:

• will clarify with martin, but may also still want to highlight points in sentence on main plot when the user clicks on a token (see above)
  • update: yes we should still do this but don't make points yellow, keep query/key color schemes just outline in different color maybe? if we use highlight token method like with search, seems to be a bit slow at the moment...

[wowjyu]

The attn data is now available for drawing upon clicking a point.

Known issue: The click interaction is kinda lagging.

[catherinesyeh]

More todos:

• fix styling
• what to do about sizing? (e.g., narrow/short screens gets cut off)
• seems that you have to be pretty zoomed in for click to work... is that expected?
• fix clear behavior
• show layer/head

[catherinesyeh]

More todos:

• option to filter out first token
• or cls/sep

In both cases, should renormalize remaining weights afterwards

[catherinesyeh]

done for now! (letting user add new sentences = future work)