Ask for visualizing colorful vector

[jkstyle2]

Dear authors,
Thanks for sharing your great work :)
I was impressed how you depicts the eight-head attention values with colorful vectors as below.
Could you share how we can visualize these vectors, if it is not manually done?

Thanks for your help in advance!

[heng-hw]

Hi @jkstyle2! Thanks for your interest in our work. We follow this approach https://github.com/jessevig/bertviz to visualize the attention. Hope it helps!