hyena equivalent to cross attention

[MiqG]

Hi, is there an example of how the Hyena block can be implemented in an equivalent manner to cross attention?

Thanks a lot in advance!

[alexeyshmelev]

@MiqG , did you solve this somehow?

[MiqG]

No... @alexeyshmelev I haven't had the time to tackle this yet, I was hoping it would be simple though