1.9.1

Full Changelog: 1.9.0a...1.9.1

1.9.0a

fix pypi

1.9.0

ability to attend to nothing for LocalMHA through gating

1.8.6

allows for turning off exact windowsize

1.8.5

make sure non-causal local attention can also support exact window sizes

1.8.4

fix bug with attention bias, thanks to @ilya16 again

1.8.2

fix when xpos is turned off

1.8.1

fix xpos with new rotary pos embedding applied on bucketed queries an…

…d keys

1.8.0

add dynamic positional bias

1.7.2

follow @ilya16 suggestion and rotate positions into queries and keys …

…after bucketing