log_relative_position_index

[jakubMitura14]

Hello Thank You for publishing this repository!
I have question to the jax implementation https://github.com/minyoungpark1/swin_transformer_v2_jax

in first line of setup function in Window attention module there is a line

        self.log_relative_position_index = log_space_continuous_position_bias(self.window_size)#krowa - not used

As far as I understand this is a novelty from swin transformer v2 relative to v1 - Hovewer I can not find then any way that this log space relative position encoding is used, Why is it so?

Thank You!