naive/kernel sliding windows

[ZihaoH]

Hi, I wonder that what's the naive/kernel sliding window. The paper didn't provide much description of them.

Why the speeding-up is so obvious?

Looking forward to your reply!
Thanks

[zeliu98]

Hi, you can find the cuda kernel implementation for the local relation layer in branch LR-Net.

[ZihaoH]

Thanks, I used to read this paper, and glad to hear the Cuda version.
But I can't find any cuda-based code in the swin-transformer, so is this model you provide built with 'sliding window (naive)'+'window (w/o shifting) '+'shifted window (cyclic)'?

[ancientmooner]

The cuda kernel is implemented here:
https://github.com/microsoft/Swin-Transformer/tree/LR-Net/ops/local_relation