Add: A minimal implementation of ShiftViT

[ariG23498]

This is a minimal implementation of ShiftViT. In this paper the authors have proposed to replace the attention module of a ViT with a NO PARAMETER shifting operation. In this example we have tried aligning the implementation as closely as we could with the official implementation in PyTorch. We hope this will benefit the keras community.

Colab Notebook

CC: @ritwikraha

[fchollet]

Thanks for the PR! 👍

Please format the code using black.

[ariG23498]

Thank you for the review @fchollet

We have made the necessary changes!

[fchollet]

Thanks for the updates! I pushed some copyedits.

[ariG23498]

@fchollet I have made changes as requested!

[ariG23498]

Thanks for the thorough review @fchollet

We have added the generated files after some minor edits (removing spaces and adding a period to the description).

Note: The code was more than 300 lines, so we modified the tutobook.py and generated the files. Will that be a problem?

[fchollet]

Awesome -- thank you for the great contribution! 👍

[fchollet]

Note: The code was more than 300 lines, so we modified the tutobook.py and generated the files. Will that be a problem?

As much as possible, this should be avoided, but it's not a blocker.