[AAAI 2022] This is the official PyTorch implementation of "Less is More: Pay Less Attention in Vision Transformers"
-
Updated
Jun 19, 2022 - Python
#
mlps
Here are 2 public repositories matching this topic...
Implementation of the model "Hedgehog" from the paper: "The Hedgehog & the Porcupine: Expressive Linear Attentions with Softmax Mimicry"
open-source
ai
ml
attention
multi-modal
neural-nets
feedforward
softmax
attention-is-all-you-need
attention-mechanisms
mlps
ffns
opensource-ai
-
Updated
Mar 11, 2024 - Python
Improve this page
Add a description, image, and links to the mlps topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the mlps topic, visit your repo's landing page and select "manage topics."