You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
First of all, this is a great package from lucidrains and I find it very helpful in my research.
A quick question is that I noticed ViT-performer is slower than the regular ViT from lucidrains. For example running on mnist from pytorch will take 15 sec/epoch for regular ViT with the configuration below while ViT performer takes 23 sec/epoch.
Checking the parameter count also shows ViT-performer has double the size of regular ViT.
I am hoping that someone has intuition about the speed of ViT performer vs regular ViT and their parameter counts.
Thank you very much in advance!
The text was updated successfully, but these errors were encountered:
Hi,
First of all, this is a great package from lucidrains and I find it very helpful in my research.
A quick question is that I noticed ViT-performer is slower than the regular ViT from lucidrains. For example running on mnist from pytorch will take 15 sec/epoch for regular ViT with the configuration below while ViT performer takes 23 sec/epoch.
Checking the parameter count also shows ViT-performer has double the size of regular ViT.
I am hoping that someone has intuition about the speed of ViT performer vs regular ViT and their parameter counts.
Thank you very much in advance!
The text was updated successfully, but these errors were encountered: