Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

LambdaResNet Implementation? #23

Open
verbose-void opened this issue Nov 12, 2020 · 4 comments
Open

LambdaResNet Implementation? #23

verbose-void opened this issue Nov 12, 2020 · 4 comments

Comments

@verbose-void
Copy link

I have been looking around and found one implementation of LambdaResNets, although there seem to be some metric performance problems and I've found wall-clock performance problems (runs ~7x slower than normal resnets).

Do you plan on putting out a lambdaresnet model in this repository?

@lucidrains
Copy link
Owner

Hi! I have no plans as my research interests rests in attention rather than convolutions

Feel free to submit a PR though!

@d-li14
Copy link

d-li14 commented Dec 10, 2020

@lucidrains Here is an implementation of Lambda ResNet with training logs and pre-trained models on ImageNet https://github.com/d-li14/lambda.pytorch. Would you please consider adding it to this repo?

@phongnhhn92
Copy link

@lucidrains Here is an implementation of Lambda ResNet with training logs and pre-trained models on ImageNet https://github.com/d-li14/lambda.pytorch. Would you please consider adding it to this repo?

@d-li14 Did your implementation require a lot of memory to train?

@innat
Copy link

innat commented Jan 10, 2021

Here is another attempt to integrate lambda-net into a pre-trained model. Work in progress though, https://github.com/innat/LamdaDenseNet-121

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

5 participants