Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Regression tests of all methods on VGG19 #3

Closed
Tracked by #2
adrhill opened this issue Oct 19, 2021 · 0 comments · Fixed by #11
Closed
Tracked by #2

Regression tests of all methods on VGG19 #3

adrhill opened this issue Oct 19, 2021 · 0 comments · Fixed by #11
Labels
tests Package testing

Comments

@adrhill
Copy link
Member

adrhill commented Oct 19, 2021

Metalhead disabled pretrained weights in 0.6.0 due to model inaccuracies.
These can technically still be loaded while they are being fixed:

model = VGG19()
Flux.loadparams!(model.layers, weights("vgg19"))

However, the VGG19 weights are a 548 MB download every time CI is run. It might therefore be more reasonable to use a smaller model. Currently, MetalheadWeights contains (in ascending size):

  • SqueezeNet (5 MB) -> requires Parallel for "fire" modules
  • GoogLeNet (27 MB) -> requires Parallel
  • Densenet121 (31 MB) -> requires SkipConnection
  • ResNet-50 (98 MB) -> requires Parallel, skip_identity
  • VGG-19 (548 MB)

An easy workaround would be to run the methods on randomly initialized parameters (with fixed seed). The explanations w.r.t. to this model should still stay constant.

@adrhill adrhill mentioned this issue Oct 19, 2021
3 tasks
@adrhill adrhill added the tests Package testing label Oct 19, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
tests Package testing
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant