Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Batch running statistics being updated at validation time #4

Closed
AntreasAntoniou opened this issue Jun 21, 2018 · 1 comment
Closed

Comments

@AntreasAntoniou
Copy link

In line 340 of the maml.py file you use:

pred = self.net(support_x[i])

Which makes training to default to True. Do we really want the batch running stats to be updated at inference time?

@dragen1860
Copy link
Owner

dragen1860 commented Jun 22, 2018

Hi, About this problem, setting it to True or False does not have too much difference according to batchnorm setting, if i not wrong.
Especially for meta-learning problem, the meta-train includes 2 sub stages: training and test, so is meta-test.
Hence, I found it obscure to set the flag to True or False for meta-learning problem.
You can try to set it to False for meta-test, and see any improvement。

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants