Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Previous version #2

Closed
yqu1 opened this issue May 28, 2018 · 4 comments
Closed

Previous version #2

yqu1 opened this issue May 28, 2018 · 4 comments

Comments

@yqu1
Copy link

yqu1 commented May 28, 2018

Hi, I was trying to use code from your previous version. I was wondering what were the problems in the previous version and were you able to successfully replicate the omniglot experiment?

@dragen1860
Copy link
Owner

dragen1860 commented May 28, 2018

hi, I recently found the first version of my code has an definitely distinct implementation, and I never realised it until the paper "repitle":https://blog.openai.com/reptile/ published. That's to say, I already implemented the reptile version but i have not published my approach before the paper.
Concisely:
the disparity of previous and current is:

  1. previous, reptile: theta = theta + meta_lr * (w - theta_pi)
  2. current, MAML: theta = theta - meta_lr * grad(Loss on theta_pi, theta)

@yqu1
Copy link
Author

yqu1 commented May 28, 2018

Thanks, the previous version (reptile) you are talking about is the one with the MetaLearner and Learner class, which you completely erased from the repository, right? were you able to achieve the accuracy described in the MAML paper for the omniglot experiment with the reptile implementation then?

@dragen1860
Copy link
Owner

yes, i move away the metalearner and learner code, which is well-written architecture for that version. You can still access previous version from https://github.com/dragen1860/Reptile-Pytorch.
Sorry for making it confuous.
Im working on memory mechanism and thereby MAML related research is interrupted temporarily.

@dragen1860
Copy link
Owner

Hi, I hv fixed current version bugs, u can pull latest version, which should works now on both omniglot and mini-imagenet.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants