LSTM-optimizer

Tensorflow 2.0 Keras implementation of "Learning to learn by gradient descent by gradient descent"

Reference

• Andrychowicz, M., Denil, M., Gomez, S., Hoffman, M. W., Pfau, D., Schaul, T., ... & De Freitas, N. (2016). Learning to learn by gradient descent by gradient descent. arXiv preprint arXiv:1606.04474.

P.S.: I cannot find any TF2-Keras or Pytorch implementation for this paper, so I built it myself, enjoy.

The dataset for this example is from keras.datasets.mnist