10_may_2017

Learning to learn by gradient descent by gradient descent

Questions:

[@priba] No acabo d'entendre com s'optimitza el 'optimizee'. Diu que que fa gradient descend sobre phi, pero no veig perque calcula el loss d'aquesta forma.

[@gcucurull] In section 2.1, they say that the optimizer operates coordinatewise on the parameters, so that an LSTM is shared (same weights but different hidden state) for all the parameters. What do they mean with "Different behavior on each coordinate is achieved by using separate activations for each objective function parameter"?

Learned Optimizers that Scale and Generalize

Questions:

[@priba]