You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Weight decay should be implemented by adding an L2 term to the loss (I guess it would be useful to have a helper function that generates this term for an entire network, given the top layer). Support for weight decay should be removed from all update generation code (see discussion in #58).
The text was updated successfully, but these errors were encountered:
benanne
changed the title
Code in nntools.updates should not deal with weight decay
Code in lasagne.updates should not deal with weight decay
Dec 15, 2014
Weight decay should be implemented by adding an L2 term to the loss (I guess it would be useful to have a helper function that generates this term for an entire network, given the top layer). Support for weight decay should be removed from all update generation code (see discussion in #58).
The text was updated successfully, but these errors were encountered: