Skip to content
This repository

HTTPS clone URL

Subversion checkout URL

You can clone with HTTPS or Subversion.

Download ZIP
Browse code

Fixed weight decay to scale with learning rate.

  • Loading branch information...
commit 0369e3b334eeeb26495b8b6812f2d3076f7e4596 1 parent abbbab1
Clement Farabet clementfarabet authored

Showing 1 changed file with 1 addition and 1 deletion. Show diff stats Hide diff stats

  1. +1 1  sgd.lua
2  sgd.lua
@@ -43,7 +43,7 @@ function optim.sgd(opfunc, x, state)
43 43
44 44 -- (2) weight decay
45 45 if wd ~= 0 then
46   - x:add(-wd, x)
  46 + x:add(-wd*lr, x)
47 47 end
48 48
49 49 -- (3) learning rate decay (annealing)

0 comments on commit 0369e3b

Please sign in to comment.
Something went wrong with that request. Please try again.