You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
@bayerj
It seems there is a bug in adadelta.py when momentum is used.
The momentum correction can be applied to adadelta, rmrprop and others stochastic updates.
The potential bug is at the 110-th line of adadelta.py
@bayerj
It seems there is a bug in
adadelta.py
whenmomentum
is used.The
momentum
correction can be applied toadadelta
,rmrprop
and others stochastic updates.The potential bug is at the
110-th
line ofadadelta.py
I think it should be
step1 = step_m1 * m
instead ofstep1 = step_m1 * m * self.step_rate
.Correct me if I am wrong.
Note that in
rmsprop.py
, the160-th
line is, which is correct.
The text was updated successfully, but these errors were encountered: