Navigation Menu

Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Initialized the regVal for first iteration in SGD optimizer #40

Closed
wants to merge 1 commit into from
Closed

Initialized the regVal for first iteration in SGD optimizer #40

wants to merge 1 commit into from

Commits on Mar 1, 2014

  1. In runMiniBatchSGD, the regVal (for 1st iter) should be initialized 

    as sum of sqrt of weights if it's L2 update; for L1 update, the same logic is followed.
    DB Tsai committed Mar 1, 2014
    Copy the full SHA
    77d47da View commit details
    Browse the repository at this point in the history