add nesterov momentum

[watason]

Summary

implimentation nesterov momentum

Purpose

Contents

Testing Methods Performed

[come2ry]

@watason
Up to how many input sizes is this optimization function guaranteed to work?

[watason]

@come2ry
i'm not sure what you are talking about.
sgd does not depend data size,also nesterov does not.
it works as long as the data load correctly.

[come2ry]

@watason
It appears that the test of learning with this optimization function is only guaranteed to work with 5 input data.

Is there a guarantee that this optimization function will not cause errors or accuracy problems with, for example, 1,000,000 data inputs?

[watason]

@come2ry

Is there a guarantee that this optimization function will not cause errors or accuracy problems with, for example, 1,000,000 data inputs?

i see.
are you asking me to guarantee the input size?
then i think this is not the place to talk about it.
if you want the number of cases of guarantee , please make it an issue in another task.
no other optimizer guarantees it.
basically, it depends on sgd.
if sgd works , it works.

[come2ry]

Okay, I understand.

[arukuka]

Thank you for your contribution! LGTM.

This is a quite minute thing, but there is a notational variation in the author of the commit.
Could you correct it if you don't mind?
Also, please register email address used to GitHub for showing icon. 🙇

[watason]

@arukuka
wtf
asap i change.
thanks!

[arukuka]

Thank you for your quick response!
I will merge it.