Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

clarify how to stream data to sgd #100

Open
alexanderchernyakovgithub opened this issue Sep 29, 2017 · 1 comment
Open

clarify how to stream data to sgd #100

alexanderchernyakovgithub opened this issue Sep 29, 2017 · 1 comment

Comments

@alexanderchernyakovgithub

I noticed in the vignette it alludes to being able to stream data to sgd via bigmemory but I can't seem to find any examples of how to do this. Could you please provide some in the docs?

@TravisDunlop
Copy link

TravisDunlop commented Nov 16, 2017

I am trying to do something similar (only with ffdf). Currently, I'm trying to break the data into chunks, calling sgd on each chunk and passing the output as the starting value for the next chunk. But it doesn't converge to the same solution as when I call sgd on the whole data all at once. I think it's because the learning rate resets with each call to sgd. However, even with setting lr and lr.control I don't see a way to pass the learning rate onto the next chunk. I would try and code it myself if I knew C++!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants