Skip to content
This repository has been archived by the owner on Nov 17, 2023. It is now read-only.

Use iterations directly instead of epoch_size #656

Closed
futurely opened this issue Nov 20, 2015 · 7 comments
Closed

Use iterations directly instead of epoch_size #656

futurely opened this issue Nov 20, 2015 · 7 comments

Comments

@futurely
Copy link

From the early experiences of training DL models BVLC/caffe#59 (comment), most of the time epoch size, i.e. the number of samples, is a totally unnecessary and annoying burden for the users to maintain. It's much more natural to use iterations directly and automatically go to the beginning at the end of the dataset. At least it should become optional and secondary to iterations.

@jermainewang
Copy link
Contributor

I think we already support that. The NDArrayIter could support last_batch_mode as roll_over which may be what you want?

@futurely
Copy link
Author

To be more clear, I mean these epoch_size should be replaced by iterations.

@tqchen
Copy link
Member

tqchen commented Nov 20, 2015

These are optional parameters, which are only needed for consensus purpose for distributed training. For single machine, num_epoch is used

@futurely
Copy link
Author

The document should be more explicit about the usage of user facing parameters.

@tqchen
Copy link
Member

tqchen commented Nov 20, 2015

Yes, you are absolutely right. The best way is to improve it when we find things that can be improved, so it can always be better? It would be great if you can open a PR to contribute your wisdom into this case and improve the docstring so people won't get confused later

Thanks!

@futurely
Copy link
Author

This example is just a special case of the bigger issue in #657.

@tqchen
Copy link
Member

tqchen commented Nov 20, 2015

Again it will be great to have your contribution in opening a PR to help making mxnet better. I see improvement even w.r.t. to this issue is great for all of us, and such steps of changes can again big momentum easier, with your wisdom and code into it

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants