Write a guide, HOWTO and/or example that shows how to correctly deal with the last batch during eval #1850
Labels
Priority: P2 - no schedule
Best effort response and resolution. We have no plan to work on this at the moment.
Status: pull requests welcome
We agree with the direction proposed, feel free to give it a shot and file a pull request
See #264 for the original motivation -- many naive implementations of eval loop over a full dataset would incorrectly deal with the last batch, that may be smaller than the others, including most of our examples. A fully complete solution would add complexity to the examples, so depending on how educational they are, it may not be the right tradeoff. Instead, we should clearly document in one place the full set of best practices to achieve this, and if needed, add utility functions to Flax to make this easier to do.
The text was updated successfully, but these errors were encountered: