-
Notifications
You must be signed in to change notification settings - Fork 38
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Saving calculations during mosaic map & final layer activations #1
Comments
First implementation in 8003359 Currently, the The |
Now implemented in b26b5a4. Layer activations are cached to PKL and optionally exported to CSV during calculation, and both can be imported by future models to remove the need for additional calculations. |
Deleted File Approved-by: Sara Kochanny <skochanny@uchicago.edu> Approved-by: James Dolezal <jamesmdolezal@gmail.com>
Deleted File Approved-by: Sara Kochanny <skochanny@uchicago.edu> Approved-by: James Dolezal <jamesmdolezal@gmail.com>
Deleted File Approved-by: Sara Kochanny <skochanny@uchicago.edu> Approved-by: James Dolezal <jamesmdolezal@gmail.com>
Deleted File Approved-by: Sara Kochanny <skochanny@uchicago.edu> Approved-by: James Dolezal <jamesmdolezal@gmail.com>
Deleted File Approved-by: Sara Kochanny <skochanny@uchicago.edu> Approved-by: James Dolezal <jamesmdolezal@gmail.com>
Deleted File Approved-by: Sara Kochanny <skochanny@uchicago.edu> Approved-by: James Dolezal <jamesmdolezal@gmail.com>
Deleted File Approved-by: Sara Kochanny <skochanny@uchicago.edu> Approved-by: James Dolezal <jamesmdolezal@gmail.com>
Deleted File Approved-by: Sara Kochanny <skochanny@uchicago.edu> Approved-by: James Dolezal <jamesmdolezal@gmail.com>
Deleted File Approved-by: Sara Kochanny <skochanny@uchicago.edu> Approved-by: James Dolezal <jamesmdolezal@gmail.com>
Currently, each mosaic map generation re-calculates final layer activations even if these have been calculated previously. In order to save time, calculated final layer activations should be saved to disk and re-used if the model and tfrecords list are the same.
Proposal: record model & tfrecord list into a JSON file and associate this combination with a filename for the saved final layer activations (CSV). During subsequent calls, this file should be loaded directly instead of re-calculated
The text was updated successfully, but these errors were encountered: