Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

move fetch from init to have_restart #480

Merged
merged 6 commits into from
Feb 20, 2022
Merged

move fetch from init to have_restart #480

merged 6 commits into from
Feb 20, 2022

Conversation

adammoody
Copy link
Contributor

@adammoody adammoody commented Feb 19, 2022

This moves the fetch operation from SCR_Init to SCR_Have_restart. Datasets are still rebuilt during SCR_Init, and flushed if SCR_GLOBAL_RESTART is set.

This allows a user to specify the checkpoint that SCR should load by calling SCR_Current before SCR_Have_restart. Currently, one must specify the checkpoint name before calling SCR_Init, but some applications would prefer to call SCR_Init before they have identified the name of the checkpoint they want to load. In particular, for applications that scan the parallel file system for checkpoints, this enables SCR to rebuild and flush any cached checkpoints during SCR_Init to make those checkpoints visible to the scan. The application can then call SCR_Current to provide the name and before calling SCR_Have_restart.

Resolves #475

This PR also enables a user to call the Restart API after having written a dataset with the Output API. This is useful for some applications that test checkpoint/restart by writing a checkpoint and then immediately reading it back to restart.

Resolves #392

This PR also modifies the behavior of SCR_FETCH=0. The previous behavior disabled SCR from loading a checkpoint from the prefix directory. Now this setting causes SCR to switch into bypass mode during restart so that SCR_Route_file directs the application to read its files directly from the prefix directory.

@adammoody adammoody changed the title WIP: move fetch to have_restart move fetch from init to have_restart Feb 20, 2022
@adammoody adammoody merged commit 0825085 into develop Feb 20, 2022
@adammoody adammoody deleted the movefetch branch February 20, 2022 20:55
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
1 participant