Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Shared files in global cache #495

Merged
merged 5 commits into from
Mar 7, 2022
Merged

Shared files in global cache #495

merged 5 commits into from
Mar 7, 2022

Conversation

adammoody
Copy link
Contributor

@adammoody adammoody commented Mar 6, 2022

This enables one to define a STORE with GROUP=WORLD to use a global file system for cache. Several large issues must be resolved, but this provides enough to run jobs for testing those other work items.

As an example, one can do the following:

First define a WORLD-enabled STORE descriptor. This can be done via an SCR config file or through an SCR_Config API call within the application, e.g.,

SCR_Config("STORE=/p/lustre/$USER/scrcache GROUP=WORLD");

Then at run time, enable cache and point to the STORE location to be used as cache.

export SCR_CACHE_BYPASS=0
export SCR_CACHE_BASE=/p/lustre/$USER/scrcache

A new --global-store option in test_api can be used to specify a directory path. If provided, test_api internally calls SCR_Config to configure that path to be a global store. One can then run test_api and write a shared file to cache. So the full usage looks something like:

export SCR_CACHE_BYPASS=0
export SCR_CACHE_BASE=/p/lustre/$USER/scrcache
srun -n4 -N4 ./test_api --shared-file --global-store $SCR_CACHE_BASE

@adammoody adammoody merged commit 81751f1 into develop Mar 7, 2022
@adammoody adammoody deleted the sharedcache branch March 7, 2022 17:21
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant