Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Singularity #2

Open
pvandyken opened this issue Sep 17, 2021 · 0 comments
Open

Singularity #2

pvandyken opened this issue Sep 17, 2021 · 0 comments
Labels
enhancement New feature or request

Comments

@pvandyken
Copy link
Owner

Singularity will eventually be one of the core features of the library. The computecanada clusters present unique challenges for pulling and organizing images, and the recommended procedures should be baked into easy-to-use scripts. Ideally, the solution will still be generalizable to other compute clusters.

The basic scheme will be as follows:

  • Images will be pulled using the 2-step method recommended by computecanada (see here).
  • Pulled images will be stored in a location of the user's choosing. In the case of computecanada, they will be on the project space in the user's personal file. Any arbitrary location could be specified, however.
  • Users should also be able to indicate a central image repository on the cluster to which they have read access. This saves space by allowing users to share commonly used packages. The common images should be symlinked in the user's personal directory. kslurm should manage this symlinking process
@pvandyken pvandyken added the enhancement New feature or request label Sep 17, 2021
@pvandyken pvandyken added this to the Neuroglia Helpers Parity milestone Sep 17, 2021
@pvandyken pvandyken mentioned this issue Sep 17, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant