Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

add TACC/ singularity to docs #827

Closed
adelavega opened this issue Oct 8, 2020 · 3 comments · Fixed by #1000
Closed

add TACC/ singularity to docs #827

adelavega opened this issue Oct 8, 2020 · 3 comments · Fixed by #1000
Assignees
Projects

Comments

@adelavega
Copy link
Collaborator

try running neuroscout-cli on TACC using singularity and document experience (formally) in the official docs.

@adelavega
Copy link
Collaborator Author

@rbroc showed interested in learning how to use TACC and singularity, so this might be a good issue for her to tackle. we'll discuss next thursday.

@adelavega
Copy link
Collaborator Author

adelavega commented Oct 23, 2020

@jdkent if you have some free cycles would you mind adding a singularity section to the neuroscout docs with your experience running this on TACC?

if you are interested, let me know if you need any help compiling the docs.

I imagine your example applies to all SLURM based systems.

Here's some good inspo too: https://fmriprep.org/en/latest/singularity.html

@adelavega adelavega added this to To Do (Frontend) in 0.9 via automation Oct 27, 2020
@adelavega adelavega moved this from To Do (Frontend) to Docs in 0.9 Oct 27, 2020
@jdkent
Copy link
Contributor

jdkent commented Oct 30, 2020

my example workflow for easy reference:

Here is my workflow for running neuroscout on tacc:

  • cd $WORK (not recommended to write files to home)
  • idev (wait for tacc to give you a compute node)
  • module load tacc-singularity
  • singularity pull docker://neuroscout/neuroscout-cli:version-0.4.1 (create the singularity image)
  • exit (logout of the idev session)

create a job file that looks like this:

#!/bin/bash
#SBATCH -J neuroscout3            # job name
#SBATCH -o /work/07723/jdk3232/lonestar/test_neuroscout.o%j
#SBATCH -N 1                # number of nodes requested
#SBATCH -n 24               # total number of mpi tasks requested
#SBATCH -p development      # queue (partition) -- normal, development, etc.
#SBATCH -t 01:30:00         # run time (hh:mm:ss) - 1.5 hours
#SBATCH --mail-user=james.kent@austin.utexas.edu
#SBATCH --mail-type=begin   # email me when the job starts
#SBATCH --mail-type=end     # email me when the job finishes
module load tacc-singularity
# test neuroscout
singularity run \
    --cleanenv \
    ${WORK}/neuroscout-cli_version-0.4.1.sif run \
        --n-cpus 24 \
        --work-dir ${SCRATCH}/data \
        --neurovault disable \
        ${SCRATCH}/tst M8Zv5

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
No open projects
0.9
  
Docs
2 participants