Skip to content

Commit

Permalink
Update filesystems.md
Browse files Browse the repository at this point in the history
  • Loading branch information
mtrahan41 committed Apr 15, 2021
1 parent ad3df0a commit 444b8a9
Showing 1 changed file with 11 additions and 0 deletions.
11 changes: 11 additions & 0 deletions docs/compute/filesystems.md
Original file line number Diff line number Diff line change
Expand Up @@ -56,6 +56,17 @@ space on the [PetaLibrary](petalibrary.html). Inappropriate use of scratch
storage, including attempts to circumvent the automatic file purge
policy, may result in loss of access to Research Computing resources.

#### Local Scratch on Summit and Blanca
All Summit nodes and most Blanca nodes have a local scratch area exceeding 100GB ideal for heavily used temporary files. This directory can be accessed in a job script with the $SLURM_SCRATCH variable. To ensure local scratch space remains free for subsequent jobs files placed in this directory will be removed automatically on job completion (successful or otherwise) and cannot be recovered. Therefore, before your job script exits it is important to copy any newly created files to a persistent file system such as your /projects/$USER directory.

As an example of how to use $SLURM_SCRATCH, the following code copies a file to the temporary directory, operates on the file in some fashion creating a new file, then copies that new file back to the projects directory before the job ends.

```
cp /projects/user1234/job/tmp_file $SLURM_SCRATCH
# Do stuff to tmp_file and generate new_file
cp new_file /projects/user1234/job/new_file
```


### Monitoring Disk Usage

Expand Down

0 comments on commit 444b8a9

Please sign in to comment.