Skip to content

Latest commit

 

History

History
79 lines (47 loc) · 2.46 KB

quartz.rst

File metadata and controls

79 lines (47 loc) · 2.46 KB
Raw

Quartz (LLNL)

The Quartz Intel CPU cluster is located at LLNL.

Introduction

If you are new to this system, please see the following resources:

  • LLNL user account
  • Quartz user guide
  • Batch system: Slurm
  • Production directories:
    • /p/lustre1/$(whoami) and /p/lustre2/$(whoami): personal directory on the parallel filesystem
    • Note that the $HOME directory and the /usr/workspace/$(whoami) space are NFS mounted and not suitable for production quality data generation.

Installation

Use the following commands to download the WarpX source code and switch to the correct branch:

git clone https://github.com/ECP-WarpX/WarpX.git $HOME/src/warpx

We use the following modules and environments on the system ($HOME/quartz_warpx.profile).

../../../../Tools/machines/quartz-llnl/quartz_warpx.profile.example

We recommend to store the above lines in a file, such as $HOME/quartz_warpx.profile, and load it into your shell after a login:

source $HOME/quartz_warpx.profile

Then, cd into the directory $HOME/src/warpx and use the following commands to compile:

cd $HOME/src/warpx
rm -rf build

cmake -S . -B build
cmake --build build -j 6

This will build an executable in build/bin/. The other general compile-time options <building-cmake> apply as usual.

Running

Intel Xeon E5-2695 v4 CPUs

The batch script below can be used to run a WarpX simulation on 2 nodes on the supercomputer Quartz at LLNL. Replace descriptions between chevrons <> by relevant values, for instance <input file> could be plasma_mirror_inputs.

../../../../Tools/machines/quartz-llnl/quartz.sbatch

To run a simulation, copy the lines above to a file quartz.sbatch and run

sbatch quartz.sbatch

to submit the job.