View this on GitHub Pages.
Short Tutorial Session
Venue: ECP Annual Meeting 2022
Date: Friday, May 6, 2022 2:30pm - 4:00pm EDT
Location: Remote
Topic Area: Programming Models & Systems Software
Keywords: Containerized HPC, System Software and Runtime Systems, Scientific Software Development, DevOps
Appropriate login details to our EC2 VM instances and an (optional) training account to the Cori supercomputer will all be provided to you at the start of the tutorial session. Please claim your own instance in the table at the bottom of the Google Doc
hostname: tutXX.supercontainers.org
user: tutorial
password: Will be provided
hostname: cori.nesrc.gov
Sign Up; Go to this page to sign up for the account. Use training code dJ2d. If you already have a NERSC account, you can use that account.
Container computing has revolutionized the way applications are developed and delivered. It offers opportunities that never existed before for significantly improving efficiency of scientific workflows and easily moving these workflows from the laptop to the supercomputer. Tools like Docker, Shifter, Singularity and Charliecloud enable a new paradigm for scientific and technical computing. However, to fully unlock its potential, users and administrators need to understand how to utilize these new approaches. This tutorial will introduce attendees to the basics of creating container images, explain best practices, and cover more advanced topics such as creating images to be run on HPC platforms using various container runtimes. The tutorial will also explain how research scientists can utilize container-based computing to accelerate their research and how these tools can boost the impact of their research by enabling better reproducibility and sharing of their scientific process without compromising security.
This is an short version of the highly successful tutorial presented at multiple SC conferences and multiple ECP Summit Meetings.
This is a hands-on tutorial. Participants will need a laptop/workstation with an ssh client to make best use of time during the tutorial. We will be providing training user accounts to both pre-configured EC2 instances as well as the Cori Supercomputer at NERSC.
This tutorial is supported by the Amazon AWS Machine Learning Research Awards. EC2 images and temporary login credentials will be distributed onsite at the tutorial.
After the tutorial, you can boot our tutorial image yourself on Amazon EC2 to run through the tutorial again. We recommend you use your own EC2 key and change the password.
US-West-Oregon: ami-09bd35c8089302e0d
Users can also install Docker and Singularity prior to attending the tutorial session. Here, it may be beneficial to create a docker and sylabs (singularity) account in advance at https://cloud.docker.com/ and https://cloud.sylabs.io/ This accounts will be needed to create images on docker cloud/dockerhub and sylabs cloud.
You can ask questions verbally or with this Google Doc. Please append your question below the others in the document.
We have also created a Slack Team for any and all related HPC container discussions. The invitation link is here.
Note: times are listed in EDT
2:30 – 2:45 Introduction to Containers in HPC (Younge)
2:45 – 3:00 How to build your first Docker container (Canon)
3:00 – 3:15 How to deploy a container on a supercomputer (Canon)
3:15 - 3:45 Containers and E4S (Shende)
3:45 - 4:00 Best Practices and Wrap Up (Canon)