Skip to content

Latest commit

 

History

History
105 lines (77 loc) · 5.95 KB

index.md

File metadata and controls

105 lines (77 loc) · 5.95 KB
Raw
type title github_repo website tags summary image
modules
High Performance Computing
HPC
computecanda
alliancecanada
brainhackcloud
Introduction to HPC infrastructure and parallel computing, using Alliance Canada (formerly Compute Canada), or Brainhack Cloud.
alliancecanada_logo.jpg

Information

The estimated time to complete this training module is 4h.

The prerequisites to take this module are:

If you have any questions regarding the module content please ask them in the relevant module channel on the school Discord server. If you do not have access to the server and would like to join, please send us an email at school [dot] brainhack [at] gmail [dot] com.

Follow up with your local TA(s) to validate you completed the exercises correctly.

⚠️ It should be noted that recently Compute Canada changed its name to Alliance Canada. That does not change the relevance of the exercises presented here, but it can make some naming conventions outdated. For example, the documentation website for the clusters is no longer https://docs.computecanada.ca/wiki/Technical_documentation but https://docs.alliancecan.ca/wiki/Technical_documentation. However for now the old URLs redirect to the new ones so using the old names doesn't seem to create issues, but that might not stay true in the long run.

⚠️ A notable exception to the name change are the hostnames of the clusters for ssh connections. You still have to use the .computecanada.ca domain name. So for example if you want to connect to Beluga, you still need to type :

ssh <username>@beluga.computecanada.ca

⚠️ ⚠️ If you reside outside of Canada and don't have access to a local HPC you can apply to access Brainhack Cloud. Subsequently anytime the lecture material below refers to location-specific inputs you will have to adjust your inputs accordingly (e.g. the ssh connection).

Resources

This module was presented by Félix-Antoine Fortin during the QLSC 612 course in 2020.

The slides are available here.

The video of his presentation is available below:

<iframe width="560" height="315" src="https://www.youtube.com/embed/J9VCHe1ovBg" title="YouTube video player" frameborder="0" allow="accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture" allowfullscreen></iframe>

Exercise

  • Download the tutorial zip file :
wget https://raw.githubusercontent.com/brainhackorg/school/master/content/en/modules/HPC/cq-formation-premiers-pas-slurmcloud.zip
  • Copy the file to the beluga cluster :
scp cq-formation-premiers-pas-slurmcloud.zip <username>@beluga.computecanada.ca:

Note: You could have directly downloaded the file from the beluga cluster, but being familiar with the scp command is very useful.

  • Connect to the beluga cluster :
ssh <username>@beluga.computecanada.ca
  • Unzip the tutorial zip file :
unzip cq-formation-premiers-pas-slurmcloud.zip
  • You can remove the zip file :
rm cq-formation-premiers-pas-slurmcloud.zip
  • Do the exercises in the cq-formation-premiers-pas-slurmcloud folder, you can see the original instructions in the README files, for example :
cd cq-formation-premiers-pas-slurmcloud/1-base
cat README.en

Updated instructions can also be seen here, with slightly more detailed explanations :

{{< tabs tabTotal="6" tabID="instructions" tabName1="0-setting-up" tabName2="1-base" tabName3="2-sequentielles" tabName4="3-gnu-parallel" tabName5="4-lot-de-taches" tabName6="5-tache-mpi" >}} {{< tab tabNum="1" >}} {{% content "content/en/modules/HPC/0-setting-up.md" %}} {{< /tab >}} {{< tab tabNum="2" >}} {{% content "content/en/modules/HPC/1-base.md" %}} {{< /tab >}} {{< tab tabNum="3" >}} {{% content "content/en/modules/HPC/2-sequentielles.md" %}} {{< /tab >}} {{< tab tabNum="4" >}} {{% content "content/en/modules/HPC/3-gnu-parallel.md" %}} {{< /tab >}} {{< tab tabNum="5" >}} {{% content "content/en/modules/HPC/4-lot-de-taches.md" %}} {{< /tab >}} {{< tab tabNum="6" >}} {{% content "content/en/modules/HPC/5-tache-mpi.md" %}} {{< /tab >}} {{< /tabs >}}


  • Follow up with your local TA(s) to validate you completed the exercises correctly.
  • 🎉 🎉 🎉 you completed this training module! 🎉 🎉 🎉

More resources

The Alliance Canada wiki is a great source of tutorials, advice and good practices. Be sure to head there first before asking the staff for help. You can also ask the instructors in the BrainHack school discord.