Speed HPC Facility

Speed: Gina Cody School HPC Facility: Scripts, Tools, and Refs

Concordia University, Montreal

• GCS Speed HPC Facility
• The Speed Manual (PDF, HTML)
• AITS Service Desk

Examples

• src/ -- sample job scripts
• doc/ -- user manual sources

Software List

• EL7 and EL9 Software List on Speed

Contributing and TODO

• Public issue tracker
• Contributions (pull requests) are welcome for your sample job scripts or links/references (subject to reviews)
• For Internal access and support requests, please see the GCS Speed Facility link above

Contributors

• See the overall GitHub contributors here
• Dr. Serguei A. Mokhov -- project lead
• Current HPC/Research support team: Gillian A. Roper, Carlos Alarcon Meza, Farah Salhany
• Dr. Tariq Daradkeh helped us with continuous support of Speed and its users and working on scheduling prediction. He has also integrated the OpenISS YOLOv3 example
• Anh H Nguyen contributed the HTML version of the manual and its generation off our LaTeX sources as well as the corresponding devcontainer environment
• The initial Grid Engine V6 manual was written by Dr. Scott Bunnell

References

Conferences

• Tariq Daradkeh, Gillian Roper, Carlos Alarcon Meza, and Serguei Mokhov. HPC jobs classification and resource prediction to minimize job failures. In International Conference on Computer Systems and Technologies 2024 (CompSysTech ’24), New York, NY, USA, June 2024. ACM. DOI: 10.1145/3674912.3674914
• Serguei Mokhov, Jonathan Llewellyn, Carlos Alarcon Meza, Tariq Daradkeh, and Gillian Roper. 2023. The use of Containers in OpenGL, ML and HPC for Teaching and Research Support. In ACM SIGGRAPH 2023 Posters (SIGGRAPH '23). Association for Computing Machinery, New York, NY, USA, Article 49, 1–2. DOI: 10.1145/3588028.3603676

Related Repositories

• OpenISS Dockerfiles -- the source of the Docker containers for the above poster as well as Singularity images based off it for Speed
• Sample complete more complex projects' repos than baby jobs based on the work of students and their theses:
  • https://github.com/NAG-DevOps/openiss-yolov3
  • https://github.com/NAG-DevOps/openiss-reid-tfk
  • https://github.com/NAG-DevOps/kg-recommendation-framework

Educational

• Linux and other tutorials from Software Carpentry
• Digital Research Alliance of Canada SLURM Examples
• Concordia's subscription to Udemy resources

Technical

• Slurm Workload Manager
• NVIDIA A100
• NVIDIA V100
• NVIDIA Tesla P6
• NVIDIA RTX 6000 Ada Generation
• AMD Tonga FirePro S7100X

Legacy

Speed no longer runs Grid Engine; these are provided for reference only.

• Altair Grid Engine (AGE) (formely Univa Grid Engine (UGE))
• UGE User Guide for version 8.6.3 (current version running on speed)
• Altair product documentation