Advanced Parallel Programming

Exercise material and model answers for the CSC course "Advanced Parallel Programming". The course is part of PRACE Advanced Training Center (PATC) activity at CSC.

Exercises

General instructions

MPI & OpenMP recap

• Heat equation solver parallelized with OpenMP
• Heat equation solver parallelized with MPI

Hybrid MPI+OpenMP programming

• Hybrid Hello World
• Hybrid heat equation solver, part 1
• Multiple thread communication
• Hybrid heat equation solver, part 2

Advanced MPI

• Cartesian grid process topology
• Datatype for a struct / derived type
• 2D-decomposed heat equation
• One-sided communication in a message chain
• One-sided communication in the heat equation solver

Parallel I/O

• Parallel I/O with Posix
• Simple MPI-IO
• HDF5 example
• Bonus: Checkpoint + restart with MPI-IO