PittPack is an open-source Poisson’s equation solver for extreme-scale computing with accelerators.
The main goal is to solve the Poisson's equation with second order accuracy on a directionally uniform Cartesian grid on CPU or GPU
clusters. PittPack uses two FFT transforms in x and y directions along with a tridiagonal solve in the z direction.
Due to FFT, it limits the boundary conditions in the x and y directions to one of the following combinations
- Periodic
- Neumann-Neumann
- Neumann-Dirichlet
- Dirichlet-Dirichlet
- Hybrid MPI/OpenACC parallelization
- Chunked-Pencil Decomposition
- Low-memory communication pattern option via pairwise-exchange algorithm
- User-friendly interface
PittPack provides config.sh which can be used to automatically configure the code for Stampede2 (https://www.tacc.utexas.edu/systems/stampede2), Comet (https://www.sdsc.edu/services/hpc/hpc_systems.html) and Bridges (https://www.psc.edu/resources/computing/bridges) clusters
source config.sh
When prompted respond by entering 0 or 1
- (0) : will configure PittPack for CPU clusters
- (1) : will configure PittPack for GPU clusters
PittPack requires the following libraries
- cmake
- MPI
- FFTW3
- cuFFT
- OpenACC (available through the PGI C++ compiler)
- HDF5 with Parallel IO
PittPack uses CMakeLists.txt and CMakeModules folder to detect the library paths.
These two components are crucial for complilation of PittPack.
Perform the following steps
cd build
cmake ..
make
The executable will be placed in the /bin folder
mpirun -np N ./bin/PittPack nx ny nz
- N: Number of processes (squared number)
- nx: Number of elements in X-direction
- ny: Number of elements in Y-direction
- nz: Number of elements in Z-direction
- The output is written to the /soln folder
- Paraview can be used to visualize the solution
- Simply open the file ending with xdmf in soln/
PittPack
│ README.md
│ CMakeLists.txt
│ LICENSE
│ config.sh
│
└─── CMakeModules
│ │ FindPGI.cmake: cmake script to find PGI
│ │ FindMYMPI.cmake: cmake script to find MPI
│ │ FindMYHDF5.cmake: cmake script to find HDF5
│ │ FindGOOGLETEST.cmake: cmake script to find Google Test
│ │ FindFFTW.cmake: cmake script to find FFTW
│
└─── src
│ │ chunkedArray.cpp: Abstracts access patterns
│ │ communicate.cpp: MPI communications
│ │ mathFunction.cpp: Defines math functions for kernel generation by PGI
│ │ signalProc.cpp: Performs FFT transforms
│ │ poissonCPU.cpp: Inherits from class PencilDcmp and specialized for CPU
│ │ poissonGPU.cpp: Inherits from class PencilDcmp and specialized for GPU
│ │ pencilDcmp.cpp: Incorporates Decomposition strategy and communication patterns
│ │ triDiag.cpp: Class for tridiagonal solvers
│ │ phdf5.cpp: Class for handling IO with hdf5
│ │
│ └─── include (headers)
│ │ pittpack.h
│ │ chunkedArray.hpp
│ │ communicate.hpp
│ │ mathFunction.hpp
│ │ signalProc.hpp
│ │ poissonCPU.hpp
│ │ poissonGPU.hpp
│ │ pencilDcmp.hpp
│ │ triDiag.hpp
│ │ phdf5.hpp
│ │ params.h
│ │ definitions.h
│
└─── bin
│ PittPack (executable)
│
│
└─── build
│ Will be populated by cmake
│
│
└─── soln
│ │ Pxdmf3d1.h5: outputs the file in hdf5 format
│ │ Pxdmf3d1.xmf: meta data to be used by ParaView
│
└─── archives
For complete documentation visit www.pittpack.com
We welcome any feedbacks by the users and developers
Please read the LICENSE file for how to use this software
Please refer to the article listed in the publications section if your project uses PittPack.
PittPack is developed as part of the NSF-GEM3D Award No. 1440638.
It is developed at the Department of Mechanical Engineering at University Pittsburgh, PA, USA.
[1] Hasbestan, J. J., Xiao, C. N., & Senocak, I. (2020). PittPack: An open-source Poisson’s equation solver for extreme-scale computing with accelerators. Computer Physics Communications, p.107272 DOI: https://doi.org/10.1016/j.cpc.2020.107272.
- Jaber J. Hasbestan (jaber@pitt.edu)
- Inanc Senocak (senocak@pitt.edu)