Skip to content

allscale/allscale_ipic3d

Repository files navigation

ipic3d

This project is the AllScale implementation of the Particle-in-Cell (PIC) method; the original pilot is called iPIC3D. This pilot is used for the simulation of space and fusion plasmas during the interaction between the solar wind and the Earth magnetic field. These physical processes may effect people and technology in space and on the Earth.

Quickstart

Ensure you have GCC 6 (or 7) installed and set as your default C/C++ compiler. Furthermore CMake 3.6 (or later) is required for the build and testing process. Simply execute the following commands to build the project and run all tests.

$ mkdir build
$ cd build
$ cmake ../code
$ make -j8
$ ctest -j8

Application Usage and Output Verification

The main executable takes as a single argument the path to an input configuration file.

$ app/ipic3d ../inputs/test.inp

Several example configuration files with varying problem sizes are provided in the inputs directory. The executable will then parse the configuration file, print the simulation parameters and commence the simulation. During the simulation, a number of output files (*.out) are generated, together with a final output file (test.out in case of the example above) at the end of the simulation.

For the provided example configuration files the simulation can be verified by comparing the final output file with reference output provided in the outputs directory. Due to the parallelism involved, the data is written out-of-order and sorting is required before comparison. To facilitate such checks, a bash script verify_output.sh is provided. It takes the problem case as an optional parameter (the default is test), runs the main executable with the corresponding input configuration, sorts the produced output data and compares it to the reference output. At the end, the script will report on whether a simulation run was correct or not.

Advanced Options

Configuration

Following options can be supplied to CMake

Option Values
-DCMAKE_BUILD_TYPE Release / Debug
-DBUILD_SHARED_LIBS ON / OFF
-DBUILD_TESTS ON / OFF
-DBUILD_DOCS ON / OFF
-DBUILD_COVERAGE ON / OFF
-DUSE_ASSERT ON / OFF
-DALLSCALE_CHECK_BOUNDS ON / OFF
-DENABLE_DEBUG_OUTPUT ON / OFF
-DUSE_VALGRIND ON / OFF
-DUSE_ALLSCALECC ON / OFF
-DENABLE_PROFILING ON / OFF
-DTHIRD_PARTY_DIR <path>

The files cmake/build_settings.cmake and code/CMakeLists.txt state their default value.

Using the AllScale Compiler

To use the AllScale compiler, you first have to setup the required dependencies in order to build it. Some packages should be installed with your system's package manager, others must be installed via the provided dependency installer. See scripts/dependencies/README.md for more details. The following commands assume you are using Ubuntu 16.04 LTS -- adjust the lines if you are using a different distribution.

$ sudo apt update
$ sudo apt install bison build-essential cmake flex git groff-base \
  libcpufreq-dev libgmp10 libhwloc-dev libjemalloc-dev libluajit-5.1-dev \
  libpapi-dev m4 pkg-config python ruby time wget zlib1g
$ scripts/dependencies/installer llvm boost cudd gmp zlib ghc cabal

To build this project using the AllScale compiler, simply set the corresponding CMake option. You may want to use a separate build directory to easily switch between GCC and AllScaleCC.

$ mkdir build_with_allscalecc
$ cd build_with_allscalecc
$ ../scripts/dependencies/third_party_linker
$ cmake -DUSE_ALLSCALECC=ON ../code
$ make -j8
$ ctest -j8

Development

Adding new Modules

The setup script can be run again to add new modules, just provide the same project name.

$ scripts/setup/run ipic3d frontend backend utils

Adding new Parts to Modules

There is a utility script to add new parts to an existing module. The project name and module name must be provided followed by a list of parts to generate. Folders will be created along the way.

$ scripts/setup/add_part ipic3d frontend sema extensions/malloc_extension

This will add the files sema.h, sema.cpp and sema_test.cc to the frontend module. Furthermore new subfolders extensions will be created containing malloc_extension.h, malloc_extension.cpp and malloc_extension_test.cc in their respective subdirectories.

Using a present AllScale Compiler / API project

The following two CMake options allow you to manually set the AllScale Compiler and AllScale API to use. Note that USE_ALLSCALECC must not be enabled for this to work.

Option Values
-DOVERRIDE_ALLSCALECC path to allscalecc binary
-DOVERRIDE_ALLSCALE_API path to AllScale API project

Executable Bit

When working on Windows via SMB share, consider setting following Git setting.

$ git config core.filemode false

Licensor

A script, together with a Git hook, is provided to automatically add a license header to each source file upon commit. See scripts/license.

Eclipse Project

$ cmake -G "Eclipse CDT4 - Unix Makefiles" /path/to/project

Visual Studio Solution

$ cmake -G "Visual Studio 15 2017 Win64" -DBUILD_SHARED_LIBS=OFF Z:\path\to\project

Add path for third-party libraries when needed.

Troubleshooting

Getting GCC 5 / CMake 3.5 / Valgrind (for Testing)

The dependency installer can setup these required tools for you. Its README (scripts/dependencies/README.md) holds the details.

It is preferred to use the operating system's package manager, if applicable.

No Source Folder in Eclipse Project

Make sure your build folder is located outside the source folder. Eclipse is not capable of dealing with such a setup correctly.

Coverage

Building the coverage us currently only supported on Linux, as Perl and Bash are required. To build and view the coverage set the corresponding CMake flag to ON and run:

$ make
$ make coverage
$ xdg-open coverage/index.html

About

iPIC3D: implicit Particle-in-Cell code for Space Weather Applications

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published