Skip to content

Latest commit

 

History

History
178 lines (117 loc) · 7 KB

buildinstructions.rst

File metadata and controls

178 lines (117 loc) · 7 KB
Raw

Build Instructions

Build with CMake (recommended)

First, clone the h5bench GitHub repository and ensure you are cloning the submodules:

git clone --recurse-submodules https://github.com/hpc-io/h5bench

If you are upadting your h5bench, ensure you have the latest submodules that could be included in new releases:

git submodule update --init

Dependency and environment variable settings

H5bench depends on MPI and parallel HDF5.

Use system provided by HDF5

For instance on the Cori system at NERSC:

module load cray-hdf5-parallel

You can also load any paralel HDF5 provided on your system, and you are good to go.

Use your own installed HDF5

Make sure to unload any system provided HDF5 version:, and set an environment variable to specify the HDF5 install path:

export HDF5_HOME=/path/to/your/hdf5/installation

It should point to a path that contains the include/, lib/, and bin/ subdirectories.

Compile with CMake

In the source directory of your cloned h5bench repository, run the following:

mkdir build
cd build

cmake ..

make
make install

Warning

If you plan on calling make install please notice that the default behavior of CMake is to install it system-wide. You can change the destination installation folder by passing the -DCMAKE_INSTALL_PREFIX=<path> to override with your defined installation directory.

By default, h5bench will only compile the base write and read benchmarks. To enable the additional benchmarks, you need to explicitly enable them before building h5bench. You can also enable all the benchmarks with -DH5BENCH_ALL=ON. Notice that some of them have additional dependencies.

Benchmark Name Build
h5bench write h5bench_write Always
h5bench read h5bench_read Always
Metadata Stress h5bench_hdf5_iotest -DH5BENCH_METADATA=ON
AMReX h5bench_amrex -DH5BENCH_AMREX=ON
Exerciser h5bench_exerciser -DH5BENCH_EXERCISER=ON
OpenPMD (write) h5bench_openpmd_write -DH5BENCH_OPENPMD=ON
OpenPMD (read) h5bench_openpmd_read -DH5BENCH_OPENPMD=ON
E3SM-IO h5bench_e3sm -DH5BENCH_E3SM=ON
MACSio h5bench_macsio -DH5BENCH_MACSIO=ON

Warning

If you want to specify the installation directory, you can pass -DCMAKE_INSTALL_PREFIX to cmake. If you are not installing it, make sure when you run h5bench, you update your environment variables to include the build directory. Otherwise, h5bench will not be able to find all the benchmarks.

Build with HDF5 ASYNC VOL connector support

To run _async benchmarks, you need the develop branch of both HDF5 and ASYNC-VOL. When building h5bench you need to specify the -DWITH_ASYNC_VOL:BOOL=ON option and have already compiled the VOL connector in the $ASYNC_VOL directory:

mkdir build
cd build

cmake .. -DWITH_ASYNC_VOL=ON -DCMAKE_C_FLAGS="-I/$ASYNC_VOL/src -L/$ASYNC_VOL/src"

make
make install

h5bench will automatically set the environment variables required to run the asynchronous versions, as long as you specify them in your JSON configuration file. However, if you run the benchmarks manually, you will need to set the following environment variables:

export HDF5_HOME="$YOUR_HDF5_DEVELOP_BRANCH_BUILD/hdf5"
export ASYNC_HOME="$YOUR_ASYNC_VOL/src"

export HDF5_VOL_CONNECTOR="async under_vol=0;under_info={}"
export HDF5_PLUGIN_PATH="$ASYNC_HOME"

# Linux
export LD_LIBRARY_PATH="$HDF5_HOME/lib:$ASYNC_HOME"
# MacOS
export DYLD_LIBRARY_PATH="$HDF5_HOME/lib:$ASYNC_HOME"

Build with Spack

You can also use Spack to install h5bench:

spack install h5bench

There are some variants available as described bellow:

CMakePackage:   h5bench

Description:
    A benchmark suite for measuring HDF5 performance.

Homepage: https://github.com/hpc-io/h5bench

Preferred version:
    1.2        [git] https://github.com/hpc-io/h5bench.git at commit 866af6777573d20740d02acc47a9080de093e4ad

Safe versions:
    develop    [git] https://github.com/hpc-io/h5bench.git on branch develop
    1.2        [git] https://github.com/hpc-io/h5bench.git at commit 866af6777573d20740d02acc47a9080de093e4ad
    1.1        [git] https://github.com/hpc-io/h5bench.git at commit 1276530a128025b83a4d9e3814a98f92876bb5c4
    1.0        [git] https://github.com/hpc-io/h5bench.git at commit 9d3438c1bc66c5976279ef203bd11a8d48ade724
    latest     [git] https://github.com/hpc-io/h5bench.git on branch master

Deprecated versions:
    None

Variants:
    Name [Default]                 When       Allowed values          Description
    ===========================    =======    ====================    ==================================

    all [off]                      @1.2:      on, off                 Enables all h5bench benchmarks
    amrex [off]                    @1.2:      on, off                 Enables AMReX benchmark
    build_type [RelWithDebInfo]    --         Debug, Release,         CMake build type
                                              RelWithDebInfo,
                                              MinSizeRel
    e3sm [off]                     @1.2:      on, off                 Enables E3SM benchmark
    exerciser [off]                @1.2:      on, off                 Enables exerciser benchmark
    ipo [off]                      --         on, off                 CMake interprocedural optimization
    metadata [off]                 @1.2:      on, off                 Enables metadata benchmark
    openpmd [off]                  @1.2:      on, off                 Enables OpenPMD benchmark

Build Dependencies:
    cmake  hdf5  mpi  parallel-netcdf

Link Dependencies:
    hdf5  mpi  parallel-netcdf

Run Dependencies:
    None

Warning

Current h5bench versions in Spack do not have support for the HDF5 VOL async/cache connectors yet.