hélios is a research code for large cosmological dataset compression.
It relies on particle clouds categorization or filtering, and includes three tools:
- compress: inflate or deflate distributed particle datasets, forked from cbench.
- combine: merge distributed particle datasets.
- analysis: compute entropy, filter and extract non-halos and generate plot scripts.
hélios can be built on Linux or macOS using CMake.
It requires a C++17 compiler and MPI as well.
It relies on a set of compression kernels with can be built from here.
They require gsl, zlib and fftw libraries.
Their installation paths should then be saved within environment variables.
export SZ_INSTALL_DIR="/path/to/foo" # save 'sz' compressor installation path
mkdir build && cd build # avoid in-source builds
cmake -DENABLE_SZ=ON .. # enable all kernels you want
make -j # use multiple compilation jobs
mpirun -np 4 ./tool params.json # tool=[compress|combine|analyzer]
Tools parameters are supplied through a JSON file.
hélios is part of the vizaly project.
It is an open source software available under the BSD-3 license.
(c) 2019, Los Alamos National Laboratory. All rights reserved.
See the license file for more details.