ADIOS2 : The Adaptable Input Output System version 2
This is ADIOS2: The Adaptable Input/Output (I/O) System.
ADIOS2 is developed as part of the United States Department of Energy's Exascale Computing Project. It is a framework for scientific data I/O to publish and subscribe to data when and where required.
ADIOS2 transports data as groups of self-describing variables and attributes across different media types (such as files, wide-area-networks, and remote direct memory access) using a common application programming interface for all transport modes. ADIOS2 can be used on supercomputers, cloud systems, and personal computers.
ADIOS2 focuses on:
- Performance I/O scalability in high performance computing (HPC) applications.
- Adaptability unified interfaces to allow for several modes of transport (files, memory-to-memory)
- Ease of Use two-level application programming interface (APIs)
- Full APIs for HPC applications: C++11, Fortran 90, C 99, Python 2 and 3
- Simplified High-Level APIs for data analysis: Python 2 and 3, C++11, Matlab
In addition, ADIOS2 APIs are based on:
MPI Although ADIOS2 is MPI-based, it can also be used in non-MPI serial code.
Data Groups ADIOS2 favors a deferred/prefetch/grouped variables transport mode by default to maximize data-per-request ratios. Sync mode, one variable at a time, is treated as the special case.
Data Steps ADIOS2 follows the actual production/consumption of data using an I/O “steps” abstraction removing the need to manage extra indexing information.
Data Engines ADIOS2 Engine abstraction allows for reusing the APIs for different transport modes removing the need for drastic code changes.
Documentation is hosted at readthedocs.
If you find ADIOS2 useful, please cite our SoftwareX paper, which also gives a high-level overview to the motivation and goals of ADIOS; complementing the documentation.
Spack: adios2 package
Docker images: under scripts/docker
Once ADIOS2 is installed refer to:
If you find a bug, please open an issue on ADIOS2 github repository
See the Contributor's Guide to ADIOS 2 for instructions on how to contribute.
ADIOS2 is licensed under the Apache License v2.0. See the accompanying Copyright.txt for more details.
bindings - public application programming interface, API, language bindings (C++11, C, Fortran, Python and Matlab)
cmake - Project specific CMake modules
examples - Simple set of examples in different languages
scripts - Project maintenance and development scripts
source - Internal source code for private components
adios2 - source directory for the ADIOS2 library to be installed under install-dir/lib/libadios2.
utils - source directory for the binary utilities, to be installed under install-dir/bin
testing - Tests using gtest