Skip to content

Latest commit

 

History

History
37 lines (30 loc) · 1.83 KB

overview.rst

File metadata and controls

37 lines (30 loc) · 1.83 KB

Overview

This section provides an overview of features in I/O backends.

Feature ADIOS1 ADIOS2 HDF5 JSON
Operating Systems Linux, OSX

Linux

, OSX, Win dows
------------------ ------------- -------------- ---------- -----------
Serial supported supported supported supported
MPI-parallel supported supported supported no
Dataset deletion no no supported supported
Compression upcoming supported upcoming no
Streaming/Staging not exposed upcoming no no
Portable Files limited awaiting yes yes
PByte-scalable yes yes no no
Performance A TBD B C
Native File Format .bp (BP3) .bp (BP4) .h5 .json
  • supported/yes: implemented and accessible for users of openPMD-api
  • upcoming: planned for upcoming releases of openPMD-api
  • limited: for example, limited to certain datatypes
  • awaiting: planned for upcoming releases of a dependency
  • TBD: to be determined (e.g. with upcoming benchmarks)

Selected References

  • Axel Huebl, Rene Widera, Felix Schmitt, Alexander Matthes, Norbert Podhorszki, Jong Youl Choi, Scott Klasky, and Michael Bussmann. On the Scalability of Data Reduction Techniques in Current and Upcoming HPC Systems from an Application Perspective, ISC High Performance 2017: High Performance Computing, pp. 15-29, 2017. arXiv:1706.00522, DOI:10.1007/978-3-319-67630-2_2