Skip to content

Releases: hpc/ior

IOR version 4.0.0

12 Jan 00:55
Compare
Choose a tag to compare

New major features:

  • Add PMDK backend (Adrian Jackson)
  • Add CHFS backend (Osamu Tatebe)
  • Add AIO backend (Julian Kunkel)
  • New S3 backend (Julian Kunkel)
  • New md-workbench benchmark (Julian Kunkel)
  • New BFS backend (Osamu Tatebe)
  • Add GPUDirect Storage support (Julian Kunkel)

New minor features:

  • Updated DAOS backend to match latest DAOS APIs (Mohamad Chaarawi)
  • Updated HDF5 backend (Jordan Henderson)
  • Improved Spectrum Scale hint support (Pidad D'Souza)
  • Add CSV output (Sebastian Oeste)
  • Improved Gfarm support (Osamu Tatebe)
  • Updated HDFS backend
  • MDTest now has a directory renaming test
  • Add prologue/epilogue support (GUAN Xin)
  • Add stronger randomized data using golden primes (Glenn K. Lockwood)
  • Add dummy backend (Julian Kunkel)
  • Improved CephFS support (Pablo Llopis)
  • Improved PnetCDF support (Wei-keng Liao)

Bugfixes:

  • Expansive fixes to mdtest correctness (Julian Kunkel)

IOR version 4.0.0 release candidate 1

22 Feb 02:47
Compare
Choose a tag to compare
Pre-release

New major features:

  • Add PMDK backend (Adrian Jackson)
  • Add CHFS backend (Osamu Tatebe)
  • Add AIO backend (Julian Kunkel)
  • New S3 backend (Julian Kunkel)
  • New md-workbench benchmark (Julian Kunkel)
  • New BFS backend (Osamu Tatebe)
  • Add GPUDirect Storage support (Julian Kunkel)

New minor features:

  • Updated DAOS backend to match latest DAOS APIs (Mohamad Chaarawi)
  • Updated HDF5 backend (Jordan Henderson)
  • Improved Spectrum Scale hint support (Pidad D'Souza)
  • Add CSV output (Sebastian Oeste)
  • Improved Gfarm support (Osamu Tatebe)
  • Updated HDFS backend
  • MDTest now has a directory renaming test
  • Add prologue/epilogue support (GUAN Xin)
  • Add stronger randomized data using golden primes (Glenn K. Lockwood)
  • Add dummy backend (Julian Kunkel)
  • Improved CephFS support (Pablo Llopis)
  • Improved PnetCDF support (Wei-keng Liao)

Bugfixes:

  • Expansive fixes to mdtest correctness (Julian Kunkel)

IOR version 3.3.0

24 Dec 01:44
Compare
Choose a tag to compare

New major features:

  • Add CephFS AIORI (Mark Nelson)
  • Add Gfarm AIORI (Osamu Tatebe)
  • Add DAOS AIORI (Mohamad Chaarawi)
  • Add DAOS DFS AIORI (Mohamad Chaarawi)
  • -B option has been replaced with --posix.odirect

New minor features:

  • Display outlier host names (Jean-Yves Vet)
  • Enable global default dir layout for subdirs in Lustre (Petros Koutoupis)
  • Removed pound signs (#) from mdtest output file names (Julian Kunkel)
  • Print I/O hints from NCMPI (Wei-keng Liao)
  • Add mknod support to mdtest (Gu Zheng)
  • Refactor AIORI-specific options (Julian Kunkel)
  • Enable IME native backend for mdtest (Jean-Yves Vet)
  • Enable mkdir/rmdir to IME AIORI (Jean-Yves Vet)
  • Add HDF5 collective metadata option (Rob Latham)
  • Add support for sync to AIORIs (Julian Kunkel)

General user improvements and bug fixes:

  • Allocate aligned buffers to support DirectIO for BeeGFS (Sven Breuner)
  • Added IOPS and latency results to json output (Robert LeBlanc)
  • Fixed case where numTasks is not evenly divisible by tasksPerNode (J. Schwartz)
  • Fix several memory leaks and buffer alignment problems (J. Schwartz, Axel Huebl, Sylvain Didelot)
  • Add mdtest data verification (Julian Kunkel)
  • Clean up functionality of stonewall (Julian Kunkel)
  • Fix checks for lustre_user.h (Andreas Dilger)
  • Make write verification work without read test (Jean-Yves Vet)
  • Documentation updates (Vaclav Hapla, Glenn Lockwood)
  • Add more debugging support (J. Schwartz)

General developer improvements:

  • Fix type casting errors (Vaclav Hapla)
  • Add basic test infrastructure (Julian Kunkel, Glenn Lockwood)
  • Conform to strict C99 (Glenn Lockwood)

Known issues:

  • S3 and HDFS backends may not compile with new versions of respective libraries (#25, #26, #301, #302)

3.2.2

19 Dec 00:16
Compare
Choose a tag to compare
  • Fixed mdtest with multiple iterations showing wrong results (#281) (Julian Kunkel)

IOR version 3.3.0 release candidate 1

24 Jun 17:45
2a17f3e
Compare
Choose a tag to compare
Pre-release

New major features:

  • Add CephFS AIORI (Mark Nelson)
  • Add Gfarm AIORI (Osamu Tatebe)
  • Add DAOS AIORI (Mohamad Chaarawi)
  • Add DAOS DFS AIORI (Mohamad Chaarawi)

New minor features:

  • Display outlier host names (Jean-Yves Vet)
  • Enable global default dir layout for subdirs in Lustre (Petros Koutoupis)
  • Removed pound signs (#) from mdtest output file names (Julian Kunkel)
  • Print I/O hints from NCMPI (Wei-keng Liao)
  • Add mknod support to mdtest (Gu Zheng)
  • Refactor AIORI-specific options (Julian Kunkel)
  • Enable IME native backend for mdtest (Jean-Yves Vet)
  • Enable mkdir/rmdir to IME AIORI (Jean-Yves Vet)
  • Add HDF5 collective metadata option (Rob Latham)
  • Add support for sync to AIORIs (Julian Kunkel)

General user improvements and bug fixes:

  • Allocate aligned buffers to support DirectIO for BeeGFS (Sven Breuner)
  • Added IOPS and latency results to json output (Robert LeBlanc)
  • Fixed case where numTasks is not evenly divisible by tasksPerNode (J. Schwartz)
  • Fix several memory leaks and buffer alignment problems (J. Schwartz, Axel Huebl, Sylvain Didelot)
  • Add mdtest data verification (Julian Kunkel)
  • Clean up functionality of stonewall (Julian Kunkel)
  • Fix checks for lustre_user.h (Andreas Dilger)
  • Make write verification work without read test (Jean-Yves Vet)
  • Documentation updates (Vaclav Hapla, Glenn Lockwood)
  • Add more debugging support (J. Schwartz)

General developer improvements:

  • Fix type casting errors (Vaclav Hapla)
  • Add basic test infrastructure (Julian Kunkel, Glenn Lockwood)
  • Conform to strict C99 (Glenn Lockwood)

Known issues:

  • S3 AIORI may not compile with new versions of aws4c (#25, #26)

3.2.1

19 May 16:24
Compare
Choose a tag to compare
  • Fixed a memory protection bug in mdtest (Julian Kunkel)
  • Fixed correctness bugs in mdtest leaf-only mode (#147) (rmn1)
  • Fixed bug where mdtest attempted to stat uncreated files (Julian Kunkel)

IOR version 3.2.0

02 Jan 20:25
4b44399
Compare
Choose a tag to compare

New major features:

  • mdtest now included as a frontend for the IOR aiori backend (Nathan Hjelm,
    LANL)
  • Added mmap AIORI (Li Dongyang, DDN)
  • Added RADOS AIORI (Shane Snyder, ANL)
  • Added IME AIORI (Jean-Yves Vet, DDN)
  • Added stonewalling for mdtest (Julian Kunkel, U Reading)

New minor features:

  • Dropped support for PLFS AIORI (John Bent)
  • Added stoneWallingWearOut functionality to allow stonewalling to ensure that
    each MPI rank writes the same amount of data and captures the effects of slow
    processes (Julian Kunkel, DKRZ)
  • Added support for JSON output (Enno Zickler, U Hamburg; Julian Kunkel, U
    Reading)
  • Added dummy AIORI (Julian Kunkel, U Reading)
  • Added support for HDF5 collective metadata operations (Rob Latham, ANL)

General user improvements:

  • BeeGFS parameter support (Oliver Steffen, ThinkParQ)
  • Semantics of -R now compares to expected signature (-G) (Julian Kunkel,
    DKRZ)
  • Improved macOS support for ncmpi (Vinson Leung)
  • Added more complete documentation (Enno Zickler, U Hamburg)
  • Assorted bugfixes and code refactoring (Adam Moody, LLNL; Julian Kunkel, U
    Reading; Enno Zickler, U Hamburg; Nathan Hjelm, LANL; Rob Latham, ANL;
    Jean-Yves Vet, DDN)
  • More robust support for non-POSIX-backed AIORIs (Shane Snyder, ANL)

General developer improvements:

  • Improvements to build process (Nathan Hjelm, LANL; Ian Kirker, UCL)
  • Added continuous integration support (Enno Zickler, U Hamburg)
  • Added better support for automated testing (Julian Kunkel, U Reading)
  • Rewritten option handling to improve support for backend-specific options
    (Julian Kunkel, U Reading)

Known issues:

  • api=RADOS cannot work correctly if specified in a config file (via -f)
    because -u/-c/-p cannot be specified (issue #98)
  • writeCheck cannot be enabled for write-only tests using some AIORIs such as
    MPI-IO (pull request #89)

IOR version 3.2.0 release candidate 2

23 Dec 04:44
4b44399
Compare
Choose a tag to compare
Pre-release

Updates since 3.2.0rc1:

  • Fixes an issue when compiling against newer versions of lustre_user.h
  • Fixes a reporting issue in mdtest

IOR version 3.2.0 release candidate 1

04 Dec 21:53
Compare
Choose a tag to compare
Pre-release

New major features:

  • mdtest now included as a frontend for the IOR aiori backend (Nathan Hjelm,
    LANL)
  • Added mmap AIORI (Li Dongyang, DDN)
  • Added RADOS AIORI (Shane Snyder, ANL)
  • Added IME AIORI (Jean-Yves Vet, DDN)
  • Added stonewalling for mdtest (Julian Kunkel, U Reading)

New minor features:

  • Dropped support for PLFS AIORI (John Bent)
  • Added stoneWallingWearOut functionality to allow stonewalling to ensure that
    each MPI rank writes the same amount of data and captures the effects of slow
    processes (Julian Kunkel, DKRZ)
  • Added support for JSON output (Enno Zickler, U Hamburg; Julian Kunkel, U
    Reading)
  • Added dummy AIORI (Julian Kunkel, U Reading)
  • Added support for HDF5 collective metadata operations (Rob Latham, ANL)

General user improvements:

  • BeeGFS parameter support (Oliver Steffen, ThinkParQ)
  • Semantics of -R now compares to expected signature (-G) (Julian Kunkel,
    DKRZ)
  • Improved macOS support for ncmpi (Vinson Leung)
  • Added more complete documentation (Enno Zickler, U Hamburg)
  • Assorted bugfixes and code refactoring (Adam Moody, LLNL; Julian Kunkel, U
    Reading; Enno Zickler, U Hamburg; Nathan Hjelm, LANL; Rob Latham, ANL;
    Jean-Yves Vet, DDN)
  • More robust support for non-POSIX-backed AIORIs (Shane Snyder, ANL)

General developer improvements:

  • Improvements to build process (Nathan Hjelm, LANL; Ian Kirker, UCL)
  • Added continuous integration support (Enno Zickler, U Hamburg)
  • Added better support for automated testing (Julian Kunkel, U Reading)
  • Rewritten option handling to improve support for backend-specific options
    (Julian Kunkel, U Reading)

Known issues:

  • api=RADOS cannot work correctly if specified in a config file (via -f)
    because -u/-c/-p cannot be specified (issue #98)
  • writeCheck cannot be enabled for write-only tests using some AIORIs such as
    MPI-IO (pull request #89)

Tagged release featuring PLFS, HDFS, and S3 aioris

23 Aug 23:43
Compare
Choose a tag to compare
  • includes support for PLFS (Jeff Inman, Brett Kettering, LANL)
  • includes support for HDFS (Jeff Inman, LANL)
  • includes support for S3 (Blair Crossman, Brett Kettering, LANL)
  • option to use incompressible data transfers (Blair Crossman, LANL)
  • code cleanup and general usability improvements (Rob Latham, ANL)