Skip to content
File utilities designed for scalability and performance.
C Shell Python Other
Branch: master
Clone or download
adammoody docs: refresh for v0.10
Signed-off-by: Adam Moody <moody20@llnl.gov>
Latest commit b38043e Jan 27, 2020
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
.github add example signed off by text Dec 20, 2018
cmake dwalk: add default file histogram Apr 16, 2019
doc
man docs: refresh for v0.10 Jan 27, 2020
src dwalk: add --progress option Jan 23, 2020
test update old dcp1 tests Feb 22, 2019
.gitignore start of spack docs Jan 7, 2019
.travis.yml
AUTHORS Add me (Gu Zheng) into AUTHORS Apr 17, 2019
CMakeLists.txt
LICENSE added all the names to license Aug 22, 2018
NOTICE
README.md README: fix link to contributor docs Dec 20, 2018
astyle.options added DTCMP sorts and used them instead of original serial sorts (#227) Mar 29, 2019
mpifileutils.spec docs: refresh for v0.10 Jan 27, 2020
mpifu_venv.sh fixing print error in venv script Jul 28, 2017
spack.yaml spack build deps instructions Jan 11, 2019

README.md

mpiFileUtils

mpiFileUtils provides both a library called libmfu and a suite of MPI-based tools to manage large datasets, which may vary from large directory trees to large files. High-performance computing users often generate large datasets with parallel applications that run with many processes (millions in some cases). However those users are then stuck with single-process tools like cp and rm to manage their datasets. This suite provides MPI-based tools to handle typical jobs like copy, remove, and compare for such datasets, providing speedups of up to 20-30x. It also provides a library that simplifies the creation of new tools or can be used in applications.

Documentation is available on ReadTheDocs.

Contributors

We welcome contributions to the project. For details on how to help, see our Contributor Guide

Copyrights

Copyright (c) 2013-2015, Lawrence Livermore National Security, LLC. Produced at the Lawrence Livermore National Laboratory CODE-673838

Copyright (c) 2006-2007,2011-2015, Los Alamos National Security, LLC. (LA-CC-06-077, LA-CC-10-066, LA-CC-14-046)

Copyright (2013-2015) UT-Battelle, LLC under Contract No. DE-AC05-00OR22725 with the Department of Energy.

Copyright (c) 2015, DataDirect Networks, Inc.

All rights reserved.

Build Status

The current status of the mpiFileUtils master branch is Build Status.

You can’t perform that action at this time.