Skip to content
File utilities designed for scalability and performance.
C Shell Python Other
Branch: master
Clone or download
kcgthb and adammoody dbcast: replaced functions deprecated in MPI-2.0
Signed-off-by: Kilian Cavalotti <>
Latest commit c90292b Feb 15, 2020
Type Name Latest commit message Commit time
Failed to load latest commit information.
.github add example signed off by text Dec 20, 2018
cmake dwalk: add default file histogram Apr 16, 2019
doc docs: update to libcircle-v0.3, move design goals to front Jan 27, 2020
man docs: refresh for v0.10 Jan 27, 2020
src dbcast: replaced functions deprecated in MPI-2.0 Feb 15, 2020
test update old dcp1 tests Feb 22, 2019
.gitignore start of spack docs Jan 7, 2019
.travis.yml update libcircle to use termination tree and reduction period calls Jan 23, 2020
AUTHORS Add me (Gu Zheng) into AUTHORS Apr 17, 2019
CMakeLists.txt move source for experimental tools to src Apr 5, 2019
LICENSE added all the names to license Aug 22, 2018
NOTICE clean up copyright and notice file Aug 22, 2018 README: fix link to contributor docs Dec 20, 2018
astyle.options added DTCMP sorts and used them instead of original serial sorts (#227) Mar 29, 2019
mpifileutils.spec docs: refresh for v0.10 Jan 27, 2020
spack.yaml spack build deps instructions Jan 11, 2019


mpiFileUtils provides both a library called libmfu and a suite of MPI-based tools to manage large datasets, which may vary from large directory trees to large files. High-performance computing users often generate large datasets with parallel applications that run with many processes (millions in some cases). However those users are then stuck with single-process tools like cp and rm to manage their datasets. This suite provides MPI-based tools to handle typical jobs like copy, remove, and compare for such datasets, providing speedups of up to 20-30x. It also provides a library that simplifies the creation of new tools or can be used in applications.

Documentation is available on ReadTheDocs.


We welcome contributions to the project. For details on how to help, see our Contributor Guide


Copyright (c) 2013-2015, Lawrence Livermore National Security, LLC. Produced at the Lawrence Livermore National Laboratory CODE-673838

Copyright (c) 2006-2007,2011-2015, Los Alamos National Security, LLC. (LA-CC-06-077, LA-CC-10-066, LA-CC-14-046)

Copyright (2013-2015) UT-Battelle, LLC under Contract No. DE-AC05-00OR22725 with the Department of Energy.

Copyright (c) 2015, DataDirect Networks, Inc.

All rights reserved.

Build Status

The current status of the mpiFileUtils master branch is Build Status.

You can’t perform that action at this time.