Skip to content
File utilities designed for scalability and performance.
C Shell Python Other
Branch: master
Clone or download

Latest commit

ofaaland and adammoody correct usage message in dfilemaker
Give the user correct guidance about the relationship between
ntotal and nlevels.

Signed-off-by: Olaf Faaland <faaland1@llnl.gov>
Latest commit 20ff7e4 Mar 19, 2020

Files

Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
.github
cmake
doc
man
src
test
.gitignore start of spack docs Jan 7, 2019
.travis.yml
AUTHORS
CMakeLists.txt
LICENSE added all the names to license Aug 22, 2018
NOTICE
README.md
astyle.options
mpifileutils.spec
mpifu_venv.sh
spack.yaml

README.md

mpiFileUtils

mpiFileUtils provides both a library called libmfu and a suite of MPI-based tools to manage large datasets, which may vary from large directory trees to large files. High-performance computing users often generate large datasets with parallel applications that run with many processes (millions in some cases). However those users are then stuck with single-process tools like cp and rm to manage their datasets. This suite provides MPI-based tools to handle typical jobs like copy, remove, and compare for such datasets, providing speedups of up to 20-30x. It also provides a library that simplifies the creation of new tools or can be used in applications.

Documentation is available on ReadTheDocs.

Contributors

We welcome contributions to the project. For details on how to help, see our Contributor Guide

Copyrights

Copyright (c) 2013-2015, Lawrence Livermore National Security, LLC. Produced at the Lawrence Livermore National Laboratory CODE-673838

Copyright (c) 2006-2007,2011-2015, Los Alamos National Security, LLC. (LA-CC-06-077, LA-CC-10-066, LA-CC-14-046)

Copyright (2013-2015) UT-Battelle, LLC under Contract No. DE-AC05-00OR22725 with the Department of Energy.

Copyright (c) 2015, DataDirect Networks, Inc.

All rights reserved.

Build Status

The current status of the mpiFileUtils master branch is Build Status.

You can’t perform that action at this time.