UnifyCR: A file system for burst buffers
Switch branches/tags
Clone or download
MichaelBrim and adammoody free previously set configurator values
TEST_CHECKPATCH_SKIP_FILES=common/src/unifycr_configurator.c
Latest commit e6641a3 Dec 12, 2018
Permalink
Type Name Latest commit message Commit time
Failed to load latest commit information.
.github Update user docs and add contributing docs Nov 8, 2018
client Add check for return value of unifycr_mount Nov 20, 2018
common free previously set configurator values Dec 13, 2018
docs Update user docs and add contributing docs Nov 8, 2018
examples Add check for return value of unifycr_mount Nov 20, 2018
extras update docs and example config file Oct 12, 2018
m4 clean up numa m4, fix compile error in client when using numa Oct 24, 2018
meta define MPI build flags with m4 script (#180) Oct 11, 2018
scripts hack check patch to be more permissive Nov 20, 2018
server Change the domain socket file name to include uid. Nov 19, 2018
t Add check for return value of unifycr_mount Nov 20, 2018
util support cleanup-on-terminate as server CLI option Oct 31, 2018
.gitignore Adding example programs to test hdf5 support. Aug 20, 2018
.travis.yml fix spack module loads command for latest spack Nov 14, 2018
LICENSE Top level LICENSE file for UnifyCR. Dec 7, 2017
LICENSE.ANL fix burstfs and cruise license (#15) Dec 8, 2017
LICENSE.BURSTFS fix burstfs and cruise license (#15) Dec 8, 2017
LICENSE.CRUISE fix burstfs and cruise license (#15) Dec 8, 2017
Makefile.am Moving test programs in /client/tests to /examples. Aug 16, 2018
README.md update broken link for Build & I/O interception Nov 9, 2018
autogen.sh add gotcha and test programs to build, support make dist (#36) Dec 19, 2017
configure.ac define MPI build flags with m4 script (#180) Oct 11, 2018

README.md

UnifyCR: A Distributed Burst Buffer File System - 0.1.0

Node-local burst buffers are becoming an indispensable hardware resource on large-scale supercomputers to buffer the bursty I/O from scientific applications. However, there is a lack of software support for burst buffers to be efficiently shared by applications within a batch-submitted job and recycled across different batch jobs. In addition, burst buffers need to cope with a variety of challenging I/O patterns from data-intensive scientific applications.

UnifyCR is a user-level burst buffer file system under active development. UnifyCR supports scalable and efficient aggregation of I/O bandwidth from burst buffers while having the same life cycle as a batch-submitted job. While UnifyCR is designed for N-N write/read, UnifyCR compliments its functionality with the support for N-1 write/read. It efficiently accelerates scientific I/O based on scalable metadata indexing, co-located I/O delegation, and server-side read clustering and pipelining.

Documentation

Full UnifyCR documentation is contained here.

Use Build & I/O Interception for instructions on how to build and install UnifyCR.

Build Status

The current status of the UnifyCR dev branch is:

Build Status Read the Docs

Contribute and Develop

Contributing guidelines can be found in our documentation.