Skip to content

PerfLab-EXaCT/BigFlowSim

Repository files navigation

BigFlowSim

Home:

About: BigFlowSim is a workflow I/O simulator that simulates several parameters that affect local and remote I/O, including I/O intensity, data reuse, data locality, data access pattern, and data movement. BigFlowSim can be used to generate a synthetic I/O traces and benchmarks. It can also be used to study the effects or trade-offs of different parameters

BigFlowSim consists of two main components: workflow generation and workflow playback.

Contacts: (firstname.lastname@pnnl.gov)

  • Ryan D. Friese
  • Nathan R. Tallent (www), (www)

Contributors:

  • Ryan D. Friese (PNNL)
  • Burcu O. Mutlu (PNNL)
  • Nathan R. Tallent (www), (www)

References

  • Ryan D. Friese, Burcu O. Mutlu, Nathan R. Tallent, Joshua Suetterlein, Jan Strube, "Effectively using remote I/O for work composition in distributed workflows," in Proc. of the 2020 IEEE Intl. Conf. on Big Data, IEEE Computer Society, December 2020. http://doi.org/10.1109/BigData50022.2020.9378352

Acknowledgements

This work was supported by the U.S. Department of Energy's Office of Advanced Scientific Computing Research:

  • Integrated End-to-end Performance Prediction and Diagnosis

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published