Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

VPP should have option for writting in parallel #14480

Closed
aeslaughter opened this issue Dec 5, 2019 · 0 comments · Fixed by #14692
Closed

VPP should have option for writting in parallel #14480

aeslaughter opened this issue Dec 5, 2019 · 0 comments · Fixed by #14692
Labels
C: Modules P: normal A defect affecting operation with a low possibility of significantly affects. T: task An enhancement to the software.

Comments

@aeslaughter
Copy link
Contributor

Reason

Results from stochastic simulations are stored as VPPs. For large stochastic simulations
with billions of sub-applications it will be necessary to output the results in parallel (i.e., Nemesis for VPP files).

Design

Within the stochastic tools module the StochasticResults object, which is a VPP (see #14410), include operational modes: "replicated" and "distributed". I propose that this concept be added to the framework. The VPP object will have a "parallel_type" parameter that can be:

"manual" (not sure of the name)
This is the current behavior for VPP data and will be the default mode.

"replicated"
This mode assumes that the VPP data is computed in parallel but the data should be
replicated on each processor. The desired vector is assumed to be the parts on each rank gathered together in a single vector. Thus, when this mode is given this gather action is automatically performed by bringing the complete vector to the root process. The "_is_broadcast" flag will still be applied to make it truly replicated, if desired.

"distributed"
This mode assumes that the VPP data is computed in parallel but the data should remain
distributed. No, parallel communication if performed and the broadcast is disabled. However,
CSV output object (perhaps it is time for separate PP and VPP Output objects) will write N-rank
number of files: "input_out_vpp_name_0.csv.RANK" (???)

Impact

This is new capability and will enable the creation of large sets of VPP data, if needed.

@aeslaughter aeslaughter added T: task An enhancement to the software. P: normal A defect affecting operation with a low possibility of significantly affects. C: Modules labels Dec 5, 2019
@aeslaughter aeslaughter added this to To Do in Stochastic Tools via automation Dec 5, 2019
aeslaughter added a commit to aeslaughter/moose that referenced this issue Jan 22, 2020
aeslaughter added a commit to aeslaughter/moose that referenced this issue Jan 22, 2020
aeslaughter added a commit to aeslaughter/moose that referenced this issue Jan 22, 2020
aeslaughter added a commit to aeslaughter/moose that referenced this issue Jan 22, 2020
aeslaughter added a commit to aeslaughter/moose that referenced this issue Jan 22, 2020
aeslaughter added a commit to aeslaughter/moose that referenced this issue Jan 22, 2020
aeslaughter added a commit to aeslaughter/moose that referenced this issue Jan 23, 2020
aeslaughter added a commit to aeslaughter/moose that referenced this issue Jan 23, 2020
@aeslaughter aeslaughter moved this from To Do to In progress in Stochastic Tools Jan 27, 2020
aeslaughter added a commit to aeslaughter/moose that referenced this issue Feb 4, 2020
aeslaughter added a commit to aeslaughter/moose that referenced this issue Feb 4, 2020
aeslaughter added a commit to aeslaughter/moose that referenced this issue Feb 13, 2020
aeslaughter added a commit to aeslaughter/moose that referenced this issue Feb 13, 2020
aeslaughter added a commit to aeslaughter/moose that referenced this issue Feb 13, 2020
aeslaughter added a commit to aeslaughter/moose that referenced this issue Feb 13, 2020
aeslaughter added a commit to aeslaughter/moose that referenced this issue Feb 18, 2020
aeslaughter added a commit to aeslaughter/moose that referenced this issue Feb 18, 2020
aeslaughter added a commit to aeslaughter/moose that referenced this issue Feb 18, 2020
aeslaughter added a commit to aeslaughter/moose that referenced this issue Feb 18, 2020
Stochastic Tools automation moved this from In progress to Done Feb 19, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
C: Modules P: normal A defect affecting operation with a low possibility of significantly affects. T: task An enhancement to the software.
Projects
1 participant