Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add support for replica execution in FabSim #138

Closed
5 tasks done
djgroen opened this issue Aug 1, 2019 · 2 comments
Closed
5 tasks done

Add support for replica execution in FabSim #138

djgroen opened this issue Aug 1, 2019 · 2 comments

Comments

@djgroen
Copy link
Owner

djgroen commented Aug 1, 2019

In discussions between me and @arabnejad we begin to realize that the current ensemble mechanism is not so efficient for executing the same simulation multiple times. This is because the user will need to prepare a large number of (near-) identical configurations, with one directory per run.

In addition, we see a clear case for running ensembles, where each sample of an ensemble is run multiple times to account for stochastic nature of the underlying code.

We therefore decided to implement replica execution both separately, and as part of the ensemble execution functionality in FabSim.

Tasks are as follows:

  • Prototype fabsim <machine> dummy with replicas. (@arabnejad )
  • Prototype fabsim <machine> dummy_ensemble with replicas. (@arabnejad )
  • Port both implementations to FabFlee.
  • Write documentation.
  • Write test cases.
@djgroen
Copy link
Owner Author

djgroen commented Aug 1, 2019

@arabnejad I thought about this more, and I think it may be better to implement this as a flag than as a separate function name.

So instead of proposing:
fabsim localhost dummy_replicated:dummy_test,replicas=5
we could go for:
fabsim localhost dummy:dummy_test,replicas=5

Similarly, for combined ensembles with replicas, we could go for:
fabsim localhost dummy_ensemble:dummy_test,replicas=5

What do you think?

djgroen added a commit that referenced this issue Aug 29, 2019
@djgroen
Copy link
Owner Author

djgroen commented Aug 29, 2019

This works for FabFlee. I also

  • refactored the variability functions (deprecated them).
  • wrote documentation for this in three places.

@djgroen djgroen closed this as completed Aug 29, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants