Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Enable "fab <machine> dummy_ensemble:dummy_test,pilot_mode=True" #76

Closed
djgroen opened this issue Dec 11, 2018 · 6 comments
Closed

Enable "fab <machine> dummy_ensemble:dummy_test,pilot_mode=True" #76

djgroen opened this issue Dec 11, 2018 · 6 comments

Comments

@djgroen
Copy link
Owner

@djgroen djgroen commented Dec 11, 2018

This is a prototype syntax to run an ensemble of dummy jobs on a single remote machine using QCG-PilotJob.

The goal of this task is to enable this functionality, so that users can easily test the PilotJob functionality from FabSim.

@djgroen
Copy link
Owner Author

@djgroen djgroen commented Mar 27, 2019

Note: the final syntax may be different of course.

Loading

@arabnejad
Copy link
Collaborator

@arabnejad arabnejad commented May 16, 2019

PilotJob functionality is added to FabSim3, please have look to FabSim_PilotJob branch
to submit a job, use PilotJob=true in your fab command
example :
fab qcg flee_ensemble:ssudan_ccamp,simulation_period=10,PilotJob=true

Loading

@arabnejad
Copy link
Collaborator

@arabnejad arabnejad commented Jun 10, 2019

NOW, PJ for both SLURM and QCG machine works
here are the step to do that :

  1. install QCG-PilotJob manager by

for QCG machine : fab qcg install_app:QCG-PilotJob,virtual_env=True
For SLURM machine : fab eagle install_app:QCG-PilotJob,virtual_env=True
NOTE : the installation path (virtual_env_path) is set on machines.yml as one of parameters for the target remote machine

  1. run PilotJob by :

for QCG machine : fab qcg flee_ensemble:mali,simulation_period=10,PilotJob=true
for SLURM machine : fab eagle flee_ensemble:mali,simulation_period=10,PilotJob=true

Loading

@djgroen
Copy link
Owner Author

@djgroen djgroen commented Jun 11, 2019

Euhmm... looks generally good, but ssudan_ccamp doesn't have a SWEEP dir in the repository?

It does work with the mali config however.

Loading

@djgroen
Copy link
Owner Author

@djgroen djgroen commented Jun 11, 2019

Most importantly, fabsim qcg flee_ensemble:mali,N=20,simulation_period=50,PilotJob=true appears to work correctly...

Loading

@djgroen
Copy link
Owner Author

@djgroen djgroen commented Jun 11, 2019

So I will close this now, but we do need to test the Flee tutorial as a whole tomorrow.

Loading

@djgroen djgroen closed this Jun 11, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Linked pull requests

Successfully merging a pull request may close this issue.

None yet
2 participants