Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Enable "fab <machine> dummy_ensemble:dummy_test,pilot_mode=True" #76

Closed
djgroen opened this issue Dec 11, 2018 · 6 comments

Comments

@djgroen
Copy link
Owner

commented Dec 11, 2018

This is a prototype syntax to run an ensemble of dummy jobs on a single remote machine using QCG-PilotJob.

The goal of this task is to enable this functionality, so that users can easily test the PilotJob functionality from FabSim.

@djgroen

This comment has been minimized.

Copy link
Owner Author

commented Mar 27, 2019

Note: the final syntax may be different of course.

@arabnejad

This comment has been minimized.

Copy link
Collaborator

commented May 16, 2019

PilotJob functionality is added to FabSim3, please have look to FabSim_PilotJob branch
to submit a job, use PilotJob=true in your fab command
example :
fab qcg flee_ensemble:ssudan_ccamp,simulation_period=10,PilotJob=true

@arabnejad

This comment has been minimized.

Copy link
Collaborator

commented Jun 10, 2019

NOW, PJ for both SLURM and QCG machine works
here are the step to do that :

  1. install QCG-PilotJob manager by

for QCG machine : fab qcg install_app:QCG-PilotJob,virtual_env=True
For SLURM machine : fab eagle install_app:QCG-PilotJob,virtual_env=True
NOTE : the installation path (virtual_env_path) is set on machines.yml as one of parameters for the target remote machine

  1. run PilotJob by :

for QCG machine : fab qcg flee_ensemble:mali,simulation_period=10,PilotJob=true
for SLURM machine : fab eagle flee_ensemble:mali,simulation_period=10,PilotJob=true

@djgroen

This comment has been minimized.

Copy link
Owner Author

commented Jun 11, 2019

Euhmm... looks generally good, but ssudan_ccamp doesn't have a SWEEP dir in the repository?

It does work with the mali config however.

@djgroen

This comment has been minimized.

Copy link
Owner Author

commented Jun 11, 2019

Most importantly, fabsim qcg flee_ensemble:mali,N=20,simulation_period=50,PilotJob=true appears to work correctly...

@djgroen

This comment has been minimized.

Copy link
Owner Author

commented Jun 11, 2019

So I will close this now, but we do need to test the Flee tutorial as a whole tomorrow.

@djgroen djgroen closed this Jun 11, 2019

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
You can’t perform that action at this time.