Minor update of run_everything.sh jobsub script + python script to fully automate the job submission by alexbooth92 · Pull Request #6 · DUNE/ND_CAFMaker

alexbooth92 · 2022-06-17T14:26:37Z

Update run_everything.sh jobsub script to allow for non-integer off-axis positions.
Also added RHC gsimple outdir structure to mirror the one that existed for FHC.

This shouldn't be merged until @CiaranH1997 has given the green light on the first test file of 100 events made:

/pnfs/dune/scratch/users/abooth/Production/ND_CAFMaker/nd_offaxis/v7/testing/CAF/1.75m/00/FHC.2750000.CAF.root

Also added a new python script launch_ndcafmaker_campaign.py which with the help of a configuration file (example launch_ndcafmaker_campaign_220620.cfg also committed) will completely automate an off-axis campaign. It will:

Interpret which horn currents and total POTs you would like at each position you specify.
Split these into bite size chunks of your choosing.
Build the jobsub_submit command automatically.
Query the grid conditions automatically before submitting another batch of jobs to check they are suitable (where suitable is definable by the user).

For example:

$ python launch_ndcafmaker_campaign.py -c launch_ndcafmaker_campaign_220620.cfg --print_only

Produces the following log:

$ cat launch_ndcafmaker_campaign.log 
2022-06-20 09:56:47,387 INFO There will be 3 submissions for FHC at 1.75.
2022-06-20 09:56:49,059 INFO There are currently 0 jobs under abooth user...
2022-06-20 09:56:49,060 INFO That's fine, will go ahead with submission
2022-06-20 09:56:49,060 INFO Running in --print_only but would have executed:
jobsub_submit --group dune --role=Analysis -N 10000 --maxConcurrent 2000 --OS=SL7 --expected-lifetime=24h --memory=4000MB file://run_everything.sh FHC 0 1e16 1.75 dk2nu
2022-06-20 09:56:49,837 INFO There are currently 0 jobs under abooth user...
2022-06-20 09:56:49,837 INFO That's fine, will go ahead with submission
2022-06-20 09:56:49,837 INFO Running in --print_only but would have executed:
jobsub_submit --group dune --role=Analysis -N 10000 --maxConcurrent 2000 --OS=SL7 --expected-lifetime=24h --memory=4000MB file://run_everything.sh FHC 10000 1e16 1.75 dk2nu
2022-06-20 09:56:50,564 INFO There are currently 0 jobs under abooth user...
2022-06-20 09:56:50,564 INFO That's fine, will go ahead with submission
2022-06-20 09:56:50,564 INFO Running in --print_only but would have executed:
jobsub_submit --group dune --role=Analysis -N 10000 --maxConcurrent 2000 --OS=SL7 --expected-lifetime=24h --memory=4000MB file://run_everything.sh FHC 20000 1e16 1.75 dk2nu
2022-06-20 09:56:50,564 INFO There will be 3 submissions for FHC at 5.75.
2022-06-20 09:56:52,027 INFO There are currently 0 jobs under abooth user...
2022-06-20 09:56:52,027 INFO That's fine, will go ahead with submission
2022-06-20 09:56:52,027 INFO Running in --print_only but would have executed:
jobsub_submit --group dune --role=Analysis -N 10000 --maxConcurrent 2000 --OS=SL7 --expected-lifetime=24h --memory=4000MB file://run_everything.sh FHC 0 1e16 5.75 dk2nu
2022-06-20 09:56:52,815 INFO There are currently 0 jobs under abooth user...
2022-06-20 09:56:52,815 INFO That's fine, will go ahead with submission
2022-06-20 09:56:52,815 INFO Running in --print_only but would have executed:
jobsub_submit --group dune --role=Analysis -N 10000 --maxConcurrent 2000 --OS=SL7 --expected-lifetime=24h --memory=4000MB file://run_everything.sh FHC 10000 1e16 5.75 dk2nu
2022-06-20 09:56:53,554 INFO There are currently 0 jobs under abooth user...
2022-06-20 09:56:53,554 INFO That's fine, will go ahead with submission
2022-06-20 09:56:53,554 INFO Running in --print_only but would have executed:
jobsub_submit --group dune --role=Analysis -N 10000 --maxConcurrent 2000 --OS=SL7 --expected-lifetime=24h --memory=4000MB file://run_everything.sh FHC 20000 1e16 5.75 dk2nu
2022-06-20 09:56:53,554 INFO There will be 3 submissions for FHC at 9.75.
2022-06-20 09:56:54,296 INFO There are currently 0 jobs under abooth user...
2022-06-20 09:56:54,297 INFO That's fine, will go ahead with submission
2022-06-20 09:56:54,297 INFO Running in --print_only but would have executed:
jobsub_submit --group dune --role=Analysis -N 10000 --maxConcurrent 2000 --OS=SL7 --expected-lifetime=24h --memory=4000MB file://run_everything.sh FHC 0 1e16 9.75 dk2nu
2022-06-20 09:56:55,066 INFO There are currently 0 jobs under abooth user...
2022-06-20 09:56:55,066 INFO That's fine, will go ahead with submission
2022-06-20 09:56:55,066 INFO Running in --print_only but would have executed:
jobsub_submit --group dune --role=Analysis -N 10000 --maxConcurrent 2000 --OS=SL7 --expected-lifetime=24h --memory=4000MB file://run_everything.sh FHC 10000 1e16 9.75 dk2nu
2022-06-20 09:56:55,866 INFO There are currently 0 jobs under abooth user...
2022-06-20 09:56:55,867 INFO That's fine, will go ahead with submission
2022-06-20 09:56:55,867 INFO Running in --print_only but would have executed:
jobsub_submit --group dune --role=Analysis -N 10000 --maxConcurrent 2000 --OS=SL7 --expected-lifetime=24h --memory=4000MB file://run_everything.sh FHC 20000 1e16 9.75 dk2nu
2022-06-20 09:56:55,867 INFO There will be 3 submissions for FHC at 13.75.
2022-06-20 09:56:56,679 INFO There are currently 0 jobs under abooth user...
2022-06-20 09:56:56,680 INFO That's fine, will go ahead with submission
2022-06-20 09:56:56,680 INFO Running in --print_only but would have executed:
jobsub_submit --group dune --role=Analysis -N 10000 --maxConcurrent 2000 --OS=SL7 --expected-lifetime=24h --memory=4000MB file://run_everything.sh FHC 0 1e16 13.75 dk2nu
2022-06-20 09:56:57,466 INFO There are currently 0 jobs under abooth user...
2022-06-20 09:56:57,466 INFO That's fine, will go ahead with submission
2022-06-20 09:56:57,466 INFO Running in --print_only but would have executed:
jobsub_submit --group dune --role=Analysis -N 10000 --maxConcurrent 2000 --OS=SL7 --expected-lifetime=24h --memory=4000MB file://run_everything.sh FHC 10000 1e16 13.75 dk2nu
2022-06-20 09:56:58,229 INFO There are currently 0 jobs under abooth user...
2022-06-20 09:56:58,229 INFO That's fine, will go ahead with submission
2022-06-20 09:56:58,229 INFO Running in --print_only but would have executed:
jobsub_submit --group dune --role=Analysis -N 10000 --maxConcurrent 2000 --OS=SL7 --expected-lifetime=24h --memory=4000MB file://run_everything.sh FHC 20000 1e16 13.75 dk2nu
2022-06-20 09:56:58,229 INFO There will be 3 submissions for FHC at 17.75.
2022-06-20 09:56:59,005 INFO There are currently 0 jobs under abooth user...
2022-06-20 09:56:59,005 INFO That's fine, will go ahead with submission
2022-06-20 09:56:59,005 INFO Running in --print_only but would have executed:
jobsub_submit --group dune --role=Analysis -N 10000 --maxConcurrent 2000 --OS=SL7 --expected-lifetime=24h --memory=4000MB file://run_everything.sh FHC 0 1e16 17.75 dk2nu
2022-06-20 09:56:59,814 INFO There are currently 0 jobs under abooth user...
2022-06-20 09:56:59,814 INFO That's fine, will go ahead with submission
2022-06-20 09:56:59,815 INFO Running in --print_only but would have executed:
jobsub_submit --group dune --role=Analysis -N 10000 --maxConcurrent 2000 --OS=SL7 --expected-lifetime=24h --memory=4000MB file://run_everything.sh FHC 10000 1e16 17.75 dk2nu
2022-06-20 09:57:01,583 INFO There are currently 0 jobs under abooth user...
2022-06-20 09:57:01,583 INFO That's fine, will go ahead with submission
2022-06-20 09:57:01,583 INFO Running in --print_only but would have executed:
jobsub_submit --group dune --role=Analysis -N 10000 --maxConcurrent 2000 --OS=SL7 --expected-lifetime=24h --memory=4000MB file://run_everything.sh FHC 20000 1e16 17.75 dk2nu
2022-06-20 09:57:01,583 INFO There will be 3 submissions for FHC at 21.75.
2022-06-20 09:57:03,332 INFO There are currently 0 jobs under abooth user...
2022-06-20 09:57:03,332 INFO That's fine, will go ahead with submission
2022-06-20 09:57:03,332 INFO Running in --print_only but would have executed:
jobsub_submit --group dune --role=Analysis -N 10000 --maxConcurrent 2000 --OS=SL7 --expected-lifetime=24h --memory=4000MB file://run_everything.sh FHC 0 1e16 21.75 dk2nu
2022-06-20 09:57:04,278 INFO There are currently 0 jobs under abooth user...
2022-06-20 09:57:04,278 INFO That's fine, will go ahead with submission
2022-06-20 09:57:04,278 INFO Running in --print_only but would have executed:
jobsub_submit --group dune --role=Analysis -N 10000 --maxConcurrent 2000 --OS=SL7 --expected-lifetime=24h --memory=4000MB file://run_everything.sh FHC 10000 1e16 21.75 dk2nu
2022-06-20 09:57:05,021 INFO There are currently 0 jobs under abooth user...
2022-06-20 09:57:05,021 INFO That's fine, will go ahead with submission
2022-06-20 09:57:05,021 INFO Running in --print_only but would have executed:
jobsub_submit --group dune --role=Analysis -N 10000 --maxConcurrent 2000 --OS=SL7 --expected-lifetime=24h --memory=4000MB file://run_everything.sh FHC 20000 1e16 21.75 dk2nu
2022-06-20 09:57:05,022 INFO There will be 3 submissions for FHC at 25.75.
2022-06-20 09:57:05,756 INFO There are currently 0 jobs under abooth user...
2022-06-20 09:57:05,757 INFO That's fine, will go ahead with submission
2022-06-20 09:57:05,757 INFO Running in --print_only but would have executed:
jobsub_submit --group dune --role=Analysis -N 10000 --maxConcurrent 2000 --OS=SL7 --expected-lifetime=24h --memory=4000MB file://run_everything.sh FHC 0 1e16 25.75 dk2nu
2022-06-20 09:57:06,525 INFO There are currently 0 jobs under abooth user...
2022-06-20 09:57:06,526 INFO That's fine, will go ahead with submission
2022-06-20 09:57:06,526 INFO Running in --print_only but would have executed:
jobsub_submit --group dune --role=Analysis -N 10000 --maxConcurrent 2000 --OS=SL7 --expected-lifetime=24h --memory=4000MB file://run_everything.sh FHC 10000 1e16 25.75 dk2nu
2022-06-20 09:57:07,275 INFO There are currently 0 jobs under abooth user...
2022-06-20 09:57:07,276 INFO That's fine, will go ahead with submission
2022-06-20 09:57:07,276 INFO Running in --print_only but would have executed:
jobsub_submit --group dune --role=Analysis -N 10000 --maxConcurrent 2000 --OS=SL7 --expected-lifetime=24h --memory=4000MB file://run_everything.sh FHC 20000 1e16 25.75 dk2nu
2022-06-20 09:57:07,276 INFO There will be 3 submissions for FHC at 26.25.
2022-06-20 09:57:08,043 INFO There are currently 0 jobs under abooth user...
2022-06-20 09:57:08,043 INFO That's fine, will go ahead with submission
2022-06-20 09:57:08,043 INFO Running in --print_only but would have executed:
jobsub_submit --group dune --role=Analysis -N 10000 --maxConcurrent 2000 --OS=SL7 --expected-lifetime=24h --memory=4000MB file://run_everything.sh FHC 0 1e16 26.25 dk2nu
2022-06-20 09:57:08,791 INFO There are currently 0 jobs under abooth user...
2022-06-20 09:57:08,792 INFO That's fine, will go ahead with submission
2022-06-20 09:57:08,792 INFO Running in --print_only but would have executed:
jobsub_submit --group dune --role=Analysis -N 10000 --maxConcurrent 2000 --OS=SL7 --expected-lifetime=24h --memory=4000MB file://run_everything.sh FHC 10000 1e16 26.25 dk2nu
2022-06-20 09:57:09,549 INFO There are currently 0 jobs under abooth user...
2022-06-20 09:57:09,549 INFO That's fine, will go ahead with submission
2022-06-20 09:57:09,549 INFO Running in --print_only but would have executed:
jobsub_submit --group dune --role=Analysis -N 10000 --maxConcurrent 2000 --OS=SL7 --expected-lifetime=24h --memory=4000MB file://run_everything.sh FHC 20000 1e16 26.25 dk2nu
2022-06-20 09:57:09,549 INFO There will be 3 submissions for FHC at 28.5.
2022-06-20 09:57:10,325 INFO There are currently 0 jobs under abooth user...
2022-06-20 09:57:10,325 INFO That's fine, will go ahead with submission
2022-06-20 09:57:10,326 INFO Running in --print_only but would have executed:
jobsub_submit --group dune --role=Analysis -N 10000 --maxConcurrent 2000 --OS=SL7 --expected-lifetime=24h --memory=4000MB file://run_everything.sh FHC 0 1e16 28.5 dk2nu
2022-06-20 09:57:11,104 INFO There are currently 0 jobs under abooth user...
2022-06-20 09:57:11,104 INFO That's fine, will go ahead with submission
2022-06-20 09:57:11,104 INFO Running in --print_only but would have executed:
jobsub_submit --group dune --role=Analysis -N 10000 --maxConcurrent 2000 --OS=SL7 --expected-lifetime=24h --memory=4000MB file://run_everything.sh FHC 10000 1e16 28.5 dk2nu
2022-06-20 09:57:11,869 INFO There are currently 0 jobs under abooth user...
2022-06-20 09:57:11,869 INFO That's fine, will go ahead with submission
2022-06-20 09:57:11,869 INFO Running in --print_only but would have executed:
jobsub_submit --group dune --role=Analysis -N 10000 --maxConcurrent 2000 --OS=SL7 --expected-lifetime=24h --memory=4000MB file://run_everything.sh FHC 20000 1e16 28.5 dk2nu
2022-06-20 09:57:11,869 INFO There will be 3 submissions for RHC at 1.75.
2022-06-20 09:57:13,530 INFO There are currently 0 jobs under abooth user...
2022-06-20 09:57:13,530 INFO That's fine, will go ahead with submission
2022-06-20 09:57:13,530 INFO Running in --print_only but would have executed:
jobsub_submit --group dune --role=Analysis -N 10000 --maxConcurrent 2000 --OS=SL7 --expected-lifetime=24h --memory=4000MB file://run_everything.sh RHC 0 1e16 1.75 dk2nu
2022-06-20 09:57:14,325 INFO There are currently 0 jobs under abooth user...
2022-06-20 09:57:14,325 INFO That's fine, will go ahead with submission
2022-06-20 09:57:14,325 INFO Running in --print_only but would have executed:
jobsub_submit --group dune --role=Analysis -N 10000 --maxConcurrent 2000 --OS=SL7 --expected-lifetime=24h --memory=4000MB file://run_everything.sh RHC 10000 1e16 1.75 dk2nu
2022-06-20 09:57:16,413 INFO There are currently 0 jobs under abooth user...
2022-06-20 09:57:16,413 INFO That's fine, will go ahead with submission
2022-06-20 09:57:16,413 INFO Running in --print_only but would have executed:
jobsub_submit --group dune --role=Analysis -N 10000 --maxConcurrent 2000 --OS=SL7 --expected-lifetime=24h --memory=4000MB file://run_everything.sh RHC 20000 1e16 1.75 dk2nu
2022-06-20 09:57:16,413 INFO There will be 3 submissions for RHC at 5.75.
2022-06-20 09:57:17,139 INFO There are currently 0 jobs under abooth user...
2022-06-20 09:57:17,139 INFO That's fine, will go ahead with submission
2022-06-20 09:57:17,139 INFO Running in --print_only but would have executed:
jobsub_submit --group dune --role=Analysis -N 10000 --maxConcurrent 2000 --OS=SL7 --expected-lifetime=24h --memory=4000MB file://run_everything.sh RHC 0 1e16 5.75 dk2nu
2022-06-20 09:57:17,897 INFO There are currently 0 jobs under abooth user...
2022-06-20 09:57:17,897 INFO That's fine, will go ahead with submission
2022-06-20 09:57:17,897 INFO Running in --print_only but would have executed:
jobsub_submit --group dune --role=Analysis -N 10000 --maxConcurrent 2000 --OS=SL7 --expected-lifetime=24h --memory=4000MB file://run_everything.sh RHC 10000 1e16 5.75 dk2nu
2022-06-20 09:57:18,662 INFO There are currently 0 jobs under abooth user...
2022-06-20 09:57:18,663 INFO That's fine, will go ahead with submission
2022-06-20 09:57:18,663 INFO Running in --print_only but would have executed:
jobsub_submit --group dune --role=Analysis -N 10000 --maxConcurrent 2000 --OS=SL7 --expected-lifetime=24h --memory=4000MB file://run_everything.sh RHC 20000 1e16 5.75 dk2nu
2022-06-20 09:57:18,663 INFO There will be 3 submissions for RHC at 9.75.
2022-06-20 09:57:19,433 INFO There are currently 0 jobs under abooth user...
2022-06-20 09:57:19,433 INFO That's fine, will go ahead with submission
2022-06-20 09:57:19,433 INFO Running in --print_only but would have executed:
jobsub_submit --group dune --role=Analysis -N 10000 --maxConcurrent 2000 --OS=SL7 --expected-lifetime=24h --memory=4000MB file://run_everything.sh RHC 0 1e16 9.75 dk2nu
2022-06-20 09:57:20,210 INFO There are currently 0 jobs under abooth user...
2022-06-20 09:57:20,211 INFO That's fine, will go ahead with submission
2022-06-20 09:57:20,211 INFO Running in --print_only but would have executed:
jobsub_submit --group dune --role=Analysis -N 10000 --maxConcurrent 2000 --OS=SL7 --expected-lifetime=24h --memory=4000MB file://run_everything.sh RHC 10000 1e16 9.75 dk2nu
2022-06-20 09:57:20,974 INFO There are currently 0 jobs under abooth user...
2022-06-20 09:57:20,975 INFO That's fine, will go ahead with submission
2022-06-20 09:57:20,975 INFO Running in --print_only but would have executed:
jobsub_submit --group dune --role=Analysis -N 10000 --maxConcurrent 2000 --OS=SL7 --expected-lifetime=24h --memory=4000MB file://run_everything.sh RHC 20000 1e16 9.75 dk2nu
2022-06-20 09:57:20,975 INFO There will be 3 submissions for RHC at 13.75.
2022-06-20 09:57:21,736 INFO There are currently 0 jobs under abooth user...
2022-06-20 09:57:21,736 INFO That's fine, will go ahead with submission
2022-06-20 09:57:21,736 INFO Running in --print_only but would have executed:
jobsub_submit --group dune --role=Analysis -N 10000 --maxConcurrent 2000 --OS=SL7 --expected-lifetime=24h --memory=4000MB file://run_everything.sh RHC 0 1e16 13.75 dk2nu
2022-06-20 09:57:22,560 INFO There are currently 0 jobs under abooth user...
2022-06-20 09:57:22,561 INFO That's fine, will go ahead with submission
2022-06-20 09:57:22,561 INFO Running in --print_only but would have executed:
jobsub_submit --group dune --role=Analysis -N 10000 --maxConcurrent 2000 --OS=SL7 --expected-lifetime=24h --memory=4000MB file://run_everything.sh RHC 10000 1e16 13.75 dk2nu
2022-06-20 09:57:23,312 INFO There are currently 0 jobs under abooth user...
2022-06-20 09:57:23,313 INFO That's fine, will go ahead with submission
2022-06-20 09:57:23,313 INFO Running in --print_only but would have executed:
jobsub_submit --group dune --role=Analysis -N 10000 --maxConcurrent 2000 --OS=SL7 --expected-lifetime=24h --memory=4000MB file://run_everything.sh RHC 20000 1e16 13.75 dk2nu
2022-06-20 09:57:23,313 INFO There will be 3 submissions for RHC at 17.75.
2022-06-20 09:57:24,919 INFO There are currently 0 jobs under abooth user...
2022-06-20 09:57:24,919 INFO That's fine, will go ahead with submission
2022-06-20 09:57:24,919 INFO Running in --print_only but would have executed:
jobsub_submit --group dune --role=Analysis -N 10000 --maxConcurrent 2000 --OS=SL7 --expected-lifetime=24h --memory=4000MB file://run_everything.sh RHC 0 1e16 17.75 dk2nu
2022-06-20 09:57:25,696 INFO There are currently 0 jobs under abooth user...
2022-06-20 09:57:25,696 INFO That's fine, will go ahead with submission
2022-06-20 09:57:25,696 INFO Running in --print_only but would have executed:
jobsub_submit --group dune --role=Analysis -N 10000 --maxConcurrent 2000 --OS=SL7 --expected-lifetime=24h --memory=4000MB file://run_everything.sh RHC 10000 1e16 17.75 dk2nu
2022-06-20 09:57:26,477 INFO There are currently 0 jobs under abooth user...
2022-06-20 09:57:26,477 INFO That's fine, will go ahead with submission
2022-06-20 09:57:26,477 INFO Running in --print_only but would have executed:
jobsub_submit --group dune --role=Analysis -N 10000 --maxConcurrent 2000 --OS=SL7 --expected-lifetime=24h --memory=4000MB file://run_everything.sh RHC 20000 1e16 17.75 dk2nu
2022-06-20 09:57:26,477 INFO There will be 3 submissions for RHC at 21.75.
2022-06-20 09:57:28,240 INFO There are currently 0 jobs under abooth user...
2022-06-20 09:57:28,240 INFO That's fine, will go ahead with submission
2022-06-20 09:57:28,241 INFO Running in --print_only but would have executed:
jobsub_submit --group dune --role=Analysis -N 10000 --maxConcurrent 2000 --OS=SL7 --expected-lifetime=24h --memory=4000MB file://run_everything.sh RHC 0 1e16 21.75 dk2nu
2022-06-20 09:57:29,009 INFO There are currently 0 jobs under abooth user...
2022-06-20 09:57:29,009 INFO That's fine, will go ahead with submission
2022-06-20 09:57:29,009 INFO Running in --print_only but would have executed:
jobsub_submit --group dune --role=Analysis -N 10000 --maxConcurrent 2000 --OS=SL7 --expected-lifetime=24h --memory=4000MB file://run_everything.sh RHC 10000 1e16 21.75 dk2nu
2022-06-20 09:57:29,782 INFO There are currently 0 jobs under abooth user...
2022-06-20 09:57:29,782 INFO That's fine, will go ahead with submission
2022-06-20 09:57:29,782 INFO Running in --print_only but would have executed:
jobsub_submit --group dune --role=Analysis -N 10000 --maxConcurrent 2000 --OS=SL7 --expected-lifetime=24h --memory=4000MB file://run_everything.sh RHC 20000 1e16 21.75 dk2nu
2022-06-20 09:57:29,782 INFO There will be 3 submissions for RHC at 25.75.
2022-06-20 09:57:30,557 INFO There are currently 0 jobs under abooth user...
2022-06-20 09:57:30,557 INFO That's fine, will go ahead with submission
2022-06-20 09:57:30,557 INFO Running in --print_only but would have executed:
jobsub_submit --group dune --role=Analysis -N 10000 --maxConcurrent 2000 --OS=SL7 --expected-lifetime=24h --memory=4000MB file://run_everything.sh RHC 0 1e16 25.75 dk2nu
2022-06-20 09:57:31,324 INFO There are currently 0 jobs under abooth user...
2022-06-20 09:57:31,324 INFO That's fine, will go ahead with submission
2022-06-20 09:57:31,324 INFO Running in --print_only but would have executed:
jobsub_submit --group dune --role=Analysis -N 10000 --maxConcurrent 2000 --OS=SL7 --expected-lifetime=24h --memory=4000MB file://run_everything.sh RHC 10000 1e16 25.75 dk2nu
2022-06-20 09:57:32,091 INFO There are currently 0 jobs under abooth user...
2022-06-20 09:57:32,091 INFO That's fine, will go ahead with submission
2022-06-20 09:57:32,091 INFO Running in --print_only but would have executed:
jobsub_submit --group dune --role=Analysis -N 10000 --maxConcurrent 2000 --OS=SL7 --expected-lifetime=24h --memory=4000MB file://run_everything.sh RHC 20000 1e16 25.75 dk2nu
2022-06-20 09:57:32,091 INFO There will be 3 submissions for RHC at 26.25.
2022-06-20 09:57:32,840 INFO There are currently 0 jobs under abooth user...
2022-06-20 09:57:32,840 INFO That's fine, will go ahead with submission
2022-06-20 09:57:32,840 INFO Running in --print_only but would have executed:
jobsub_submit --group dune --role=Analysis -N 10000 --maxConcurrent 2000 --OS=SL7 --expected-lifetime=24h --memory=4000MB file://run_everything.sh RHC 0 1e16 26.25 dk2nu
2022-06-20 09:57:33,582 INFO There are currently 0 jobs under abooth user...
2022-06-20 09:57:33,582 INFO That's fine, will go ahead with submission
2022-06-20 09:57:33,582 INFO Running in --print_only but would have executed:
jobsub_submit --group dune --role=Analysis -N 10000 --maxConcurrent 2000 --OS=SL7 --expected-lifetime=24h --memory=4000MB file://run_everything.sh RHC 10000 1e16 26.25 dk2nu
2022-06-20 09:57:35,177 INFO There are currently 0 jobs under abooth user...
2022-06-20 09:57:35,178 INFO That's fine, will go ahead with submission
2022-06-20 09:57:35,178 INFO Running in --print_only but would have executed:
jobsub_submit --group dune --role=Analysis -N 10000 --maxConcurrent 2000 --OS=SL7 --expected-lifetime=24h --memory=4000MB file://run_everything.sh RHC 20000 1e16 26.25 dk2nu
2022-06-20 09:57:35,178 INFO There will be 3 submissions for RHC at 28.5.
2022-06-20 09:57:35,982 INFO There are currently 0 jobs under abooth user...
2022-06-20 09:57:35,982 INFO That's fine, will go ahead with submission
2022-06-20 09:57:35,982 INFO Running in --print_only but would have executed:
jobsub_submit --group dune --role=Analysis -N 10000 --maxConcurrent 2000 --OS=SL7 --expected-lifetime=24h --memory=4000MB file://run_everything.sh RHC 0 1e16 28.5 dk2nu
2022-06-20 09:57:36,716 INFO There are currently 0 jobs under abooth user...
2022-06-20 09:57:36,716 INFO That's fine, will go ahead with submission
2022-06-20 09:57:36,716 INFO Running in --print_only but would have executed:
jobsub_submit --group dune --role=Analysis -N 10000 --maxConcurrent 2000 --OS=SL7 --expected-lifetime=24h --memory=4000MB file://run_everything.sh RHC 10000 1e16 28.5 dk2nu
2022-06-20 09:57:37,484 INFO There are currently 0 jobs under abooth user...
2022-06-20 09:57:37,484 INFO That's fine, will go ahead with submission
2022-06-20 09:57:37,484 INFO Running in --print_only but would have executed:
jobsub_submit --group dune --role=Analysis -N 10000 --maxConcurrent 2000 --OS=SL7 --expected-lifetime=24h --memory=4000MB file://run_everything.sh RHC 20000 1e16 28.5 dk2nu
2022-06-20 09:57:37,484 INFO launch_ndcafmaker_campaign.py finished!

…xis positions. Also added RHC gsimple outdir structure similar to mirror the one that existed for FHC.

…h uses run_everything in it's current form.

…ting in June 2022.

alexbooth92 · 2022-06-20T15:42:51Z

@CiaranH1997 confirmed that the first test file looks OK. Now running a small test of the automation. Will merge after see that this is successful.

… out including this in your jobsub command confuses things greatly.

…ropriate values given we can't easily control the maximum number of concurrent jobs.

alexbooth92 added 2 commits June 17, 2022 05:53

Update run_everything.sh jobsub script to allow for non-integer off-a…

1eb6b8e

…xis positions. Also added RHC gsimple outdir structure similar to mirror the one that existed for FHC.

Merge branch 'master' into feature/abooth-noninteger_oa_position

f01bc4d

alexbooth92 requested review from CiaranH1997 and cmmarshall June 17, 2022 14:26

alexbooth92 added 2 commits June 20, 2022 10:02

A new script which should completely automate the any production whic…

e63410e

…h uses run_everything in it's current form.

Configuration file for the 'non-integer' position PRISM campaign star…

7554c50

…ting in June 2022.

alexbooth92 changed the title ~~Minor update of run_everything.sh jobsub script~~ Minor update of run_everything.sh jobsub script + python script to fully automate the job submission Jun 20, 2022

alexbooth92 added 2 commits June 20, 2022 10:27

Change the default wait time back to a sensible value.

4b917f8

Add some comments to the launch script.

b7f7783

alexbooth92 added 4 commits June 20, 2022 11:29

Remove support for specifying max number of concurrent jobs. It turns…

f199697

… out including this in your jobsub command confuses things greatly.

Change default n_jobs_per_submission and n_jobs_threshold to more app…

23ba14e

…ropriate values given we can't easily control the maximum number of concurrent jobs.

Reintroduce time.

bde446c

Pass user to count_jobs.

0a4e72d

alexbooth92 merged commit 9d819e5 into master Jun 21, 2022

alexbooth92 deleted the feature/abooth-noninteger_oa_position branch June 21, 2022 13:36

sindhu-ku mentioned this pull request Nov 14, 2023

Issue with pass-through truth #40

Closed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Minor update of run_everything.sh jobsub script + python script to fully automate the job submission#6

Minor update of run_everything.sh jobsub script + python script to fully automate the job submission#6
alexbooth92 merged 10 commits intomasterfrom
feature/abooth-noninteger_oa_position

alexbooth92 commented Jun 17, 2022 •

edited

Loading

Uh oh!

alexbooth92 commented Jun 20, 2022

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

1 participant

Conversation

alexbooth92 commented Jun 17, 2022 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

alexbooth92 commented Jun 20, 2022

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

1 participant

alexbooth92 commented Jun 17, 2022 •

edited

Loading