Skip to content
Sascha Wagner edited this page Oct 24, 2018 · 6 revisions

Ant

Have a look at the blaster-specific section of the installation guide if you want to compile Ant on blaster.

Analysis / AntSubmit

AntSubmit creates a job for each input line, specifying an input file. This is forwarded to Ant prepended with -i as input. Run AntSubmit --help to see all options.

To create suitable file lists (which you could not find on the DAQwiki, but ask around!), you may use paste, for example:

ls /home/wagners/MC/pi0pi0_4g/pluto/* > pi0pi0_pluto 
ls /home/wagners/MC/pi0pi0_4g/geant/* > pi0pi0_geant 
paste pi0pi0_geant pi0pi0_pluto > MC_pi0pi0 

Also ensure to make absolute path names by using the clobbered version of ls above. Fixing file lists can be achieved with readlink as follows:

cat good-files-ant.list | xargs -n1 readlink -f > ~/work/2014-12_good_files`

To get started, create an empty folder (possibly named after your physics class you want to submit on blaster), ensure there's enough space for the output (always goes to current directory). Then create an Antrc file in your empty folder with arguments to Ant, for example:

-p InterpolatedPulls
-s Setup_2014_07_EPT_Prod

Then run, for example,

AntSubmit --filelist ~/work/2014-12_good_files

and see what happens. At some point, newly created log and root folders should appear, filled with output.

By default AntSubmit uses the qsub command to submit jobs to the queue system of the farm. By specifying the --no_qsub option the command lines the all jobs will be printed. By piping them into GNU parallel one can run over multiple input files in parallel on a multicore system:

AntSubmit --no_qsub --filelist ~/work/2014-12_good_files | parallel

AntMapReduce

AntMapReduce...

find <path/to/tree-files> -name "*.root" | AntMapReduce --plot "CrossSection_plot"

Simulation / AntSimSubmit

AntSimSubmit creates jobs for your MC simulation including the event generation using the MC generator of your choice and the detector simulation using a2geant. Run

AntSimSubmit --help

to see all flags you can pass as command line arguments.

It is highly recommended to create a configuration file to change the MC simulation to your needs. A default example file can be exported using

AntSimSubmit --example-config

By default AntSimSubmit tries to find a configuration sim_settings in the current working directory. You can add your own configuration file with -c.

See the example configuration file exported via the aforementioned method to get an idea of how to specify the simulation you wish. For example double pion production would look like

;"p pi0 [g g] pi0 [g g]" 500 100000

Make sure that you create the directories mcgen, geant, and log in your output directory, assuming the default settings, or use

AntSimSubmit -f

to left create them. A log of the submitted jobs can be found in the output directory in the format submit_date_time.log as well.

PBS/Torque queue management

Check the status of the queue with qstat or showq -r. Get your fairshare with diagnose -f.

In case you have submitted the wrong batch of jobs, or forgot to enable an option, you want to delete all jobs at once. Although qdel all exists to do that, it's rather slow as it deletes the jobs from the beginning. A better way to do this is

qstat | grep $USER | cut -f1 -d" " | tac | xargs -n10 qdel