Pegasus_workflows

Installation and setup

Download Pegasus and HTCondor

On Ubuntu 16.04 you may have to install libmysqlclient18 by dwnloading the deb package

Generating a DAG

If you have a daxgen.py file, like L2_daxgen.py, you can generate the DAG (as xml) by doing

$ python L2_daxgen.py

This will create a dax file L2.dax.

Starting HTCondor

Check that the condor daemon is running,

$ ps aux | egrep condor_

If it is not, then start the daemon:

$ sudo <release_dir>/sbin/condor_master

Executing the workflow

To execute the workflow do

$ ./plan_dax.sh L2.dax

See the Pegasus tutorial for info on other setup one needs to do, e.g., the sites.xml file, the tc.txt ("transformation catalog") to map executables, etc..

Monitoring the workflow progress

Start up the Pegasus web service

$ sudo pegasus-service

and navigate to https://localhost:5000