/OSG-GEM

Permalink
OSG-GEM/sites.xml.template
Newer
Older
Raw Normal view History
100644 52 lines (44 sloc) 3.31 KB
Aug 8, 2016 @rynge Added support for multiple inputs and a GEM merge at the end. Simplie…
1 <?xml version="1.0" encoding="UTF-8"?>
2 <sitecatalog xmlns="http://pegasus.isi.edu/schema/sitecatalog" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://pegasus.isi.edu/schema/sitecatalog http://pegasus.isi.edu/schema/sc-4.0.xsd" version="4.0">
3
4 <site handle="local" arch="x86_64">
5 <directory type="shared-scratch" path="${RUN_DIR}/scratch">
6 <file-server operation="all" url="file://${RUN_DIR}/scratch"/>
7 </directory>
8 <directory type="local-storage" path="${RUN_DIR}/outputs">
9 <file-server operation="all" url="file://${RUN_DIR}/outputs"/>
10 </directory>
11 <profile namespace="pegasus" key="SSH_PRIVATE_KEY" >${HOME}/.ssh/workflow</profile>
12 <profile namespace="env" key="PATH" >${PATH}</profile>
Sep 30, 2016 @rynge Switched back to stashcp for data staging
13 <profile namespace="env" key="LD_LIBRARY_PATH" >${LD_LIBRARY_PATH}</profile>
Aug 8, 2016 @rynge Added support for multiple inputs and a GEM merge at the end. Simplie…
14 <profile namespace="condor" key="+WantsStashCache" >True</profile>
15 </site>
16
17 <site handle="stash" arch="x86_64" os="LINUX">
18 <directory type="shared-scratch" path="/stash2/user/${USER}/public">
Oct 27, 2016 @rynge Fixed typo in site catalog
19 <file-server operation="get" url="http://stash.osgconnect.net/~${USER}"/>
Oct 25, 2016 @rynge Switched to wget
20 <!-- file-server operation="get" url="stash:///user/${USER}/public"/ -->
Aug 8, 2016 @rynge Added support for multiple inputs and a GEM merge at the end. Simplie…
21 <file-server operation="put" url="scp://${USER}@login02.osgconnect.net/stash2/user/${USER}/public"/>
22 </directory>
23 </site>
24
25 <site handle="condorpool" arch="x86_64" os="LINUX">
26 <profile namespace="pegasus" key="style" >condor</profile>
27 <profile namespace="condor" key="universe" >vanilla</profile>
May 24, 2017 @wpoehlm exclude problematic compute sites from sites catalog
28 <profile namespace="condor" key="requirements" >OSGVO_OS_STRING == "RHEL 6" &amp;&amp; HAS_MODULES == True &amp;&amp; HAS_SCP == True &amp;&amp; GLIDEIN_ResourceName != "Hyak" &amp;&amp; GLIDEIN_ResourceName != "IIT_CE1" &amp;&amp; GLIDEIN_ResourceName != "IIT_CE" &amp;&amp; GLIDEIN_ResourceName != "UCR-HEP" &amp;&amp; GLIDEIN_ResourceName != "cinvestav" &amp;&amp; GLIDEIN_Site != "UUCHPC" &amp;&amp; TARGET.GLIDEIN_ResourceName =!= MY.MachineAttrGLIDEIN_ResourceName1 &amp;&amp; TARGET.GLIDEIN_ResourceName =!= MY.MachineAttrGLIDEIN_ResourceName2 &amp;&amp; TARGET.GLIDEIN_ResourceName =!= MY.MachineAttrGLIDEIN_ResourceName3 &amp;&amp; TARGET.GLIDEIN_ResourceName =!= MY.MachineAttrGLIDEIN_ResourceName4</profile>
Oct 11, 2016 @rynge Request 2 GB RAM
29 <profile namespace="condor" key="request_memory" >2 GB</profile>
Aug 8, 2016 @rynge Added support for multiple inputs and a GEM merge at the end. Simplie…
30 <profile namespace="condor" key="request_disk" >30 GB</profile>
31 <profile namespace="condor" key="+WantsStashCache" >True</profile>
Aug 18, 2016 @rynge Fix for missing dataset problem
32
33 <!-- disable OSG squid caching for now -->
Oct 25, 2016 @rynge Switched to wget
34 <profile namespace="env" key="http_proxy" ></profile>
35 <profile namespace="env" key="OSG_SQUID_LOCATION" ></profile>
Aug 8, 2016 @rynge Added support for multiple inputs and a GEM merge at the end. Simplie…
36 </site>
Dec 13, 2016 @rynge Enabled the workflow to be executed on Jetstream
37
38 <site handle="jetstream-staging" arch="x86_64" os="LINUX">
Dec 16, 2016 Improved file system layout when running on Jetstream
39 <directory type="shared-scratch" path="${PWD}/staging">
40 <file-server operation="all" url="scp://${USER}@${HOSTNAME}${PWD}/staging"/>
Dec 13, 2016 @rynge Enabled the workflow to be executed on Jetstream
41 </directory>
42 </site>
43
44 <site handle="jetstream-condorpool" arch="x86_64" os="LINUX">
45 <profile namespace="pegasus" key="style" >condor</profile>
46 <profile namespace="condor" key="universe" >vanilla</profile>
47 <profile namespace="condor" key="request_memory" >2 GB</profile>
48 <profile namespace="condor" key="request_disk" >1 GB</profile>
49 </site>
Aug 8, 2016 @rynge Added support for multiple inputs and a GEM merge at the end. Simplie…
50
51 </sitecatalog>