stage out plugin for xrood on CAF

[ericvaandering]

Original Savannah ticket 83930 reported by fanzago on Mon Jul 4 04:24:04 2011.

CAF has to use the xrootd protocol to read input data and to perfom the stageout of produced files.

It needs to write a new SEAPI plugin for xrootd and some changes in the client.

Changed files

1. in crab/python:
   cmscp.py
   Scheduler.py
   SchedulerCaf.py
   PhEDExDatasvcInfo.py
   crab_template.py
2. in ProdCommon/Storage/SEAPI:
   SElement.py
   and added ProtocolXrootd.py

Some notes to use xrootd at caf:

1. In the SchedulerCaf the "pool" parameter is not more necessary
2. the setup of the environment is done sourcing the file
   /afs/cern.ch/cms/caf/test.sh in the UI and at WN level
3. in the PhEDExDatasvcInfo
   *) the forced path is now '/store/eos/user/'
   *) to get the complete endpoint, the query of phedex api has to be done using "stageout" and not "direct" --> root://eoscms//eos/cms/store/eos/user/fanzago/FEDE_TEST_DEL_9/
   *) currently to get the se_path we split the endpoint assuming root://eoscms// is a fixed value
   *) for test up, waiting the update of phedex api, the first part of the endpoint is harcoded
4. in the protocolXrootd
   *) the command for the copy is xrdcp that needs the complete
   endpoint for the destination file
   *) other command are performed using something similar to:
   xrd eoscms <command> <file>

and currently we are assuming eoscms is the name of remote xrd server (so eoscms is hardcoded)

I don't commit in cvs the code, waiting for the crab_2_7_8_patch2 release.
If you want to test the code, I can provide the patched tgz.

Federica

[ericvaandering]

Comment by belforte on Mon Jul 4 04:24:04 2011

This item has been reassigned from the project CRAB task tracker to your tracker.

The original report is still available at task #21096

Following are the information included in the original report:

• [field #0] Item ID: 21096
• [field Add tar balls to repo #1] Group ID: 265
• [field Add binaries to externals/ directory #2] Open/Closed: Open
• [field Lmitiation due to the Input sandbox #3] Severity: 3 - Normal
• [field change users LFN namespace, add check on user datasetpath #4] Privacy: Public
• [field support for SRMv2 #9] Category: crab client
• [field new client-server communication system #10] Submitted by: fanzago
• [field development of a set of API for the dedicate storage interaction #11] Assigned to: fanzago
• [field re-deign of submission component structure #12] Submitted on: 2011-06-23 18:39
• [field CRAB-SA/Client and BossLite integration #13] Summary: stage out plugin for xrood on CAF
• [field development of condor_g scheduler script for BossLite #14] Original Submission: CAF has to use the xrootd protocol to read input data and to perfom the stageout of produced files.

It needs to write a new SEAPI plugin for xrootd and some changes in the client.

Changed files

1. in crab/python:
   cmscp.py
   Scheduler.py
   SchedulerCaf.py
   PhEDExDatasvcInfo.py
   crab_template.py
2. in ProdCommon/Storage/SEAPI:
   SElement.py
   and added ProtocolXrootd.py
   #######################

Some notes to use xrootd at caf:

1. In the SchedulerCaf the "pool" parameter is not more necessary
2. the setup of the environment is done sourcing the file
   /afs/cern.ch/cms/caf/test.sh in the UI and at WN level
3. in the PhEDExDatasvcInfo
   *) the forced path is now /store/eos/user/
   *) to get the complete endpoint, the query of phedex api has to be done using "stageout" and not "direct" --> root://eoscms//eos/cms/store/eos/user/fanzago/FEDE_TEST_DEL_9/
   *) currently to get the se_path we split the endpoint assuming root://eoscms// is a fixed value
   *) for test up, waiting the update of phedex api, the first part of the endpoint is harcoded
4. in the protocolXrootd
   *) the command for the copy is xrdcp that needs the complete
   endpoint for the destination file
   *) other command are performed using something similar to:
   xrd eoscms

and currently we are assuming eoscms is the name of remote xrd server (so eoscms is hardcoded)

I don t commit in cvs the code, waiting for the crab_2_7_8_patch2 release.
If you want to test the code, I can provide the patched tgz.

Federica

• [field Improve the Error Handler making the jobs resubission more smart #16] Item Group: None
• [field add the merge support for analysis jobs #17] Status: None
• [field implementation of a &quot;localcopy&quot; feature to take output file from a SE to the user local area #18] Component Version: None
• [field CRAB wrapper cleaning and reorganization #19] Operating System: None
• [field LSF (CAF ) script for bosslite #20] Reproducibility: None
• [field implement a new feature which allow an easy report about submitted jobs/task #21] Size (loc): None
• [field submission to the CAF using the server #22] Fixed Release: None
• [field check how to use (if needed) the PA job queue when the server submit directly to condor_g #23] Planned Release: None
• [field test #24] Effort: 0.00
• [field GetOutput Migration from Boss to bosslite #28] Priority: 5 - Normal
• [field JobTracking component migration to bosslite #29] Should Start On: 2011-06-22 22:00
• [field implement task flavor management in command menager component #30] Should be Finished on: 2011-06-22 22:00
• [field support to additional requirements management #31] Percent Complete: 90%
• [field test of: new support for py pset @ WN level and api to extract hnUserName usage #33] Release: None
• [field Enable crab to get Histo names from JobReport #34] Release: 278
• [field Abilitate PostMortem for the server #58] Custom Select Box Add tar balls to repo #1: None
• [field crab -report #59] Custom Select Box Add binaries to externals/ directory #2: None
• [field Enable the bulk resubmissions #60] Custom Select Box Lmitiation due to the Input sandbox #3: None
• [field improve get output status and flag handling in the server #61] Custom Select Box change users LFN namespace, add check on user datasetpath #4: None
• [field CommandManager support for allowed users and for accepted client versions #62] Custom Select Box extract output file name from pset #5: None
• [field [BUG] Logging info being retrieved also for not aborted/killed joba #63] Custom Select Box enable the &quot;global&quot; crab.cfg support #6: None
• [field [BUG] Problem on JobHandling.py: receiving jobid instead of object or viceversa #64] Custom Select Box &quot;multicrab&quot; support implementation #7: None
• [field [BUG] Status updates on resubmissions #65] Custom Select Box Test CRAB with the new LCG-UI #8: None
• [field GetOutput timeout for glite #66] Custom Select Box support for SRMv2 #9: None
• [field CMS Naming B/W listing (aka Brian patch) #67] Custom Select Box new client-server communication system #10: None

[ericvaandering]

Comment by fanzago on Mon Jul 4 05:00:35 2011

/afs/cern.ch/user/f/fanzago/public/CRAB_2_7_8_patch2_pre1_XROOTD.tgz

[ericvaandering]

Comment by fanzago on Wed Jul 13 08:24:18 2011

patch installata in afs:

/afs/cern.ch/cms/ccs/wm/scripts/Crab/CRAB_2_7_8_patch1_CAF/

[ericvaandering]

Comment by fanzago on Wed Jul 13 08:28:35 2011

the patch is related only the source of file at WN level, not stageout

[ericvaandering]

Comment by fanzago on Fri Jul 22 11:12:52 2011

The CRAB version to work at CAF with XROOTD protocol also for stageout is prepared and installed at cern for test.

TO use this release you have only to source the file
/afs/cern.ch/cms/ccs/wm/scripts/Crab/CRAB_2_7_8_patch_XROOTD/crab.(c)sh

Warning: to create jobs it is necessary to check the DBS that requieres the user grid proxy.
So before creating jobs you have to create your grid proxy.

[ericvaandering]

Comment by fanzago on Mon Aug 29 05:11:42 2011

Changes to allow the switch between rfio and xrootd protocol.
Committed code in cvs:

1. in crab/python
   Scheduler.py
   SchedulerLocal.py
   SchedulerCAF.py
   cmscp.py
   PhEDExDatasvcInfo.py

2. in prodcommon/Storage/SEAPI
   SElement.py
   ProtocolRfio.py
   ProtocolXrootd.py

Please test the code

[ericvaandering]

Comment by fanzago on Mon Aug 29 05:19:58 2011

In the crab.cfg in the section [USER] the parameter caf_lfn has to be added.
This parameter allows to select the first part of LFN, needed to query the PhEDEx api.

The default value is /store/caf/user.
The value to test eos area is

caf_lfn = /store/eos/user

The endpoint returned by the query contains the protocol (rfio or xrootd at caf) for the output copy.

[ericvaandering]

Comment by fanzago on Mon Aug 29 05:33:22 2011

Updated crab/python
full_crab.cfg
crab_help.cfg

adding the caf_lfn parameter in [USER]

[ericvaandering]

Closed by belforte on Tue Nov 1 18:49:20 2011