implement crab -resubmit bad

[ericvaandering]

Original Savannah ticket 99942 reported by belforte on Mon Jan 21 04:19:51 2013.

Hi,
I'd like to propose you a new feature for crab2, that allows to
resubmit the set of failed jobs without having to copy-paste by hand the
list(s) of failed jobs from -status output.

The use case should be obvious: it is particularly important in case
multicrab is used. In that case it is not possible to resubmit via
multicrab, since each task need its own list of failed job.

The syntax could be simply

crab -resubmit bad

(similar to crab -resubmit all )

I have the modification in the code ready in 284 and I'm using it w/o
problems (crab.py, Resubmitter.py and ResubmitterServer.py)

The implementation is such that the following jobs are resubmitted:

in status ['KillSuccess','SubFailed','Aborted']

in status ['Cleared'] if the job or wrapper exit code is not 0.

The set can be expanded easily.

ADD:
['Cancelled'] to be added
exit code 60308 to be skipped

[ericvaandering]

Comment by slacapra on Thu Jan 17 10:25:20 2013

Committed into CVS

Modified Files:
crab.py Resubmitter.py ResubmitterServer.py
Log Message:
implement -resubmit bad as per task #39244

[ericvaandering]

Comment by belforte on Mon Jan 21 04:19:51 2013

This item has been reassigned from the project CRAB task tracker to your tracker.

The original report is still available at task #39244

Following are the information included in the original report:

• [field #0] Item ID: 39244
• [field Add tar balls to repo #1] Group ID: 265
• [field Add binaries to externals/ directory #2] Open/Closed: Closed
• [field Lmitiation due to the Input sandbox #3] Severity: 3 - Normal
• [field change users LFN namespace, add check on user datasetpath #4] Privacy: Public
• [field support for SRMv2 #9] Category: crab client
• [field new client-server communication system #10] Submitted by: slacapra
• [field development of a set of API for the dedicate storage interaction #11] Assigned to: slacapra
• [field re-deign of submission component structure #12] Submitted on: 2013-01-17 15:29
• [field CRAB-SA/Client and BossLite integration #13] Summary: implement crab -resubmit bad
• [field development of condor_g scheduler script for BossLite #14] Original Submission: Hi,
  I d like to propose you a new feature for crab2, that allows to
  resubmit the set of failed jobs without having to copy-paste by hand the
  list(s) of failed jobs from -status output.

The use case should be obvious: it is particularly important in case
multicrab is used. In that case it is not possible to resubmit via
multicrab, since each task need its own list of failed job.

The syntax could be simply

crab -resubmit bad

(similar to crab -resubmit all )

I have the modification in the code ready in 284 and I m using it w/o
problems (crab.py, Resubmitter.py and ResubmitterServer.py)

The implementation is such that the following jobs are resubmitted:

in status [ KillSuccess , SubFailed , Aborted ]

in status [ Cleared ] if the job or wrapper exit code is not 0.

The set can be expanded easily.

ADD:
[ Cancelled ] to be added
exit code 60308 to be skipped

• [field Disk space and server cleaning management #15] Closed on: 2013-01-17 16:25
• [field Improve the Error Handler making the jobs resubission more smart #16] Item Group: None
• [field add the merge support for analysis jobs #17] Status: Done
• [field implementation of a "localcopy" feature to take output file from a SE to the user local area #18] Component Version: None
• [field CRAB wrapper cleaning and reorganization #19] Operating System: None
• [field LSF (CAF ) script for bosslite #20] Reproducibility: None
• [field implement a new feature which allow an easy report about submitted jobs/task #21] Size (loc): None
• [field submission to the CAF using the server #22] Fixed Release: None
• [field check how to use (if needed) the PA job queue when the server submit directly to condor_g #23] Planned Release: None
• [field test #24] Effort: 0.00
• [field GetOutput Migration from Boss to bosslite #28] Priority: 3 - Low
• [field JobTracking component migration to bosslite #29] Should Start On: 2013-01-17 00:00
• [field implement task flavor management in command menager component #30] Should be Finished on: 2013-01-17 00:00
• [field support to additional requirements management #31] Percent Complete: 0%
• [field test of: new support for py pset @ WN level and api to extract hnUserName usage #33] Release: None
• [field Enable crab to get Histo names from JobReport #34] Release: 285
• [field Abilitate PostMortem for the server #58] Custom Select Box Add tar balls to repo #1: None
• [field crab -report #59] Custom Select Box Add binaries to externals/ directory #2: None
• [field Enable the bulk resubmissions #60] Custom Select Box Lmitiation due to the Input sandbox #3: None
• [field improve get output status and flag handling in the server #61] Custom Select Box change users LFN namespace, add check on user datasetpath #4: None
• [field CommandManager support for allowed users and for accepted client versions #62] Custom Select Box extract output file name from pset #5: None
• [field [BUG] Logging info being retrieved also for not aborted/killed joba #63] Custom Select Box enable the "global" crab.cfg support #6: None
• [field [BUG] Problem on JobHandling.py: receiving jobid instead of object or viceversa #64] Custom Select Box "multicrab" support implementation #7: None
• [field [BUG] Status updates on resubmissions #65] Custom Select Box Test CRAB with the new LCG-UI #8: None
• [field GetOutput timeout for glite #66] Custom Select Box support for SRMv2 #9: None
• [field CMS Naming B/W listing (aka Brian patch) #67] Custom Select Box new client-server communication system #10: None

[ericvaandering]

Closed by belforte on Tue Jan 29 06:42:40 2013

[ericvaandering]

Comment by belforte on Tue Jan 29 06:42:40 2013

released in CRAB_2_8_5