relval matrix update + data relval HLT:@relval2016 #14098

hengne · 2016-04-15T17:25:13Z

Includes:

update 2015D data workflows to use new HLT relval2016 menu (for L1 stage2)
regular relval updates of the gen-sim input strings
build on top of:
- PR Fixup crash observed in 0-event 1307.0 due to L1TGlobalSummary|Util #14073 - fix crash for cosmic workflow
- PR HLT development incl. use of v4 of L1T (80X) #13862 - HLT development incl. use of v4 of L1T (80X)

…er middleware to Condition Database

…from-CMSSW_8_1_0_pre2_relval' into from-CMSSW_8_1_0_pre2_relval

…SW_8_1_0_pre2_relval_test

cmsbuild · 2016-04-20T11:37:44Z

The tests are being triggered in jenkins.
https://cmssdt.cern.ch/jenkins/job/ib-any-integration/12518/console

cmsbuild · 2016-04-20T12:54:49Z

-1

Tested at: bda7b3e

You can see the results of the tests here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-14098/12518/summary.html

I found follow errors while testing this PR

Failed tests: RelVals AddOn

RelVals:

When I ran the RelVals I found an error in the following worklfows:
140.53 step2

runTheMatrix-results/140.53_RunHI2011+RunHI2011+RECOHID11+HARVESTDHI/step2_RunHI2011+RunHI2011+RECOHID11+HARVESTDHI.log

1000.0 step2

runTheMatrix-results/1000.0_RunMinBias2011A+RunMinBias2011A+TIER0+SKIMD+HARVESTDfst2+ALCASPLIT/step2_RunMinBias2011A+RunMinBias2011A+TIER0+SKIMD+HARVESTDfst2+ALCASPLIT.log

1001.0 step2

runTheMatrix-results/1001.0_RunMinBias2011A+RunMinBias2011A+TIER0EXP+ALCAEXP+ALCAHARVD1+ALCAHARVD2+ALCAHARVD3+ALCAHARVD4/step2_RunMinBias2011A+RunMinBias2011A+TIER0EXP+ALCAEXP+ALCAHARVD1+ALCAHARVD2+ALCAHARVD3+ALCAHARVD4.log

1003.0 step2

runTheMatrix-results/1003.0_RunMinBias2012A+RunMinBias2012A+RECODDQM+HARVESTDDQM/step2_RunMinBias2012A+RunMinBias2012A+RECODDQM+HARVESTDDQM.log

25202.0 step2

runTheMatrix-results/25202.0_TTbar_13+TTbar_13+DIGIUP15_PU25+RECOUP15_PU25+HARVESTUP15_PU25/step2_TTbar_13+TTbar_13+DIGIUP15_PU25+RECOUP15_PU25+HARVESTUP15_PU25.log

50202.0 step2

runTheMatrix-results/50202.0_TTbar_13+TTbar_13+DIGIUP15_PU50+RECOUP15_PU50+HARVESTUP15_PU50/step2_TTbar_13+TTbar_13+DIGIUP15_PU50+RECOUP15_PU50+HARVESTUP15_PU50.log

AddOn:

I found errors in the following addon tests:

cmsDriver.py RelVal -s HLT:PRef,RAW2DIGI,L1Reco,RECO --data --scenario=pp -n 10 --conditions auto:run2_data_PRef --relval 9000,50 --datatier "RAW-HLT-RECO" --eventcontent FEVTDEBUGHLT --customise=HLTrigger/Configuration/CustomConfigs.L1THLT --era Run2_2016 --magField 38T_PostLS1 --processName=HLTRECO --filein file:RelVal_Raw_PRef_DATA.root --fileout file:RelVal_Raw_PRef_DATA_HLT_RECO.root : FAILED - time: date Wed Apr 20 14:30:43 2016-date Wed Apr 20 14:24:44 2016 s - exit: 16640
cmsDriver.py RelVal -s HLT:HIon,RAW2DIGI,L1Reco,RECO --data --scenario=HeavyIons -n 10 --conditions auto:run2_data_HIon --relval 9000,50 --datatier "RAW-HLT-RECO" --eventcontent FEVTDEBUGHLT --customise=HLTrigger/Configuration/CustomConfigs.L1THLT --era Run2_2016,Run2_HI --magField 38T_PostLS1 --processName=HLTRECO --filein file:RelVal_Raw_HIon_DATA.root --fileout file:RelVal_Raw_HIon_DATA_HLT_RECO.root : FAILED - time: date Wed Apr 20 14:32:27 2016-date Wed Apr 20 14:24:49 2016 s - exit: 16640
cmsDriver.py RelVal -s HLT:PIon,RAW2DIGI,L1Reco,RECO --data --scenario=pp -n 10 --conditions auto:run2_data_PIon --relval 9000,50 --datatier "RAW-HLT-RECO" --eventcontent FEVTDEBUGHLT --customise=HLTrigger/Configuration/CustomConfigs.L1THLT --era Run2_2016 --magField 38T_PostLS1 --processName=HLTRECO --filein file:RelVal_Raw_PIon_DATA.root --fileout file:RelVal_Raw_PIon_DATA_HLT_RECO.root : FAILED - time: date Wed Apr 20 14:31:00 2016-date Wed Apr 20 14:25:54 2016 s - exit: 16640
cmsDriver.py RelVal -s HLT:Fake,RAW2DIGI,L1Reco,RECO --data --scenario=pp -n 10 --conditions auto:run1_data_Fake --relval 9000,50 --datatier "RAW-HLT-RECO" --eventcontent FEVTDEBUGHLT --customise=HLTrigger/Configuration/CustomConfigs.L1THLT --processName=HLTRECO --filein file:RelVal_Raw_Fake_DATA.root --fileout file:RelVal_Raw_Fake_DATA_HLT_RECO.root : FAILED - time: date Wed Apr 20 14:35:52 2016-date Wed Apr 20 14:32:58 2016 s - exit: 16640
cmsDriver.py RelVal -s HLT:GRun,RAW2DIGI,L1Reco,RECO --data --scenario=pp -n 10 --conditions auto:run2_data_GRun --relval 9000,50 --datatier "RAW-HLT-RECO" --eventcontent FEVTDEBUGHLT --customise=HLTrigger/Configuration/CustomConfigs.L1THLT --era Run2_25ns --magField 38T_PostLS1 --processName=HLTRECO --filein file:RelVal_Raw_GRun_DATA.root --fileout file:RelVal_Raw_GRun_DATA_HLT_RECO.root : FAILED - time: date Wed Apr 20 14:39:15 2016-date Wed Apr 20 14:33:02 2016 s - exit: 16640
cmsDriver.py RelVal -s HLT:Fake1,RAW2DIGI,L1Reco,RECO --data --scenario=pp -n 10 --conditions auto:run2_data_Fake1 --relval 9000,50 --datatier "RAW-HLT-RECO" --eventcontent FEVTDEBUGHLT --customise=HLTrigger/Configuration/CustomConfigs.L1THLT --era Run2_25ns --processName=HLTRECO --filein file:RelVal_Raw_Fake1_DATA.root --fileout file:RelVal_Raw_Fake1_DATA_HLT_RECO.root : FAILED - time: date Wed Apr 20 14:38:51 2016-date Wed Apr 20 14:35:54 2016 s - exit: 16640

hengne · 2016-04-20T13:30:34Z

still the file access issue, and also the issue in #14165

hengne · 2016-04-20T16:24:34Z

please test

cmsbuild · 2016-04-20T16:24:53Z

The tests are being triggered in jenkins.
https://cmssdt.cern.ch/jenkins/job/ib-any-integration/12525/console

cmsbuild · 2016-04-20T19:00:11Z

+1
Tested at: bda7b3e
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-14098/12525/summary.html

cmsbuild · 2016-04-20T20:30:33Z

Comparison is ready
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-14098/12525/summary.html

There are some workflows for which there are errors in the baseline:
134.911 step 3
140.53 step 2
1000.0 step 2
1001.0 step 2
1003.0 step 2
The results for the comparisons for these workflows could be incomplete
This means most likely that the IB is having errors in the relvals.The error does NOT come from this pull request

hengne · 2016-04-21T02:14:09Z

+1

hengne · 2016-04-21T08:05:43Z

@mulhearn could you please help to sign it again? thanks!

Add phase ii scenarios to runTheMatrix on top of #14098 #14165

slava77 · 2016-04-22T14:37:20Z

Configuration/PyReleaseValidation/python/relval_steps.py

@@ -1465,7 +1482,7 @@ def identityFS(wf):
 from  Configuration.PyReleaseValidation.upgradeWorkflowComponents import *

 defaultDataSets={}
-defaultDataSets['2017']='CMSSW_8_1_0_pre1-80X_upgrade2017_design_v4_UPG17-v'
+defaultDataSets['2017']='CMSSW_8_1_0_pre2-80X_upgrade2017_realistic_v1_UPG17realGT-v'


it looks like the datasets for 2017 are not available at CERN. So, pileup and recycled SIM matrix doesn't work.
Did somebody request transfer already?

yes, it is requested automatically but it is stack there:

https://cmsweb.cern.ch/phedex/prod/Data::Subscriptions#state=create_since%3D1458743912%3Bfilter%3D%2F*%2FCMSSW_8_1_0_pre2-80X_upgrade2017_realistic_v1_UPG17realGT-v*%2FGEN-SIM%3Bnode%3DT2_CH_CERN

Hi Hengne,

the request was there for more than a week.
It looks like it has fallen through the cracks.
Maybe an email to dataops to get it going?

Wu and others added 30 commits April 6, 2016 17:42

T2_Chen commented out to avoid eos errors

9347c53

re-generation gen-sim update

9ffb690

remove temp. T2_CH_CERN requirement

7af7641

new GT for cosmic wf in fullSim noPU set

3b7d09e

add experimental workflows to test digital signature to access Fronti…

700120b

…er middleware to Condition Database

remove temp. T2_CH_CERN requirement

f1a1ec2

add experimental workflows to test digital signature to access Fronti…

8512e8a

…er middleware to Condition Database

add Frontier Digital Signature test run1 fullSim workflow

83fd3ec

add frontier digital signature test run1 data workflows

57eab4d

add frontier digital signature test run1 data HI workflow

db69d5b

add frontier digital signature test run2 data workflows

26f7eb2

change a run2 data workflow to be a run2 data skimming workflow

11004bd

add label for Frontier digi signature test workflows

b27a439

add frontier digital signature test workflow of 2017 upgrade

1a5fe28

add frontier digital signature test workflow for run2 fastsim

02c76d2

add 11425.0 upgrade frontier digital signature test workflow in ib test

564c7b3

update gensim input for 2017 workflows

56d9115

fix typo in gensim input string

bdbf431

Merge branch 'from-CMSSW_8_1_0_pre2_relval', remote branch 'mengqing/…

0d96830

…from-CMSSW_8_1_0_pre2_relval' into from-CMSSW_8_1_0_pre2_relval

clean up

9a7b249

fix conflict

94c8733

change to phase1 design GT with new gensim input

78dfd98

clearn up

87030e1

Merge branch 'from-CMSSW_8_1_0_pre2_relval_DigiSigTest' into from-CMS…

eaccb88

…SW_8_1_0_pre2_relval_test

update data 2015d and fastsim workflows to use relval2016 HLT menu

50bc972

resolve conflict

dcfd4e4

resolve conflict

07ec74b

resolve confilict

9f25003

resolve conflict

d6b5d6c

resolve conflict

60874bf

cmsbuild added tests-pending tests-started and removed tests-rejected tests-pending labels Apr 20, 2016

cmsbuild added tests-rejected and removed tests-started labels Apr 20, 2016

hengne mentioned this pull request Apr 20, 2016

Phase2 workflow fixes #14165

Closed

cmsbuild added tests-pending tests-started and removed tests-rejected tests-pending labels Apr 20, 2016

cmsbuild added tests-approved and removed tests-started labels Apr 20, 2016

cmsbuild added comparison-available and removed comparison-pending labels Apr 20, 2016

cmsbuild added pdmv-approved and removed pdmv-pending labels Apr 21, 2016

davidlange6 merged commit 5fc878e into cms-sw:CMSSW_8_1_X Apr 21, 2016

davidlange6 added a commit that referenced this pull request Apr 21, 2016

Merge pull request #14181 from davidlange6/addPhIIscenarios

692264b

Add phase ii scenarios to runTheMatrix on top of #14098 #14165

slava77 reviewed Apr 22, 2016
View reviewed changes

hengne mentioned this pull request Apr 22, 2016

relval matrix to use HLT relval2016 #14117

Merged

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

relval matrix update + data relval HLT:@relval2016 #14098

relval matrix update + data relval HLT:@relval2016 #14098

hengne commented Apr 15, 2016 •

edited

cmsbuild commented Apr 20, 2016

cmsbuild commented Apr 20, 2016

hengne commented Apr 20, 2016

hengne commented Apr 20, 2016

cmsbuild commented Apr 20, 2016

cmsbuild commented Apr 20, 2016

cmsbuild commented Apr 20, 2016

hengne commented Apr 21, 2016

hengne commented Apr 21, 2016

slava77 Apr 22, 2016

hengne Apr 22, 2016

slava77 Apr 22, 2016

relval matrix update + data relval HLT:@relval2016 #14098

relval matrix update + data relval HLT:@relval2016 #14098

Conversation

hengne commented Apr 15, 2016 • edited

cmsbuild commented Apr 20, 2016

cmsbuild commented Apr 20, 2016

hengne commented Apr 20, 2016

hengne commented Apr 20, 2016

cmsbuild commented Apr 20, 2016

cmsbuild commented Apr 20, 2016

cmsbuild commented Apr 20, 2016

hengne commented Apr 21, 2016

hengne commented Apr 21, 2016

slava77 Apr 22, 2016

Choose a reason for hiding this comment

hengne Apr 22, 2016

Choose a reason for hiding this comment

slava77 Apr 22, 2016

Choose a reason for hiding this comment

hengne commented Apr 15, 2016 •

edited