EMTF 2017 PR #4 - 2017 CondDB and O2O #19928

abrinke1 · 2017-07-26T16:51:44Z

Part 4 of set of PRs following PR #19743
(Skipped part originally labeled as number 3)

Updated CondDB and O2O functionality from @kkotov to support 2017 pT assignment and primitive conversion in emulator.

cmsbuild · 2017-07-26T16:52:03Z

A new Pull Request was created by @abrinke1 for master.

It involves the following packages:

CondCore/L1TPlugins
CondFormats/DataRecord
CondTools/L1TriggerExt
L1Trigger/L1TMuonEndCap
L1TriggerConfig/L1TConfigProducers
L1TriggerConfig/Utilities

@ghellwig, @arunhep, @cerminar, @cmsbuild, @rekovic, @franzoni, @ggovi, @davidlange6, @mulhearn, @lpernie can you please review it and eventually sign? Thanks.
@ghellwig, @kreczko, @tocheng, @Martin-Grunewald, @thomreis, @mmusich, @seemasharmafnal this is something you requested to watch as well.
@davidlange6 you are the release manager for this.

cms-bot commands are listed here

arunhep · 2017-07-26T21:47:10Z

please test

cmsbuild · 2017-07-26T21:47:26Z

The tests are being triggered in jenkins.
https://cmssdt.cern.ch/jenkins/job/ib-any-integration/21795/console Started: 2017/07/27 00:23

cmsbuild · 2017-07-26T22:56:42Z

-1

Tested at: c7ca155

The following merge commits were also included on top of IB + this PR after doing git cms-merge-topic:
b2079c1
You can see more details here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-19928/21795/git-log-recent-commits
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-19928/21795/git-merge-result

You can see the results of the tests here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-19928/21795/summary.html

I found follow errors while testing this PR

Failed tests: RelVals AddOn

RelVals:

When I ran the RelVals I found an error in the following worklfows:
136.731 step2

runTheMatrix-results/136.731_RunSinglePh2016B+RunSinglePh2016B+HLTDR2_2016+RECODR2_2016reHLT_skimSinglePh_HIPM+HARVESTDR2/step2_RunSinglePh2016B+RunSinglePh2016B+HLTDR2_2016+RECODR2_2016reHLT_skimSinglePh_HIPM+HARVESTDR2.log

135.4 step1

runTheMatrix-results/135.4_ZEE_13+ZEEFS_13+HARVESTUP15FS+MINIAODMCUP15FS/step1_ZEE_13+ZEEFS_13+HARVESTUP15FS+MINIAODMCUP15FS.log

136.7611 step2

runTheMatrix-results/136.7611_RunJetHT2016E_reminiaod+RunJetHT2016E_reminiaod+REMINIAOD_data2016+HARVESTDR2_REMINIAOD_data2016/step2_RunJetHT2016E_reminiaod+RunJetHT2016E_reminiaod+REMINIAOD_data2016+HARVESTDR2_REMINIAOD_data2016.log

1306.0 step2

runTheMatrix-results/1306.0_SingleMuPt1_UP15+SingleMuPt1_UP15+DIGIUP15+RECOUP15+HARVESTUP15/step2_SingleMuPt1_UP15+SingleMuPt1_UP15+DIGIUP15+RECOUP15+HARVESTUP15.log

1330.0 step2

runTheMatrix-results/1330.0_ZMM_13+ZMM_13+DIGIUP15+RECOUP15+HARVESTUP15/step2_ZMM_13+ZMM_13+DIGIUP15+RECOUP15+HARVESTUP15.log

10042.0 step2

runTheMatrix-results/10042.0_ZMM_13+ZMM_13TeV_TuneCUETP8M1_2017_GenSimFull+DigiFull_2017+RecoFull_2017+ALCAFull_2017+HARVESTFull_2017/step2_ZMM_13+ZMM_13TeV_TuneCUETP8M1_2017_GenSimFull+DigiFull_2017+RecoFull_2017+ALCAFull_2017+HARVESTFull_2017.log

25202.0 step2

runTheMatrix-results/25202.0_TTbar_13+TTbar_13+DIGIUP15_PU25+RECOUP15_PU25+HARVESTUP15_PU25/step2_TTbar_13+TTbar_13+DIGIUP15_PU25+RECOUP15_PU25+HARVESTUP15_PU25.log

10024.0 step2

runTheMatrix-results/10024.0_TTbar_13+TTbar_13TeV_TuneCUETP8M1_2017_GenSimFull+DigiFull_2017+RecoFull_2017+ALCAFull_2017+HARVESTFull_2017/step2_TTbar_13+TTbar_13TeV_TuneCUETP8M1_2017_GenSimFull+DigiFull_2017+RecoFull_2017+ALCAFull_2017+HARVESTFull_2017.log

10824.0 step2

runTheMatrix-results/10824.0_TTbar_13+TTbar_13TeV_TuneCUETP8M1_2018_GenSimFull+DigiFull_2018+RecoFull_2018+ALCAFull_2018+HARVESTFull_2018/step2_TTbar_13+TTbar_13TeV_TuneCUETP8M1_2018_GenSimFull+DigiFull_2018+RecoFull_2018+ALCAFull_2018+HARVESTFull_2018.log

20034.0 step2

runTheMatrix-results/20034.0_TTbar_14TeV+TTbar_14TeV_TuneCUETP8M1_2023D17_GenSimHLBeamSpotFull14+DigiFullTrigger_2023D17+RecoFullGlobal_2023D17+HARVESTFullGlobal_2023D17/step2_TTbar_14TeV+TTbar_14TeV_TuneCUETP8M1_2023D17_GenSimHLBeamSpotFull14+DigiFullTrigger_2023D17+RecoFullGlobal_2023D17+HARVESTFullGlobal_2023D17.log

20434.0 step2

runTheMatrix-results/20434.0_TTbar_14TeV+TTbar_14TeV_TuneCUETP8M1_2023D19_GenSimHLBeamSpotFull14+DigiFullTrigger_2023D19+RecoFullGlobal_2023D19+HARVESTFullGlobal_2023D19/step2_TTbar_14TeV+TTbar_14TeV_TuneCUETP8M1_2023D19_GenSimHLBeamSpotFull14+DigiFullTrigger_2023D19+RecoFullGlobal_2023D19+HARVESTFullGlobal_2023D19.log

AddOn:

I found errors in the following addon tests:

cmsDriver.py RelVal -s L1REPACK:Full --data --scenario=pp -n 10 --conditions auto:run2_hlt_Fake2 --relval 9000,50 --datatier "RAW" --eventcontent RAW --customise=HLTrigger/Configuration/CustomConfigs.L1T --era Run2_2016 --fileout file:RelVal_Raw_Fake2_DATA.root --filein /store/data/Run2015D/MuonEG/RAW/v1/000/256/677/00000/80950A90-745D-E511-92FD-02163E011C5D.root : FAILED - time: date Thu Jul 27 00:49:31 2017-date Thu Jul 27 00:48:54 2017 s - exit: 18688
cmsRun /cvmfs/cms-ib.cern.ch/nweek-02482/slc6_amd64_gcc630/cms/cmssw-patch/CMSSW_9_3_X_2017-07-26-1100/src/HLTrigger/Configuration/test/OnLine_HLT_Fake2.py realData=True globalTag=@ inputFiles=@ : FAILED - time: date Thu Jul 27 00:49:31 2017-date Thu Jul 27 00:48:54 2017 s - exit: 21504
cmsDriver.py RelVal -s HLT:Fake2,RAW2DIGI,L1Reco,RECO --data --scenario=pp -n 10 --conditions auto:run2_data_Fake2 --relval 9000,50 --datatier "RAW-HLT-RECO" --eventcontent FEVTDEBUGHLT --customise=HLTrigger/Configuration/CustomConfigs.L1THLT --era Run2_2016 --processName=HLTRECO --filein file:RelVal_Raw_Fake2_DATA.root --fileout file:RelVal_Raw_Fake2_DATA_HLT_RECO.root : FAILED - time: date Thu Jul 27 00:49:31 2017-date Thu Jul 27 00:48:54 2017 s - exit: 21504
cmsDriver.py TTbar_Tauola_13TeV_TuneCUETP8M1_cfi -s GEN,SIM,DIGI,L1,DIGI2RAW --mc --scenario=pp -n 10 --conditions auto:run2_mc_2e34_v2 --relval 9000,50 --datatier "GEN-SIM-RAW" --eventcontent RAWSIM --customise=HLTrigger/Configuration/CustomConfigs.L1T --era Run2_2017 --fileout file:RelVal_Raw_2e34_v2_MC.root : FAILED - time: date Thu Jul 27 00:50:09 2017-date Thu Jul 27 00:48:56 2017 s - exit: 18688
cmsRun /cvmfs/cms-ib.cern.ch/nweek-02482/slc6_amd64_gcc630/cms/cmssw-patch/CMSSW_9_3_X_2017-07-26-1100/src/HLTrigger/Configuration/test/OnLine_HLT_2e34_v2.py realData=False globalTag=@ inputFiles=@ : FAILED - time: date Thu Jul 27 00:50:09 2017-date Thu Jul 27 00:48:56 2017 s - exit: 21504
cmsDriver.py RelVal -s HLT:2e34_v2,RAW2DIGI,L1Reco,RECO --mc --scenario=pp -n 10 --conditions auto:run2_mc_2e34_v2 --relval 9000,50 --datatier "RAW-HLT-RECO" --eventcontent FEVTDEBUGHLT --customise=HLTrigger/Configuration/CustomConfigs.L1THLT --era Run2_2017 --processName=HLTRECO --filein file:RelVal_Raw_2e34_v2_MC.root --fileout file:RelVal_Raw_2e34_v2_MC_HLT_RECO.root : FAILED - time: date Thu Jul 27 00:50:09 2017-date Thu Jul 27 00:48:56 2017 s - exit: 21504
cmsDriver.py RelVal -s L1REPACK:Full --data --scenario=pp -n 10 --conditions auto:run2_hlt_PRef --relval 9000,50 --datatier "RAW" --customise=HLTrigger/Configuration/CustomConfigs.L1T --era Run2_2017 --eventcontent RAW --fileout file:RelVal_Raw_PRef_DATA.root --filein /store/data/Run2017A/HLTPhysics4/RAW/v1/000/295/606/00000/36DE5E0A-3645-E711-8FA1-02163E01A43B.root : FAILED - time: date Thu Jul 27 00:49:41 2017-date Thu Jul 27 00:48:57 2017 s - exit: 18688
cmsRun /cvmfs/cms-ib.cern.ch/nweek-02482/slc6_amd64_gcc630/cms/cmssw-patch/CMSSW_9_3_X_2017-07-26-1100/src/HLTrigger/Configuration/test/OnLine_HLT_PRef.py realData=True globalTag=@ inputFiles=@ : FAILED - time: date Thu Jul 27 00:49:41 2017-date Thu Jul 27 00:48:57 2017 s - exit: 21504
cmsDriver.py RelVal -s HLT:PRef,RAW2DIGI,L1Reco,RECO --data --scenario=pp -n 10 --conditions auto:run2_data_PRef --relval 9000,50 --datatier "RAW-HLT-RECO" --eventcontent FEVTDEBUGHLT --customise=HLTrigger/Configuration/CustomConfigs.L1THLT --era Run2_2017 --processName=HLTRECO --filein file:RelVal_Raw_PRef_DATA.root --fileout file:RelVal_Raw_PRef_DATA_HLT_RECO.root : FAILED - time: date Thu Jul 27 00:49:41 2017-date Thu Jul 27 00:48:57 2017 s - exit: 21504
cmsDriver.py RelVal -s L1REPACK:Full2015Data --data --scenario=HeavyIons -n 10 --conditions auto:run2_hlt_HIon --relval 9000,50 --datatier "RAW" --eventcontent RAW --customise=HLTrigger/Configuration/CustomConfigs.L1T --era Run2_2016,Run2_HI --fileout file:RelVal_Raw_HIon_DATA.root --filein /store/hidata/HIRun2015/HIHardProbes/RAW-RECO/HighPtJet-PromptReco-v1/000/263/689/00000/1802CD9A-DDB8-E511-9CF9-02163E0138CA.root : FAILED - time: date Thu Jul 27 00:49:36 2017-date Thu Jul 27 00:48:58 2017 s - exit: 18688
cmsRun /cvmfs/cms-ib.cern.ch/nweek-02482/slc6_amd64_gcc630/cms/cmssw-patch/CMSSW_9_3_X_2017-07-26-1100/src/HLTrigger/Configuration/test/OnLine_HLT_HIon.py realData=True globalTag=@ inputFiles=@ : FAILED - time: date Thu Jul 27 00:49:36 2017-date Thu Jul 27 00:48:58 2017 s - exit: 21504
cmsDriver.py RelVal -s HLT:HIon,RAW2DIGI,L1Reco,RECO --data --scenario=HeavyIons -n 10 --conditions auto:run2_data_HIon --relval 9000,50 --datatier "RAW-HLT-RECO" --eventcontent FEVTDEBUGHLT --customise=HLTrigger/Configuration/CustomConfigs.L1THLT --era Run2_2016,Run2_HI --processName=HLTRECO --filein file:RelVal_Raw_HIon_DATA.root --fileout file:RelVal_Raw_HIon_DATA_HLT_RECO.root : FAILED - time: date Thu Jul 27 00:49:36 2017-date Thu Jul 27 00:48:58 2017 s - exit: 21504
cmsDriver.py TTbar_Tauola_13TeV_TuneCUETP8M1_cfi -s GEN,SIM,DIGI,L1,DIGI2RAW --mc --scenario=pp -n 10 --conditions auto:run2_mc_GRun --relval 9000,50 --datatier "GEN-SIM-RAW" --eventcontent RAWSIM --customise=HLTrigger/Configuration/CustomConfigs.L1T --era Run2_2017 --fileout file:RelVal_Raw_GRun_MC.root : FAILED - time: date Thu Jul 27 00:50:16 2017-date Thu Jul 27 00:49:03 2017 s - exit: 18688
cmsRun /cvmfs/cms-ib.cern.ch/nweek-02482/slc6_amd64_gcc630/cms/cmssw-patch/CMSSW_9_3_X_2017-07-26-1100/src/HLTrigger/Configuration/test/OnLine_HLT_GRun.py realData=False globalTag=@ inputFiles=@ : FAILED - time: date Thu Jul 27 00:50:16 2017-date Thu Jul 27 00:49:03 2017 s - exit: 21504
cmsDriver.py RelVal -s HLT:GRun,RAW2DIGI,L1Reco,RECO --mc --scenario=pp -n 10 --conditions auto:run2_mc_GRun --relval 9000,50 --datatier "RAW-HLT-RECO" --eventcontent FEVTDEBUGHLT --customise=HLTrigger/Configuration/CustomConfigs.L1THLT --era Run2_2017 --processName=HLTRECO --filein file:RelVal_Raw_GRun_MC.root --fileout file:RelVal_Raw_GRun_MC_HLT_RECO.root : FAILED - time: date Thu Jul 27 00:50:16 2017-date Thu Jul 27 00:49:03 2017 s - exit: 21504
cmsDriver.py TTbar_Tauola_13TeV_TuneCUETP8M1_cfi -s GEN,SIM,DIGI,L1,DIGI2RAW --mc --scenario=pp -n 10 --conditions auto:run2_mc_PIon --relval 9000,50 --datatier "GEN-SIM-RAW" --eventcontent RAWSIM --customise=HLTrigger/Configuration/CustomConfigs.L1T --era Run2_2017 --fileout file:RelVal_Raw_PIon_MC.root : FAILED - time: date Thu Jul 27 00:49:53 2017-date Thu Jul 27 00:49:09 2017 s - exit: 18688
cmsRun /cvmfs/cms-ib.cern.ch/nweek-02482/slc6_amd64_gcc630/cms/cmssw-patch/CMSSW_9_3_X_2017-07-26-1100/src/HLTrigger/Configuration/test/OnLine_HLT_PIon.py realData=False globalTag=@ inputFiles=@ : FAILED - time: date Thu Jul 27 00:49:53 2017-date Thu Jul 27 00:49:09 2017 s - exit: 21504
cmsDriver.py RelVal -s HLT:PIon,RAW2DIGI,L1Reco,RECO --mc --scenario=pp -n 10 --conditions auto:run2_mc_PIon --relval 9000,50 --datatier "RAW-HLT-RECO" --eventcontent FEVTDEBUGHLT --customise=HLTrigger/Configuration/CustomConfigs.L1THLT --era Run2_2017 --processName=HLTRECO --filein file:RelVal_Raw_PIon_MC.root --fileout file:RelVal_Raw_PIon_MC_HLT_RECO.root : FAILED - time: date Thu Jul 27 00:49:53 2017-date Thu Jul 27 00:49:09 2017 s - exit: 21504
cmsDriver.py TTbar_Tauola_13TeV_TuneCUETP8M1_cfi -s GEN,SIM,DIGI,L1,DIGI2RAW --mc --scenario=pp -n 10 --conditions auto:run2_mc_PRef --relval 9000,50 --datatier "GEN-SIM-RAW" --eventcontent RAWSIM --customise=HLTrigger/Configuration/CustomConfigs.L1T --era Run2_2017 --fileout file:RelVal_Raw_PRef_MC.root : FAILED - time: date Thu Jul 27 00:50:04 2017-date Thu Jul 27 00:49:14 2017 s - exit: 18688
cmsRun /cvmfs/cms-ib.cern.ch/nweek-02482/slc6_amd64_gcc630/cms/cmssw-patch/CMSSW_9_3_X_2017-07-26-1100/src/HLTrigger/Configuration/test/OnLine_HLT_PRef.py realData=False globalTag=@ inputFiles=@ : FAILED - time: date Thu Jul 27 00:50:04 2017-date Thu Jul 27 00:49:14 2017 s - exit: 21504
cmsDriver.py RelVal -s HLT:PRef,RAW2DIGI,L1Reco,RECO --mc --scenario=pp -n 10 --conditions auto:run2_mc_PRef --relval 9000,50 --datatier "RAW-HLT-RECO" --eventcontent FEVTDEBUGHLT --customise=HLTrigger/Configuration/CustomConfigs.L1THLT --era Run2_2017 --processName=HLTRECO --filein file:RelVal_Raw_PRef_MC.root --fileout file:RelVal_Raw_PRef_MC_HLT_RECO.root : FAILED - time: date Thu Jul 27 00:50:04 2017-date Thu Jul 27 00:49:14 2017 s - exit: 21504
cmsDriver.py TTbar_13TeV_TuneCUETP8M1_cfi --conditions auto:run2_mc --fast -n 100 --eventcontent AODSIM,DQM --relval 100000,1000 -s GEN,SIM,RECOBEFMIX,DIGI:pdigi_valid,L1,DIGI2RAW,L1Reco,RECO,EI,VALIDATION --customise=HLTrigger/Configuration/CustomConfigs.L1THLT --datatier GEN-SIM-DIGI-RECO,DQMIO --beamspot NominalCollision2015 --era Run2_2016 : FAILED - time: date Thu Jul 27 00:50:02 2017-date Thu Jul 27 00:49:16 2017 s - exit: 18688
cmsDriver.py RelVal -s L1REPACK:Full --data --scenario=pp -n 10 --conditions auto:run2_hlt_PIon --relval 9000,50 --datatier "RAW" --customise=HLTrigger/Configuration/CustomConfigs.L1T --era Run2_2017 --eventcontent RAW --fileout file:RelVal_Raw_PIon_DATA.root --filein /store/data/Run2017A/HLTPhysics4/RAW/v1/000/295/606/00000/36DE5E0A-3645-E711-8FA1-02163E01A43B.root : FAILED - time: date Thu Jul 27 00:50:04 2017-date Thu Jul 27 00:49:18 2017 s - exit: 18688
cmsRun /cvmfs/cms-ib.cern.ch/nweek-02482/slc6_amd64_gcc630/cms/cmssw-patch/CMSSW_9_3_X_2017-07-26-1100/src/HLTrigger/Configuration/test/OnLine_HLT_PIon.py realData=True globalTag=@ inputFiles=@ : FAILED - time: date Thu Jul 27 00:50:04 2017-date Thu Jul 27 00:49:18 2017 s - exit: 21504
cmsDriver.py RelVal -s HLT:PIon,RAW2DIGI,L1Reco,RECO --data --scenario=pp -n 10 --conditions auto:run2_data_PIon --relval 9000,50 --datatier "RAW-HLT-RECO" --eventcontent FEVTDEBUGHLT --customise=HLTrigger/Configuration/CustomConfigs.L1THLT --era Run2_2017 --processName=HLTRECO --filein file:RelVal_Raw_PIon_DATA.root --fileout file:RelVal_Raw_PIon_DATA_HLT_RECO.root : FAILED - time: date Thu Jul 27 00:50:04 2017-date Thu Jul 27 00:49:18 2017 s - exit: 21504
cmsDriver.py TTbar_Tauola_13TeV_TuneCUETP8M1_cfi -s GEN,SIM,DIGI,L1,DIGI2RAW --mc --scenario=HeavyIons -n 10 --conditions auto:run2_mc_HIon --relval 9000,50 --datatier "GEN-SIM-RAW" --eventcontent RAWSIM --customise=HLTrigger/Configuration/CustomConfigs.L1T --era Run2_2016,Run2_HI --fileout file:RelVal_Raw_HIon_MC.root : FAILED - time: date Thu Jul 27 00:50:13 2017-date Thu Jul 27 00:49:25 2017 s - exit: 18688
cmsRun /cvmfs/cms-ib.cern.ch/nweek-02482/slc6_amd64_gcc630/cms/cmssw-patch/CMSSW_9_3_X_2017-07-26-1100/src/HLTrigger/Configuration/test/OnLine_HLT_HIon.py realData=False globalTag=@ inputFiles=@ : FAILED - time: date Thu Jul 27 00:50:13 2017-date Thu Jul 27 00:49:25 2017 s - exit: 21504
cmsDriver.py RelVal -s HLT:HIon,RAW2DIGI,L1Reco,RECO --mc --scenario=HeavyIons -n 10 --conditions auto:run2_mc_HIon --relval 9000,50 --datatier "RAW-HLT-RECO" --eventcontent FEVTDEBUGHLT --customise=HLTrigger/Configuration/CustomConfigs.L1THLT --era Run2_2016,Run2_HI --processName=HLTRECO --filein file:RelVal_Raw_HIon_MC.root --fileout file:RelVal_Raw_HIon_MC_HLT_RECO.root : FAILED - time: date Thu Jul 27 00:50:13 2017-date Thu Jul 27 00:49:25 2017 s - exit: 21504
cmsDriver.py TTbar_Tauola_13TeV_TuneCUETP8M1_cfi -s GEN,SIM,DIGI,L1,DIGI2RAW --mc --scenario=pp -n 10 --conditions auto:run2_mc_Fake2 --relval 9000,50 --datatier "GEN-SIM-RAW" --eventcontent RAWSIM --customise=HLTrigger/Configuration/CustomConfigs.L1T --era Run2_2016 --fileout file:RelVal_Raw_Fake2_MC.root : FAILED - time: date Thu Jul 27 00:50:12 2017-date Thu Jul 27 00:49:27 2017 s - exit: 18688
cmsRun /cvmfs/cms-ib.cern.ch/nweek-02482/slc6_amd64_gcc630/cms/cmssw-patch/CMSSW_9_3_X_2017-07-26-1100/src/HLTrigger/Configuration/test/OnLine_HLT_Fake2.py realData=False globalTag=@ inputFiles=@ : FAILED - time: date Thu Jul 27 00:50:12 2017-date Thu Jul 27 00:49:27 2017 s - exit: 21504
cmsDriver.py RelVal -s HLT:Fake2,RAW2DIGI,L1Reco,RECO --mc --scenario=pp -n 10 --conditions auto:run2_mc_Fake2 --relval 9000,50 --datatier "RAW-HLT-RECO" --eventcontent FEVTDEBUGHLT --customise=HLTrigger/Configuration/CustomConfigs.L1THLT --era Run2_2016 --processName=HLTRECO --filein file:RelVal_Raw_Fake2_MC.root --fileout file:RelVal_Raw_Fake2_MC_HLT_RECO.root : FAILED - time: date Thu Jul 27 00:50:12 2017-date Thu Jul 27 00:49:27 2017 s - exit: 21504
cmsDriver.py RelVal -s L1REPACK:Full --data --scenario=pp -n 10 --conditions auto:run2_hlt_GRun --relval 9000,50 --datatier "RAW" --eventcontent RAW --customise=HLTrigger/Configuration/CustomConfigs.L1T --era Run2_2017 --fileout file:RelVal_Raw_GRun_DATA.root --filein /store/data/Run2017A/HLTPhysics4/RAW/v1/000/295/606/00000/36DE5E0A-3645-E711-8FA1-02163E01A43B.root : FAILED - time: date Thu Jul 27 00:51:08 2017-date Thu Jul 27 00:49:38 2017 s - exit: 18688
cmsRun /cvmfs/cms-ib.cern.ch/nweek-02482/slc6_amd64_gcc630/cms/cmssw-patch/CMSSW_9_3_X_2017-07-26-1100/src/HLTrigger/Configuration/test/OnLine_HLT_GRun.py realData=True globalTag=@ inputFiles=@ : FAILED - time: date Thu Jul 27 00:51:08 2017-date Thu Jul 27 00:49:38 2017 s - exit: 21504
cmsDriver.py RelVal -s HLT:GRun,RAW2DIGI,L1Reco,RECO --data --scenario=pp -n 10 --conditions auto:run2_data_GRun --relval 9000,50 --datatier "RAW-HLT-RECO" --eventcontent FEVTDEBUGHLT --customise=HLTrigger/Configuration/CustomConfigs.L1THLT --era Run2_2017 --processName=HLTRECO --filein file:RelVal_Raw_GRun_DATA.root --fileout file:RelVal_Raw_GRun_DATA_HLT_RECO.root : FAILED - time: date Thu Jul 27 00:51:08 2017-date Thu Jul 27 00:49:38 2017 s - exit: 21504
cmsDriver.py RelVal -s L1REPACK:Full --data --scenario=pp -n 10 --conditions auto:run2_hlt_2e34_v2 --relval 9000,50 --datatier "RAW" --eventcontent RAW --customise=HLTrigger/Configuration/CustomConfigs.L1T --era Run2_2017 --fileout file:RelVal_Raw_2e34_v2_DATA.root --filein /store/data/Run2017A/HLTPhysics4/RAW/v1/000/295/606/00000/36DE5E0A-3645-E711-8FA1-02163E01A43B.root : FAILED - time: date Thu Jul 27 00:51:10 2017-date Thu Jul 27 00:49:42 2017 s - exit: 18688
cmsRun /cvmfs/cms-ib.cern.ch/nweek-02482/slc6_amd64_gcc630/cms/cmssw-patch/CMSSW_9_3_X_2017-07-26-1100/src/HLTrigger/Configuration/test/OnLine_HLT_2e34_v2.py realData=True globalTag=@ inputFiles=@ : FAILED - time: date Thu Jul 27 00:51:10 2017-date Thu Jul 27 00:49:42 2017 s - exit: 21504
cmsDriver.py RelVal -s HLT:2e34_v2,RAW2DIGI,L1Reco,RECO --data --scenario=pp -n 10 --conditions auto:run2_data_2e34_v2 --relval 9000,50 --datatier "RAW-HLT-RECO" --eventcontent FEVTDEBUGHLT --customise=HLTrigger/Configuration/CustomConfigs.L1THLT --era Run2_2017 --processName=HLTRECO --filein file:RelVal_Raw_2e34_v2_DATA.root --fileout file:RelVal_Raw_2e34_v2_DATA_HLT_RECO.root : FAILED - time: date Thu Jul 27 00:51:10 2017-date Thu Jul 27 00:49:42 2017 s - exit: 21504

The following merge commits were also included on top of IB + this PR after doing git cms-merge-topic:
b2079c1
You can see more details here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-19928/21795/git-log-recent-commits
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-19928/21795/git-merge-result

cmsbuild · 2017-07-26T22:56:44Z

Comparison not run due to runTheMatrix errors (RelVals and Igprof tests were also skipped)

abrinke1 · 2017-07-27T07:06:28Z

@arunhep @davidlange6 @kkotov @rekovic
Do these errors mean anything to you? Is there an exit code catalogue somewhere? Also I see that other merge commits were included on top of mine. Is there any way to know which merge commits were responsible for the errors?
Thanks much,
Andrew

kkotov · 2017-07-27T08:32:50Z

@abrinke1 , The error you see here:

https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-19928/21795/runTheMatrix-results/20434.0_TTbar_14TeV+TTbar_14TeV_TuneCUETP8M1_2023D19_GenSimHLBeamSpotFull14+DigiFullTrigger_2023D19+RecoFullGlobal_2023D19+HARVESTFullGlobal_2023D19/step2_TTbar_14TeV+TTbar_14TeV_TuneCUETP8M1_2023D19_GenSimHLBeamSpotFull14+DigiFullTrigger_2023D19+RecoFullGlobal_2023D19+HARVESTFullGlobal_2023D19.log

is generated in this line:

https://github.com/abrinke1/cmssw/blob/EMTF_PR_2017_93X_part4/L1Trigger/L1TMuonEndCap/plugins/L1TMuonEndCapParamsESProducer.cc#L43

and results from the first literal in "FirmwareVersion" being capitalized despite it is lower-case in the config:

https://github.com/abrinke1/cmssw/blob/EMTF_PR_2017_93X_part4/L1Trigger/L1TMuonEndCap/python/fakeEmtfParams_cff.py#L14

cmsbuild · 2017-07-27T08:58:04Z

Pull request #19928 was updated. @ghellwig, @arunhep, @cerminar, @cmsbuild, @rekovic, @franzoni, @ggovi, @davidlange6, @mulhearn, @lpernie can you please check and sign again.

abrinke1 · 2017-07-27T08:58:35Z

@kkotov Thanks! I hope this commit will fix it - let me know if you see anything fishy.
abrinke1@3a2a3ad

…me change

…to EMTF_PR_2017_93X_part4

cmsbuild · 2017-07-27T13:55:30Z

Pull request #19928 was updated. @ghellwig, @arunhep, @cerminar, @cmsbuild, @rekovic, @franzoni, @ggovi, @davidlange6, @mulhearn, @lpernie can you please check and sign again.

abrinke1 · 2017-07-27T13:55:40Z

Just pushed a little more clean-up ... @arunhep @davidlange6 can you trigger the cmsbuild tests again?

Thanks,
Andrew

arunhep · 2017-07-27T15:28:19Z

@cmsbuild please test

cmsbuild · 2017-07-27T15:28:35Z

The tests are being triggered in jenkins.
https://cmssdt.cern.ch/jenkins/job/ib-any-integration/21832/console Started: 2017/07/27 17:44

cmsbuild · 2017-07-27T16:28:10Z

-1

Tested at: 34dc38a

The following merge commits were also included on top of IB + this PR after doing git cms-merge-topic:
34dc38a
5072a68
You can see more details here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-19928/21832/git-log-recent-commits
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-19928/21832/git-merge-result

You can see the results of the tests here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-19928/21832/summary.html

I found follow errors while testing this PR

Failed tests: RelVals AddOn

RelVals:

When I ran the RelVals I found an error in the following worklfows:
4.53 step2

runTheMatrix-results/4.53_RunPhoton2012B+RunPhoton2012B+HLTD+RECODR1reHLT+HARVESTDR1reHLT/step2_RunPhoton2012B+RunPhoton2012B+HLTD+RECODR1reHLT+HARVESTDR1reHLT.log

136.731 step2

runTheMatrix-results/136.731_RunSinglePh2016B+RunSinglePh2016B+HLTDR2_2016+RECODR2_2016reHLT_skimSinglePh_HIPM+HARVESTDR2/step2_RunSinglePh2016B+RunSinglePh2016B+HLTDR2_2016+RECODR2_2016reHLT_skimSinglePh_HIPM+HARVESTDR2.log

4.22 step2

runTheMatrix-results/4.22_RunCosmics2011A+RunCosmics2011A+RECOCOSD+ALCACOSD+SKIMCOSD+HARVESTDC/step2_RunCosmics2011A+RunCosmics2011A+RECOCOSD+ALCACOSD+SKIMCOSD+HARVESTDC.log

140.53 step2

runTheMatrix-results/140.53_RunHI2011+RunHI2011+RECOHID11+HARVESTDHI/step2_RunHI2011+RunHI2011+RECOHID11+HARVESTDHI.log

136.7611 step2

runTheMatrix-results/136.7611_RunJetHT2016E_reminiaod+RunJetHT2016E_reminiaod+REMINIAOD_data2016+HARVESTDR2_REMINIAOD_data2016/step2_RunJetHT2016E_reminiaod+RunJetHT2016E_reminiaod+REMINIAOD_data2016+HARVESTDR2_REMINIAOD_data2016.log

1000.0 step2

runTheMatrix-results/1000.0_RunMinBias2011A+RunMinBias2011A+TIER0+SKIMD+HARVESTDfst2+ALCASPLIT/step2_RunMinBias2011A+RunMinBias2011A+TIER0+SKIMD+HARVESTDfst2+ALCASPLIT.log

1001.0 step2

runTheMatrix-results/1001.0_RunMinBias2011A+RunMinBias2011A+TIER0EXP+ALCAEXP+ALCAHARVD1+ALCAHARVD2+ALCAHARVD3+ALCAHARVD4+ALCAHARVD5/step2_RunMinBias2011A+RunMinBias2011A+TIER0EXP+ALCAEXP+ALCAHARVD1+ALCAHARVD2+ALCAHARVD3+ALCAHARVD4+ALCAHARVD5.log

1003.0 step2

runTheMatrix-results/1003.0_RunMinBias2012A+RunMinBias2012A+RECODDQM+HARVESTDDQM/step2_RunMinBias2012A+RunMinBias2012A+RECODDQM+HARVESTDDQM.log

10024.0 step1

runTheMatrix-results/10024.0_TTbar_13+TTbar_13TeV_TuneCUETP8M1_2017_GenSimFull+DigiFull_2017+RecoFull_2017+ALCAFull_2017+HARVESTFull_2017/step1_TTbar_13+TTbar_13TeV_TuneCUETP8M1_2017_GenSimFull+DigiFull_2017+RecoFull_2017+ALCAFull_2017+HARVESTFull_2017.log

10042.0 step1

runTheMatrix-results/10042.0_ZMM_13+ZMM_13TeV_TuneCUETP8M1_2017_GenSimFull+DigiFull_2017+RecoFull_2017+ALCAFull_2017+HARVESTFull_2017/step1_ZMM_13+ZMM_13TeV_TuneCUETP8M1_2017_GenSimFull+DigiFull_2017+RecoFull_2017+ALCAFull_2017+HARVESTFull_2017.log

10824.0 step1

runTheMatrix-results/10824.0_TTbar_13+TTbar_13TeV_TuneCUETP8M1_2018_GenSimFull+DigiFull_2018+RecoFull_2018+ALCAFull_2018+HARVESTFull_2018/step1_TTbar_13+TTbar_13TeV_TuneCUETP8M1_2018_GenSimFull+DigiFull_2018+RecoFull_2018+ALCAFull_2018+HARVESTFull_2018.log

20034.0 step1

runTheMatrix-results/20034.0_TTbar_14TeV+TTbar_14TeV_TuneCUETP8M1_2023D17_GenSimHLBeamSpotFull14+DigiFullTrigger_2023D17+RecoFullGlobal_2023D17+HARVESTFullGlobal_2023D17/step1_TTbar_14TeV+TTbar_14TeV_TuneCUETP8M1_2023D17_GenSimHLBeamSpotFull14+DigiFullTrigger_2023D17+RecoFullGlobal_2023D17+HARVESTFullGlobal_2023D17.log

20434.0 step1

runTheMatrix-results/20434.0_TTbar_14TeV+TTbar_14TeV_TuneCUETP8M1_2023D19_GenSimHLBeamSpotFull14+DigiFullTrigger_2023D19+RecoFullGlobal_2023D19+HARVESTFullGlobal_2023D19/step1_TTbar_14TeV+TTbar_14TeV_TuneCUETP8M1_2023D19_GenSimHLBeamSpotFull14+DigiFullTrigger_2023D19+RecoFullGlobal_2023D19+HARVESTFullGlobal_2023D19.log

AddOn:

I found errors in the following addon tests:

cmsDriver.py RelVal -s L1REPACK:Full --data --scenario=pp -n 10 --conditions auto:run2_hlt_Fake2 --relval 9000,50 --datatier "RAW" --eventcontent RAW --customise=HLTrigger/Configuration/CustomConfigs.L1T --era Run2_2016 --fileout file:RelVal_Raw_Fake2_DATA.root --filein /store/data/Run2015D/MuonEG/RAW/v1/000/256/677/00000/80950A90-745D-E511-92FD-02163E011C5D.root : FAILED - time: date Thu Jul 27 18:15:20 2017-date Thu Jul 27 18:14:45 2017 s - exit: 16640
cmsRun /cvmfs/cms-ib.cern.ch/nweek-02482/slc6_amd64_gcc630/cms/cmssw-patch/CMSSW_9_3_X_2017-07-27-1100/src/HLTrigger/Configuration/test/OnLine_HLT_Fake2.py realData=True globalTag=@ inputFiles=@ : FAILED - time: date Thu Jul 27 18:15:20 2017-date Thu Jul 27 18:14:45 2017 s - exit: 16640
cmsDriver.py RelVal -s HLT:Fake2,RAW2DIGI,L1Reco,RECO --data --scenario=pp -n 10 --conditions auto:run2_data_Fake2 --relval 9000,50 --datatier "RAW-HLT-RECO" --eventcontent FEVTDEBUGHLT --customise=HLTrigger/Configuration/CustomConfigs.L1THLT --era Run2_2016 --processName=HLTRECO --filein file:RelVal_Raw_Fake2_DATA.root --fileout file:RelVal_Raw_Fake2_DATA_HLT_RECO.root : FAILED - time: date Thu Jul 27 18:15:20 2017-date Thu Jul 27 18:14:45 2017 s - exit: 16640
cmsDriver.py TTbar_Tauola_13TeV_TuneCUETP8M1_cfi -s GEN,SIM,DIGI,L1,DIGI2RAW --mc --scenario=pp -n 10 --conditions auto:run2_mc_2e34_v2 --relval 9000,50 --datatier "GEN-SIM-RAW" --eventcontent RAWSIM --customise=HLTrigger/Configuration/CustomConfigs.L1T --era Run2_2017 --fileout file:RelVal_Raw_2e34_v2_MC.root : FAILED - time: date Thu Jul 27 18:15:53 2017-date Thu Jul 27 18:14:49 2017 s - exit: 16640
cmsRun /cvmfs/cms-ib.cern.ch/nweek-02482/slc6_amd64_gcc630/cms/cmssw-patch/CMSSW_9_3_X_2017-07-27-1100/src/HLTrigger/Configuration/test/OnLine_HLT_2e34_v2.py realData=False globalTag=@ inputFiles=@ : FAILED - time: date Thu Jul 27 18:15:53 2017-date Thu Jul 27 18:14:49 2017 s - exit: 16640
cmsDriver.py RelVal -s HLT:2e34_v2,RAW2DIGI,L1Reco,RECO --mc --scenario=pp -n 10 --conditions auto:run2_mc_2e34_v2 --relval 9000,50 --datatier "RAW-HLT-RECO" --eventcontent FEVTDEBUGHLT --customise=HLTrigger/Configuration/CustomConfigs.L1THLT --era Run2_2017 --processName=HLTRECO --filein file:RelVal_Raw_2e34_v2_MC.root --fileout file:RelVal_Raw_2e34_v2_MC_HLT_RECO.root : FAILED - time: date Thu Jul 27 18:15:53 2017-date Thu Jul 27 18:14:49 2017 s - exit: 16640
cmsDriver.py RelVal -s L1REPACK:Full --data --scenario=pp -n 10 --conditions auto:run2_hlt_PRef --relval 9000,50 --datatier "RAW" --customise=HLTrigger/Configuration/CustomConfigs.L1T --era Run2_2017 --eventcontent RAW --fileout file:RelVal_Raw_PRef_DATA.root --filein /store/data/Run2017A/HLTPhysics4/RAW/v1/000/295/606/00000/36DE5E0A-3645-E711-8FA1-02163E01A43B.root : FAILED - time: date Thu Jul 27 18:15:34 2017-date Thu Jul 27 18:14:53 2017 s - exit: 16640
cmsRun /cvmfs/cms-ib.cern.ch/nweek-02482/slc6_amd64_gcc630/cms/cmssw-patch/CMSSW_9_3_X_2017-07-27-1100/src/HLTrigger/Configuration/test/OnLine_HLT_PRef.py realData=True globalTag=@ inputFiles=@ : FAILED - time: date Thu Jul 27 18:15:34 2017-date Thu Jul 27 18:14:53 2017 s - exit: 16640
cmsDriver.py RelVal -s HLT:PRef,RAW2DIGI,L1Reco,RECO --data --scenario=pp -n 10 --conditions auto:run2_data_PRef --relval 9000,50 --datatier "RAW-HLT-RECO" --eventcontent FEVTDEBUGHLT --customise=HLTrigger/Configuration/CustomConfigs.L1THLT --era Run2_2017 --processName=HLTRECO --filein file:RelVal_Raw_PRef_DATA.root --fileout file:RelVal_Raw_PRef_DATA_HLT_RECO.root : FAILED - time: date Thu Jul 27 18:15:34 2017-date Thu Jul 27 18:14:53 2017 s - exit: 16640
cmsDriver.py RelVal -s L1REPACK:Full2015Data --data --scenario=HeavyIons -n 10 --conditions auto:run2_hlt_HIon --relval 9000,50 --datatier "RAW" --eventcontent RAW --customise=HLTrigger/Configuration/CustomConfigs.L1T --era Run2_2016,Run2_HI --fileout file:RelVal_Raw_HIon_DATA.root --filein /store/hidata/HIRun2015/HIHardProbes/RAW-RECO/HighPtJet-PromptReco-v1/000/263/689/00000/1802CD9A-DDB8-E511-9CF9-02163E0138CA.root : FAILED - time: date Thu Jul 27 18:15:29 2017-date Thu Jul 27 18:14:54 2017 s - exit: 16640
cmsRun /cvmfs/cms-ib.cern.ch/nweek-02482/slc6_amd64_gcc630/cms/cmssw-patch/CMSSW_9_3_X_2017-07-27-1100/src/HLTrigger/Configuration/test/OnLine_HLT_HIon.py realData=True globalTag=@ inputFiles=@ : FAILED - time: date Thu Jul 27 18:15:29 2017-date Thu Jul 27 18:14:54 2017 s - exit: 16640
cmsDriver.py RelVal -s HLT:HIon,RAW2DIGI,L1Reco,RECO --data --scenario=HeavyIons -n 10 --conditions auto:run2_data_HIon --relval 9000,50 --datatier "RAW-HLT-RECO" --eventcontent FEVTDEBUGHLT --customise=HLTrigger/Configuration/CustomConfigs.L1THLT --era Run2_2016,Run2_HI --processName=HLTRECO --filein file:RelVal_Raw_HIon_DATA.root --fileout file:RelVal_Raw_HIon_DATA_HLT_RECO.root : FAILED - time: date Thu Jul 27 18:15:29 2017-date Thu Jul 27 18:14:54 2017 s - exit: 16640
cmsDriver.py TTbar_Tauola_13TeV_TuneCUETP8M1_cfi -s GEN,SIM,DIGI,L1,DIGI2RAW --mc --scenario=pp -n 10 --conditions auto:run2_mc_GRun --relval 9000,50 --datatier "GEN-SIM-RAW" --eventcontent RAWSIM --customise=HLTrigger/Configuration/CustomConfigs.L1T --era Run2_2017 --fileout file:RelVal_Raw_GRun_MC.root : FAILED - time: date Thu Jul 27 18:16:04 2017-date Thu Jul 27 18:14:58 2017 s - exit: 16640
cmsRun /cvmfs/cms-ib.cern.ch/nweek-02482/slc6_amd64_gcc630/cms/cmssw-patch/CMSSW_9_3_X_2017-07-27-1100/src/HLTrigger/Configuration/test/OnLine_HLT_GRun.py realData=False globalTag=@ inputFiles=@ : FAILED - time: date Thu Jul 27 18:16:04 2017-date Thu Jul 27 18:14:58 2017 s - exit: 16640
cmsDriver.py RelVal -s HLT:GRun,RAW2DIGI,L1Reco,RECO --mc --scenario=pp -n 10 --conditions auto:run2_mc_GRun --relval 9000,50 --datatier "RAW-HLT-RECO" --eventcontent FEVTDEBUGHLT --customise=HLTrigger/Configuration/CustomConfigs.L1THLT --era Run2_2017 --processName=HLTRECO --filein file:RelVal_Raw_GRun_MC.root --fileout file:RelVal_Raw_GRun_MC_HLT_RECO.root : FAILED - time: date Thu Jul 27 18:16:04 2017-date Thu Jul 27 18:14:58 2017 s - exit: 16640
cmsDriver.py TTbar_Tauola_13TeV_TuneCUETP8M1_cfi -s GEN,SIM,DIGI,L1,DIGI2RAW --mc --scenario=pp -n 10 --conditions auto:run2_mc_PIon --relval 9000,50 --datatier "GEN-SIM-RAW" --eventcontent RAWSIM --customise=HLTrigger/Configuration/CustomConfigs.L1T --era Run2_2017 --fileout file:RelVal_Raw_PIon_MC.root : FAILED - time: date Thu Jul 27 18:16:06 2017-date Thu Jul 27 18:15:25 2017 s - exit: 16640
cmsRun /cvmfs/cms-ib.cern.ch/nweek-02482/slc6_amd64_gcc630/cms/cmssw-patch/CMSSW_9_3_X_2017-07-27-1100/src/HLTrigger/Configuration/test/OnLine_HLT_PIon.py realData=False globalTag=@ inputFiles=@ : FAILED - time: date Thu Jul 27 18:16:06 2017-date Thu Jul 27 18:15:25 2017 s - exit: 16640
cmsDriver.py RelVal -s HLT:PIon,RAW2DIGI,L1Reco,RECO --mc --scenario=pp -n 10 --conditions auto:run2_mc_PIon --relval 9000,50 --datatier "RAW-HLT-RECO" --eventcontent FEVTDEBUGHLT --customise=HLTrigger/Configuration/CustomConfigs.L1THLT --era Run2_2017 --processName=HLTRECO --filein file:RelVal_Raw_PIon_MC.root --fileout file:RelVal_Raw_PIon_MC_HLT_RECO.root : FAILED - time: date Thu Jul 27 18:16:06 2017-date Thu Jul 27 18:15:25 2017 s - exit: 16640
cmsDriver.py TTbar_Tauola_13TeV_TuneCUETP8M1_cfi -s GEN,SIM,DIGI,L1,DIGI2RAW --mc --scenario=pp -n 10 --conditions auto:run2_mc_PRef --relval 9000,50 --datatier "GEN-SIM-RAW" --eventcontent RAWSIM --customise=HLTrigger/Configuration/CustomConfigs.L1T --era Run2_2017 --fileout file:RelVal_Raw_PRef_MC.root : FAILED - time: date Thu Jul 27 18:16:25 2017-date Thu Jul 27 18:15:36 2017 s - exit: 16640
cmsRun /cvmfs/cms-ib.cern.ch/nweek-02482/slc6_amd64_gcc630/cms/cmssw-patch/CMSSW_9_3_X_2017-07-27-1100/src/HLTrigger/Configuration/test/OnLine_HLT_PRef.py realData=False globalTag=@ inputFiles=@ : FAILED - time: date Thu Jul 27 18:16:25 2017-date Thu Jul 27 18:15:36 2017 s - exit: 16640
cmsDriver.py RelVal -s HLT:PRef,RAW2DIGI,L1Reco,RECO --mc --scenario=pp -n 10 --conditions auto:run2_mc_PRef --relval 9000,50 --datatier "RAW-HLT-RECO" --eventcontent FEVTDEBUGHLT --customise=HLTrigger/Configuration/CustomConfigs.L1THLT --era Run2_2017 --processName=HLTRECO --filein file:RelVal_Raw_PRef_MC.root --fileout file:RelVal_Raw_PRef_MC_HLT_RECO.root : FAILED - time: date Thu Jul 27 18:16:25 2017-date Thu Jul 27 18:15:36 2017 s - exit: 16640
cmsDriver.py RelVal -s L1REPACK:Full --data --scenario=pp -n 10 --conditions auto:run2_hlt_PIon --relval 9000,50 --datatier "RAW" --customise=HLTrigger/Configuration/CustomConfigs.L1T --era Run2_2017 --eventcontent RAW --fileout file:RelVal_Raw_PIon_DATA.root --filein /store/data/Run2017A/HLTPhysics4/RAW/v1/000/295/606/00000/36DE5E0A-3645-E711-8FA1-02163E01A43B.root : FAILED - time: date Thu Jul 27 18:16:31 2017-date Thu Jul 27 18:15:44 2017 s - exit: 16640
cmsRun /cvmfs/cms-ib.cern.ch/nweek-02482/slc6_amd64_gcc630/cms/cmssw-patch/CMSSW_9_3_X_2017-07-27-1100/src/HLTrigger/Configuration/test/OnLine_HLT_PIon.py realData=True globalTag=@ inputFiles=@ : FAILED - time: date Thu Jul 27 18:16:31 2017-date Thu Jul 27 18:15:44 2017 s - exit: 16640
cmsDriver.py RelVal -s HLT:PIon,RAW2DIGI,L1Reco,RECO --data --scenario=pp -n 10 --conditions auto:run2_data_PIon --relval 9000,50 --datatier "RAW-HLT-RECO" --eventcontent FEVTDEBUGHLT --customise=HLTrigger/Configuration/CustomConfigs.L1THLT --era Run2_2017 --processName=HLTRECO --filein file:RelVal_Raw_PIon_DATA.root --fileout file:RelVal_Raw_PIon_DATA_HLT_RECO.root : FAILED - time: date Thu Jul 27 18:16:31 2017-date Thu Jul 27 18:15:44 2017 s - exit: 16640
cmsDriver.py RelVal -s L1REPACK:GT1 --data --scenario=pp -n 10 --conditions auto:run1_hlt_Fake --relval 9000,50 --datatier "RAW" --eventcontent RAW --customise=HLTrigger/Configuration/CustomConfigs.L1T --fileout file:RelVal_Raw_Fake_DATA.root --filein /store/data/Run2012A/MuEG/RAW/v1/000/191/718/14932935-E289-E111-830C-5404A6388697.root : FAILED - time: date Thu Jul 27 18:18:45 2017-date Thu Jul 27 18:16:52 2017 s - exit: 16640
cmsRun /cvmfs/cms-ib.cern.ch/nweek-02482/slc6_amd64_gcc630/cms/cmssw-patch/CMSSW_9_3_X_2017-07-27-1100/src/HLTrigger/Configuration/test/OnLine_HLT_Fake.py realData=True globalTag=@ inputFiles=@ : FAILED - time: date Thu Jul 27 18:18:45 2017-date Thu Jul 27 18:16:52 2017 s - exit: 16640
cmsDriver.py RelVal -s HLT:Fake,RAW2DIGI,L1Reco,RECO --data --scenario=pp -n 10 --conditions auto:run1_data_Fake --relval 9000,50 --datatier "RAW-HLT-RECO" --eventcontent FEVTDEBUGHLT --customise=HLTrigger/Configuration/CustomConfigs.L1THLT --processName=HLTRECO --filein file:RelVal_Raw_Fake_DATA.root --fileout file:RelVal_Raw_Fake_DATA_HLT_RECO.root : FAILED - time: date Thu Jul 27 18:18:45 2017-date Thu Jul 27 18:16:52 2017 s - exit: 16640
cmsDriver.py RelVal -s L1REPACK:Full --data --scenario=pp -n 10 --conditions auto:run2_hlt_GRun --relval 9000,50 --datatier "RAW" --eventcontent RAW --customise=HLTrigger/Configuration/CustomConfigs.L1T --era Run2_2017 --fileout file:RelVal_Raw_GRun_DATA.root --filein /store/data/Run2017A/HLTPhysics4/RAW/v1/000/295/606/00000/36DE5E0A-3645-E711-8FA1-02163E01A43B.root : FAILED - time: date Thu Jul 27 18:21:08 2017-date Thu Jul 27 18:17:27 2017 s - exit: 16640
cmsRun /cvmfs/cms-ib.cern.ch/nweek-02482/slc6_amd64_gcc630/cms/cmssw-patch/CMSSW_9_3_X_2017-07-27-1100/src/HLTrigger/Configuration/test/OnLine_HLT_GRun.py realData=True globalTag=@ inputFiles=@ : FAILED - time: date Thu Jul 27 18:21:08 2017-date Thu Jul 27 18:17:27 2017 s - exit: 16640
cmsDriver.py RelVal -s HLT:GRun,RAW2DIGI,L1Reco,RECO --data --scenario=pp -n 10 --conditions auto:run2_data_GRun --relval 9000,50 --datatier "RAW-HLT-RECO" --eventcontent FEVTDEBUGHLT --customise=HLTrigger/Configuration/CustomConfigs.L1THLT --era Run2_2017 --processName=HLTRECO --filein file:RelVal_Raw_GRun_DATA.root --fileout file:RelVal_Raw_GRun_DATA_HLT_RECO.root : FAILED - time: date Thu Jul 27 18:21:08 2017-date Thu Jul 27 18:17:27 2017 s - exit: 16640
cmsDriver.py RelVal -s L1REPACK:GCTGT --data --scenario=pp -n 10 --conditions auto:run2_hlt_Fake1 --relval 9000,50 --datatier "RAW" --eventcontent RAW --customise=HLTrigger/Configuration/CustomConfigs.L1T --era Run2_25ns --fileout file:RelVal_Raw_Fake1_DATA.root --filein /store/data/Run2015D/MuonEG/RAW/v1/000/256/677/00000/80950A90-745D-E511-92FD-02163E011C5D.root : FAILED - time: date Thu Jul 27 18:21:09 2017-date Thu Jul 27 18:18:50 2017 s - exit: 16640
cmsRun /cvmfs/cms-ib.cern.ch/nweek-02482/slc6_amd64_gcc630/cms/cmssw-patch/CMSSW_9_3_X_2017-07-27-1100/src/HLTrigger/Configuration/test/OnLine_HLT_Fake1.py realData=True globalTag=@ inputFiles=@ : FAILED - time: date Thu Jul 27 18:21:09 2017-date Thu Jul 27 18:18:50 2017 s - exit: 16640
cmsDriver.py RelVal -s HLT:Fake1,RAW2DIGI,L1Reco,RECO --data --scenario=pp -n 10 --conditions auto:run2_data_Fake1 --relval 9000,50 --datatier "RAW-HLT-RECO" --eventcontent FEVTDEBUGHLT --customise=HLTrigger/Configuration/CustomConfigs.L1THLT --era Run2_25ns --processName=HLTRECO --filein file:RelVal_Raw_Fake1_DATA.root --fileout file:RelVal_Raw_Fake1_DATA_HLT_RECO.root : FAILED - time: date Thu Jul 27 18:21:09 2017-date Thu Jul 27 18:18:50 2017 s - exit: 16640
cmsDriver.py RelVal -s L1REPACK:Full --data --scenario=pp -n 10 --conditions auto:run2_hlt_2e34_v2 --relval 9000,50 --datatier "RAW" --eventcontent RAW --customise=HLTrigger/Configuration/CustomConfigs.L1T --era Run2_2017 --fileout file:RelVal_Raw_2e34_v2_DATA.root --filein /store/data/Run2017A/HLTPhysics4/RAW/v1/000/295/606/00000/36DE5E0A-3645-E711-8FA1-02163E01A43B.root : FAILED - time: date Thu Jul 27 18:22:06 2017-date Thu Jul 27 18:19:53 2017 s - exit: 16640
cmsRun /cvmfs/cms-ib.cern.ch/nweek-02482/slc6_amd64_gcc630/cms/cmssw-patch/CMSSW_9_3_X_2017-07-27-1100/src/HLTrigger/Configuration/test/OnLine_HLT_2e34_v2.py realData=True globalTag=@ inputFiles=@ : FAILED - time: date Thu Jul 27 18:22:06 2017-date Thu Jul 27 18:19:53 2017 s - exit: 16640
cmsDriver.py RelVal -s HLT:2e34_v2,RAW2DIGI,L1Reco,RECO --data --scenario=pp -n 10 --conditions auto:run2_data_2e34_v2 --relval 9000,50 --datatier "RAW-HLT-RECO" --eventcontent FEVTDEBUGHLT --customise=HLTrigger/Configuration/CustomConfigs.L1THLT --era Run2_2017 --processName=HLTRECO --filein file:RelVal_Raw_2e34_v2_DATA.root --fileout file:RelVal_Raw_2e34_v2_DATA_HLT_RECO.root : FAILED - time: date Thu Jul 27 18:22:06 2017-date Thu Jul 27 18:19:53 2017 s - exit: 16640

The following merge commits were also included on top of IB + this PR after doing git cms-merge-topic:
34dc38a
5072a68
You can see more details here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-19928/21832/git-log-recent-commits
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-19928/21832/git-merge-result

cmsbuild · 2017-07-27T16:28:13Z

Comparison not run due to runTheMatrix errors (RelVals and Igprof tests were also skipped)

abrinke1 · 2017-07-27T17:45:39Z

Hi all,

Turns out the previous bug @kkotov was not the only one - or maybe not even the bug causing the crash in the first place. @rekovic @arunhep @davidlange6 @ALL : is there a way I can get more detailed error messages, or re-run the failing sequence myself?

Thanks much,
Andrew

rekovic · 2017-07-28T13:13:34Z

@abrinke1 To run the workflow 136.731 locally, execut
runTheMatrix.py -l 136.731

rekovic · 2017-07-28T13:18:00Z

@abrinke1
Then, within the new direcoty, you can use the configuration file of step2, which is where the job fails, to
run any debug tools (ex. gdb, valgrind) with cmsRun.

kkotov · 2017-07-28T13:18:36Z

@abrinke1 , I am pretty ignorant for what concerns the "plugin-poisoned" concept (although, I could guess the idea behind). So far I was simply removing these files from the lib/ directory in my working area and launching the jobs again. Doing so I never observed any problems, but I could not see why these files are appearing in a first place in a rather trivial contexts (not to mention that I have a strong feeling this was not always a reproducible behavior as setting up a new working directory helped me to get around these errors sometimes). While fixing this problem in a local environment is easy, I have no idea on what to do during the unit tests. I'd give it another try hoping that it won't show up, but I hope someone more knowledgeable can comment here.
@recovic, running the matrix locally certainly helps to see most of the errors before testing the PR here. But it still won't help understanding what to do if these "plugin-poisoned" errors shows up again.

kkotov · 2017-07-28T13:22:24Z

@rekovic , btw. I'd bye you a beer if you show me the hint how to run gdb in lxplus environment. I once spent non-negligible amount of time to see how to make gdb to resolve shared object dependencies. It happens automatically everywhere else, but not on lxplus.

abrinke1 · 2017-07-31T09:28:24Z

@rekovic @arunhep @davidlange6 @ALL ,

The failing sequence that @kkotov was mentioning is below. Like he says, I have no idea why a poisoned plugin would appear or not appear - the code compiles fine. Does anyone have suggestions on what's going on, or how to fix it?

Thanks much,
Andrew

runTheMatrix.py -l 136.731
ERROR executing [description of process]

cd 136.731_RunSinglePh2016B+RunSinglePh2016B+HLTDR2_2016+RECODR2_2016reHLT_skimSinglePh_HIPM+HARVESTDR2

cmsDriver.py step2 --datatier FEVTDEBUGHLT --conditions auto:run2_hlt_relval -s L1REPACK:Full,HLT:@relval2016 --process reHLT --data --era Run2_2016 --eventcontent FEVTDEBUGHLT -n 100 --filein filelist:step1_dasquery.log --lumiToProcess step1_lumiRanges.log --fileout file:step2.root > step2_RunSinglePh2016B+RunSinglePh2016B+HLTDR2_2016+RECODR2_2016reHLT_skimSinglePh_HIPM+HARVESTDR2.log 2

Step: L1REPACK Spec: ['Full']
L1T INFO: L1REPACK:Full (intended for 2016 data) will unpack all L1T inputs, re-L1T INFO: L1REPACK:Full (intended for 2016 data) will unpack all L1T inputs, re-emulated (Stage-2), and pack uGT, uGMT, and Calo Stage-2 output.
----- Begin Fatal Exception 31-Jul-2017 11:20:13 CEST-----------------------
An exception of category 'PluginLibraryLoadError' occurred while
[0] Constructing the EventProcessor
[1] Constructing ESSource: class=PoolDBESSource label='GlobalTag'
Exception Message:
unable to load /afs/cern.ch/user/a/abrinke1/CentralPR/CMSSW_9_3_X_2017-07-25-2300/lib/slc6_amd64_gcc630/poisoned/plugin-poisoned-CondCoreL1TPlugins.so because /afs/cern.ch/user/a/abrinke1/CentralPR/CMSSW_9_3_X_2017-07-25-2300/lib/slc6_amd64_gcc630/poisoned/plugin-poisoned-CondCoreL1TPlugins.so: cannot open shared object file: No such file or directory
----- End Fatal Exception -------------------------------------------------

davidlange6 · 2017-07-31T09:32:36Z

are the condformats that this PR removes part of the global tag?

…

On Jul 31, 2017, at 11:28 AM, abrinke1 ***@***.***> wrote: @rekovic @arunhep @davidlange6 @ALL , The failing sequence that @kkotov was mentioning is below. Like he says, I have no idea why a poisoned plugin would appear or not appear - the code compiles fine. Does anyone have suggestions on what's going on, or how to fix it? Thanks much, Andrew runTheMatrix.py -l 136.731 ERROR executing [description of process] cd 136.731_RunSinglePh2016B+RunSinglePh2016B+HLTDR2_2016+RECODR2_2016reHLT_skimSinglePh_HIPM+HARVESTDR2 cmsDriver.py step2 --datatier FEVTDEBUGHLT --conditions auto:run2_hlt_relval -s ***@***.*** --process reHLT --data --era Run2_2016 --eventcontent FEVTDEBUGHLT -n 100 --filein filelist:step1_dasquery.log --lumiToProcess step1_lumiRanges.log --fileout file:step2.root > step2_RunSinglePh2016B+RunSinglePh2016B+HLTDR2_2016+RECODR2_2016reHLT_skimSinglePh_HIPM+HARVESTDR2.log 2 Step: L1REPACK Spec: ['Full'] L1T INFO: L1REPACK:Full (intended for 2016 data) will unpack all L1T inputs, re-L1T INFO: L1REPACK:Full (intended for 2016 data) will unpack all L1T inputs, re-emulated (Stage-2), and pack uGT, uGMT, and Calo Stage-2 output. ----- Begin Fatal Exception 31-Jul-2017 11:20:13 CEST----------------------- An exception of category 'PluginLibraryLoadError' occurred while [0] Constructing the EventProcessor [1] Constructing ESSource: class=PoolDBESSource label='GlobalTag' Exception Message: unable to load /afs/cern.ch/user/a/abrinke1/CentralPR/CMSSW_9_3_X_2017-07-25-2300/lib/slc6_amd64_gcc630/poisoned/plugin-poisoned-CondCoreL1TPlugins.so because /afs/cern.ch/user/a/abrinke1/CentralPR/CMSSW_9_3_X_2017-07-25-2300/lib/slc6_amd64_gcc630/poisoned/plugin-poisoned-CondCoreL1TPlugins.so: cannot open shared object file: No such file or directory ----- End Fatal Exception ------------------------------------------------- — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub, or mute the thread.

abrinke1 · 2017-07-31T09:49:21Z

Hmm ... good question. @kkotov would have to answer that one - but he's traveling at the moment.

However, I re-added the original CondFormats/DataRecord/src/L1TMuonEndcapParamsRcd.cc and CondFormats/DataRecord/interface/L1TMuonEndcapParamsRcd.h files, re-compiled, and re-ran - but that didn't change anything. So it doesn't seem to depend on the fact that those files are were missing.

davidlange6 · 2017-07-31T09:56:13Z

given the plugin declariations that are removed (nice - "C" goes to "c" 👎 - that will have to be changed unfortunately) - that is not going to change anything..

abrinke1 · 2017-08-01T17:08:51Z

For now, moving on to PR #20006 for DQM, which is not dependent on any O2O / ConfFormats payloads. Will come back to this, probably with a new PR.

arunhep · 2017-08-08T13:47:30Z

Can this PR be closed if not relevant now?

abrinke1 · 2017-08-08T15:30:32Z

Sorry, thought I had already closed it - now closed.

EMTF 2017 PR #4 - 2017 CondDB and O2O

37c1ea4

cmsbuild added this to the CMSSW_9_3_X milestone Jul 26, 2017

cmsbuild added alca-pending comparison-pending db-pending l1-pending orp-pending pending-signatures tests-pending labels Jul 26, 2017

EMTF small bugfix for shared_ptr in ESProducer

c7ca155

cmsbuild added tests-started and removed tests-pending labels Jul 26, 2017

cmsbuild added comparison-notrun tests-rejected and removed comparison-pending tests-started labels Jul 26, 2017

EMTF fix typo in fakeEmtfParams_cff.py

3a2a3ad

cmsbuild added comparison-pending tests-pending and removed comparison-notrun tests-rejected labels Jul 27, 2017

abrinke1 added 2 commits July 27, 2017 15:52

EMTF removed exact duplicate of L1TMuonEndCapParamsRcd, propagated na…

473e685

…me change

Merge branch 'EMTF_PR_2017_93X_part4' of github.com:abrinke1/cmssw in…

34dc38a

…to EMTF_PR_2017_93X_part4

cmsbuild added tests-started and removed tests-pending labels Jul 27, 2017

cmsbuild added comparison-notrun tests-rejected and removed comparison-pending tests-started labels Jul 27, 2017

abrinke1 mentioned this pull request Aug 1, 2017

EMTF 2017 PR #5 - DQM #20006

Merged

abrinke1 closed this Aug 8, 2017

abrinke1 mentioned this pull request Aug 28, 2017

EMTF 2017 PR #6 - Emulator #20286

Merged

abrinke1 deleted the EMTF_PR_2017_93X_part4 branch September 18, 2018 12:22

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

EMTF 2017 PR #4 - 2017 CondDB and O2O #19928

EMTF 2017 PR #4 - 2017 CondDB and O2O #19928

abrinke1 commented Jul 26, 2017 •

edited

cmsbuild commented Jul 26, 2017

arunhep commented Jul 26, 2017

cmsbuild commented Jul 26, 2017 •

edited

cmsbuild commented Jul 26, 2017

cmsbuild commented Jul 26, 2017

abrinke1 commented Jul 27, 2017 •

edited

kkotov commented Jul 27, 2017

cmsbuild commented Jul 27, 2017

abrinke1 commented Jul 27, 2017

cmsbuild commented Jul 27, 2017

abrinke1 commented Jul 27, 2017

arunhep commented Jul 27, 2017

cmsbuild commented Jul 27, 2017 •

edited

cmsbuild commented Jul 27, 2017

cmsbuild commented Jul 27, 2017

abrinke1 commented Jul 27, 2017

rekovic commented Jul 28, 2017

rekovic commented Jul 28, 2017

kkotov commented Jul 28, 2017

kkotov commented Jul 28, 2017

abrinke1 commented Jul 31, 2017

davidlange6 commented Jul 31, 2017 via email

abrinke1 commented Jul 31, 2017

davidlange6 commented Jul 31, 2017

abrinke1 commented Aug 1, 2017

arunhep commented Aug 8, 2017

abrinke1 commented Aug 8, 2017

EMTF 2017 PR #4 - 2017 CondDB and O2O #19928

EMTF 2017 PR #4 - 2017 CondDB and O2O #19928

Conversation

abrinke1 commented Jul 26, 2017 • edited

cmsbuild commented Jul 26, 2017

arunhep commented Jul 26, 2017

cmsbuild commented Jul 26, 2017 • edited

cmsbuild commented Jul 26, 2017

cmsbuild commented Jul 26, 2017

abrinke1 commented Jul 27, 2017 • edited

kkotov commented Jul 27, 2017

cmsbuild commented Jul 27, 2017

abrinke1 commented Jul 27, 2017

cmsbuild commented Jul 27, 2017

abrinke1 commented Jul 27, 2017

arunhep commented Jul 27, 2017

cmsbuild commented Jul 27, 2017 • edited

cmsbuild commented Jul 27, 2017

cmsbuild commented Jul 27, 2017

abrinke1 commented Jul 27, 2017

rekovic commented Jul 28, 2017

rekovic commented Jul 28, 2017

kkotov commented Jul 28, 2017

kkotov commented Jul 28, 2017

abrinke1 commented Jul 31, 2017

davidlange6 commented Jul 31, 2017 via email

abrinke1 commented Jul 31, 2017

davidlange6 commented Jul 31, 2017

abrinke1 commented Aug 1, 2017

arunhep commented Aug 8, 2017

abrinke1 commented Aug 8, 2017

abrinke1 commented Jul 26, 2017 •

edited

cmsbuild commented Jul 26, 2017 •

edited

abrinke1 commented Jul 27, 2017 •

edited

cmsbuild commented Jul 27, 2017 •

edited