updated HLT GT for online DQM #22572

threus · 2018-03-10T13:56:38Z

backport of #22627

cmsbuild · 2018-03-10T13:56:57Z

A new Pull Request was created by @threus for CMSSW_10_0_X.

It involves the following packages:

DQM/Integration

@vazzolini, @kmaeshima, @dmitrijus, @cmsbuild, @jfernan2, @vanbesien can you please review it and eventually sign? Thanks.
@makortel, @batinkov, @thomreis this is something you requested to watch as well.
@davidlange6, @slava77, @fabiocos you are the release manager for this.

cms-bot commands are listed here

Backported from updated GT in online DQM to v3 #22627

dmitrijus · 2018-03-10T14:11:41Z

+1

cmsbuild · 2018-03-10T14:11:58Z

The tests are being triggered in jenkins.
https://cmssdt.cern.ch/jenkins/job/ib-any-integration/26760/console Started: 2018/03/10 15:12

cmsbuild · 2018-03-10T14:11:59Z

This pull request is fully signed and it will be integrated in one of the next CMSSW_10_0_X IBs after it passes the integration tests and once validation in the development release cycle CMSSW_10_1_X is complete. This pull request will now be reviewed by the release team before it's merged. @davidlange6, @slava77, @smuzaffar, @fabiocos (and backports should be raised in the release meeting by the corresponding L2)

cmsbuild · 2018-03-10T16:03:42Z

+1
Tested at: cb6d1cb
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-22572/26760/summary.html

cmsbuild · 2018-03-10T16:03:49Z

Comparison job queued.

cmsbuild · 2018-03-10T17:59:40Z

Comparison is ready
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-22572/26760/summary.html

Comparison Summary:

No significant changes to the logs found
Reco comparison results: 2 differences found in the comparisons
DQMHistoTests: Total files compared: 27
DQMHistoTests: Total histograms compared: 2468459
DQMHistoTests: Total failures: 1
DQMHistoTests: Total nulls: 0
DQMHistoTests: Total successes: 2468289
DQMHistoTests: Total skipped: 169
DQMHistoTests: Total Missing objects: 0
DQMHistoSizes: Histogram memory added: 1.21000000012 KiB( 22 files compared)
Checked 111 log files, 9 edm output root files, 27 DQM output files

dmitrijus · 2018-03-13T13:02:32Z

+1

cmsbuild · 2018-03-15T14:50:50Z

The tests are being triggered in jenkins.
https://cmssdt.cern.ch/jenkins/job/ib-any-integration/26880/console Started: 2018/03/15 16:02

cmsbuild · 2018-03-15T14:50:50Z

This pull request is fully signed and it will be integrated in one of the next CMSSW_10_0_X IBs after it passes the integration tests and once validation in the development release cycle CMSSW_10_1_X is complete. This pull request will now be reviewed by the release team before it's merged. @davidlange6, @slava77, @smuzaffar, @fabiocos (and backports should be raised in the release meeting by the corresponding L2)

cmsbuild · 2018-03-15T16:29:40Z

-1

Tested at: b86fabc

You can see the results of the tests here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-22572/26880/summary.html

I found follow errors while testing this PR

Failed tests: RelVals AddOn

RelVals:

When I ran the RelVals I found an error in the following worklfows:
4.53 step2

runTheMatrix-results/4.53_RunPhoton2012B+RunPhoton2012B+HLTD+RECODR1reHLT+HARVESTDR1reHLT/step2_RunPhoton2012B+RunPhoton2012B+HLTD+RECODR1reHLT+HARVESTDR1reHLT.log

4.22 step2

runTheMatrix-results/4.22_RunCosmics2011A+RunCosmics2011A+RECOCOSD+ALCACOSD+SKIMCOSD+HARVESTDC/step2_RunCosmics2011A+RunCosmics2011A+RECOCOSD+ALCACOSD+SKIMCOSD+HARVESTDC.log

136.731 step2

runTheMatrix-results/136.731_RunSinglePh2016B+RunSinglePh2016B+HLTDR2_2016+RECODR2_2016reHLT_skimSinglePh_HIPM+HARVESTDR2/step2_RunSinglePh2016B+RunSinglePh2016B+HLTDR2_2016+RECODR2_2016reHLT_skimSinglePh_HIPM+HARVESTDR2.log

136.7611 step2

runTheMatrix-results/136.7611_RunJetHT2016E_reminiaod+RunJetHT2016E_reminiaod+REMINIAOD_data2016_HIPM+HARVESTDR2_REMINIAOD_data2016_HIPM/step2_RunJetHT2016E_reminiaod+RunJetHT2016E_reminiaod+REMINIAOD_data2016_HIPM+HARVESTDR2_REMINIAOD_data2016_HIPM.log

136.788 step2

runTheMatrix-results/136.788_RunSinglePh2017B+RunSinglePh2017B+HLTDR2_2017+RECODR2_2017reHLT_skimSinglePh_Prompt+HARVEST2017/step2_RunSinglePh2017B+RunSinglePh2017B+HLTDR2_2017+RECODR2_2017reHLT_skimSinglePh_Prompt+HARVEST2017.log

1325.7 step2

runTheMatrix-results/1325.7_TTbar_13_94XNanoAODINPUT+TTbar_13_94XNanoAODINPUT+NANOEDMMC2017+HARVESTNANOAODMC2017/step2_TTbar_13_94XNanoAODINPUT+TTbar_13_94XNanoAODINPUT+NANOEDMMC2017+HARVESTNANOAODMC2017.log

140.53 step2

runTheMatrix-results/140.53_RunHI2011+RunHI2011+RECOHID11+HARVESTDHI/step2_RunHI2011+RunHI2011+RECOHID11+HARVESTDHI.log

1000.0 step2

runTheMatrix-results/1000.0_RunMinBias2011A+RunMinBias2011A+TIER0+SKIMD+HARVESTDfst2+ALCASPLIT/step2_RunMinBias2011A+RunMinBias2011A+TIER0+SKIMD+HARVESTDfst2+ALCASPLIT.log

1001.0 step2

runTheMatrix-results/1001.0_RunMinBias2011A+RunMinBias2011A+TIER0EXP+ALCAEXP+ALCAHARVD1+ALCAHARVD2+ALCAHARVD3+ALCAHARVD4+ALCAHARVD5/step2_RunMinBias2011A+RunMinBias2011A+TIER0EXP+ALCAEXP+ALCAHARVD1+ALCAHARVD2+ALCAHARVD3+ALCAHARVD4+ALCAHARVD5.log

AddOn:

I found errors in the following addon tests:

cmsRun /cvmfs/cms-ib.cern.ch/nweek-02515/slc6_amd64_gcc630/cms/cmssw-patch/CMSSW_10_0_X_2018-03-15-1100/src/PhysicsTools/PatAlgos/test/IntegrationTest_cfg.py : FAILED - time: date Thu Mar 15 17:09:34 2018-date Thu Mar 15 17:09:20 2018 s - exit: 34304
cmsDriver.py RelVal -s L1REPACK:Full --data --scenario=pp -n 10 --conditions auto:run2_hlt_Fake2 --relval 9000,50 --datatier "RAW" --eventcontent RAW --customise=HLTrigger/Configuration/CustomConfigs.L1T --era Run2_2016 --fileout file:RelVal_Raw_Fake2_DATA.root --filein /store/data/Run2016B/JetHT/RAW/v1/000/272/762/00000/C666CDE2-E013-E611-B15A-02163E011DBE.root : FAILED - time: date Thu Mar 15 17:10:05 2018-date Thu Mar 15 17:09:25 2018 s - exit: 34304
cmsRun /cvmfs/cms-ib.cern.ch/nweek-02515/slc6_amd64_gcc630/cms/cmssw-patch/CMSSW_10_0_X_2018-03-15-1100/src/HLTrigger/Configuration/test/OnLine_HLT_Fake2.py realData=True globalTag=@ inputFiles=@ : FAILED - time: date Thu Mar 15 17:10:05 2018-date Thu Mar 15 17:09:25 2018 s - exit: 21504
cmsDriver.py RelVal -s HLT:Fake2,RAW2DIGI,L1Reco,RECO --data --scenario=pp -n 10 --conditions auto:run2_data_Fake2 --relval 9000,50 --datatier "RAW-HLT-RECO" --eventcontent FEVTDEBUGHLT --customise=HLTrigger/Configuration/CustomConfigs.L1THLT --era Run2_2016 --processName=HLTRECO --filein file:RelVal_Raw_Fake2_DATA.root --fileout file:RelVal_Raw_Fake2_DATA_HLT_RECO.root : FAILED - time: date Thu Mar 15 17:10:05 2018-date Thu Mar 15 17:09:25 2018 s - exit: 21504
cmsDriver.py RelVal -s L1REPACK:Full --data --scenario=pp -n 10 --conditions auto:run2_hlt_PRef --relval 9000,50 --datatier "RAW" --customise=HLTrigger/Configuration/CustomConfigs.L1T --era Run2_2018 --eventcontent RAW --fileout file:RelVal_Raw_PRef_DATA.root --filein /store/data/Run2017A/HLTPhysics4/RAW/v1/000/295/606/00000/36DE5E0A-3645-E711-8FA1-02163E01A43B.root : FAILED - time: date Thu Mar 15 17:10:16 2018-date Thu Mar 15 17:09:29 2018 s - exit: 34304
cmsRun /cvmfs/cms-ib.cern.ch/nweek-02515/slc6_amd64_gcc630/cms/cmssw-patch/CMSSW_10_0_X_2018-03-15-1100/src/HLTrigger/Configuration/test/OnLine_HLT_PRef.py realData=True globalTag=@ inputFiles=@ : FAILED - time: date Thu Mar 15 17:10:16 2018-date Thu Mar 15 17:09:29 2018 s - exit: 21504
cmsDriver.py RelVal -s HLT:PRef,RAW2DIGI,L1Reco,RECO --data --scenario=pp -n 10 --conditions auto:run2_data_PRef --relval 9000,50 --datatier "RAW-HLT-RECO" --eventcontent FEVTDEBUGHLT --customise=HLTrigger/Configuration/CustomConfigs.L1THLT --era Run2_2018 --processName=HLTRECO --filein file:RelVal_Raw_PRef_DATA.root --fileout file:RelVal_Raw_PRef_DATA_HLT_RECO.root : FAILED - time: date Thu Mar 15 17:10:16 2018-date Thu Mar 15 17:09:29 2018 s - exit: 21504
cmsDriver.py RelVal -s L1REPACK:Full2015Data --data --scenario=HeavyIons -n 10 --conditions auto:run2_hlt_HIon --relval 9000,50 --datatier "RAW" --eventcontent RAW --customise=HLTrigger/Configuration/CustomConfigs.L1T --era Run2_2016,Run2_HI --fileout file:RelVal_Raw_HIon_DATA.root --filein /store/hidata/HIRun2015/HIHardProbes/RAW-RECO/HighPtJet-PromptReco-v1/000/263/689/00000/1802CD9A-DDB8-E511-9CF9-02163E0138CA.root : FAILED - time: date Thu Mar 15 17:10:11 2018-date Thu Mar 15 17:09:30 2018 s - exit: 34304
cmsRun /cvmfs/cms-ib.cern.ch/nweek-02515/slc6_amd64_gcc630/cms/cmssw-patch/CMSSW_10_0_X_2018-03-15-1100/src/HLTrigger/Configuration/test/OnLine_HLT_HIon.py realData=True globalTag=@ inputFiles=@ : FAILED - time: date Thu Mar 15 17:10:11 2018-date Thu Mar 15 17:09:30 2018 s - exit: 21504
cmsDriver.py RelVal -s HLT:HIon,RAW2DIGI,L1Reco,RECO --data --scenario=HeavyIons -n 10 --conditions auto:run2_data_HIon --relval 9000,50 --datatier "RAW-HLT-RECO" --eventcontent FEVTDEBUGHLT --customise=HLTrigger/Configuration/CustomConfigs.L1THLT --era Run2_2016,Run2_HI --processName=HLTRECO --filein file:RelVal_Raw_HIon_DATA.root --fileout file:RelVal_Raw_HIon_DATA_HLT_RECO.root : FAILED - time: date Thu Mar 15 17:10:11 2018-date Thu Mar 15 17:09:30 2018 s - exit: 21504
cmsDriver.py RelVal -s L1REPACK:Full --data --scenario=pp -n 10 --conditions auto:run2_hlt_PIon --relval 9000,50 --datatier "RAW" --customise=HLTrigger/Configuration/CustomConfigs.L1T --era Run2_2018 --eventcontent RAW --fileout file:RelVal_Raw_PIon_DATA.root --filein /store/data/Run2017A/HLTPhysics4/RAW/v1/000/295/606/00000/36DE5E0A-3645-E711-8FA1-02163E01A43B.root : FAILED - time: date Thu Mar 15 17:11:17 2018-date Thu Mar 15 17:10:10 2018 s - exit: 34304
cmsRun /cvmfs/cms-ib.cern.ch/nweek-02515/slc6_amd64_gcc630/cms/cmssw-patch/CMSSW_10_0_X_2018-03-15-1100/src/HLTrigger/Configuration/test/OnLine_HLT_PIon.py realData=True globalTag=@ inputFiles=@ : FAILED - time: date Thu Mar 15 17:11:17 2018-date Thu Mar 15 17:10:10 2018 s - exit: 21504
cmsDriver.py RelVal -s HLT:PIon,RAW2DIGI,L1Reco,RECO --data --scenario=pp -n 10 --conditions auto:run2_data_PIon --relval 9000,50 --datatier "RAW-HLT-RECO" --eventcontent FEVTDEBUGHLT --customise=HLTrigger/Configuration/CustomConfigs.L1THLT --era Run2_2018 --processName=HLTRECO --filein file:RelVal_Raw_PIon_DATA.root --fileout file:RelVal_Raw_PIon_DATA_HLT_RECO.root : FAILED - time: date Thu Mar 15 17:11:17 2018-date Thu Mar 15 17:10:10 2018 s - exit: 21504
cmsRun /cvmfs/cms-ib.cern.ch/nweek-02515/slc6_amd64_gcc630/cms/cmssw-patch/CMSSW_10_0_X_2018-03-15-1100/src/Utilities/ReleaseScripts/scripts/read312RV_cfg.py : FAILED - time: date Thu Mar 15 17:15:48 2018-date Thu Mar 15 17:15:30 2018 s - exit: 34304
cmsDriver.py RelVal -s L1REPACK:GT1 --data --scenario=pp -n 10 --conditions auto:run1_hlt_Fake --relval 9000,50 --datatier "RAW" --eventcontent RAW --customise=HLTrigger/Configuration/CustomConfigs.L1T --fileout file:RelVal_Raw_Fake_DATA.root --filein /store/data/Run2012A/MuEG/RAW/v1/000/191/718/14932935-E289-E111-830C-5404A6388697.root : FAILED - time: date Thu Mar 15 17:16:49 2018-date Thu Mar 15 17:15:55 2018 s - exit: 34304
cmsRun /cvmfs/cms-ib.cern.ch/nweek-02515/slc6_amd64_gcc630/cms/cmssw-patch/CMSSW_10_0_X_2018-03-15-1100/src/HLTrigger/Configuration/test/OnLine_HLT_Fake.py realData=True globalTag=@ inputFiles=@ : FAILED - time: date Thu Mar 15 17:16:49 2018-date Thu Mar 15 17:15:55 2018 s - exit: 21504
cmsDriver.py RelVal -s HLT:Fake,RAW2DIGI,L1Reco,RECO --data --scenario=pp -n 10 --conditions auto:run1_data_Fake --relval 9000,50 --datatier "RAW-HLT-RECO" --eventcontent FEVTDEBUGHLT --customise=HLTrigger/Configuration/CustomConfigs.L1THLT --processName=HLTRECO --filein file:RelVal_Raw_Fake_DATA.root --fileout file:RelVal_Raw_Fake_DATA_HLT_RECO.root : FAILED - time: date Thu Mar 15 17:16:49 2018-date Thu Mar 15 17:15:55 2018 s - exit: 21504
cmsDriver.py RelVal -s L1REPACK:Full --data --scenario=pp -n 10 --conditions auto:run2_hlt_GRun --relval 9000,50 --datatier "RAW" --eventcontent RAW --customise=HLTrigger/Configuration/CustomConfigs.L1T --era Run2_2018 --fileout file:RelVal_Raw_GRun_DATA.root --filein /store/data/Run2017A/HLTPhysics4/RAW/v1/000/295/606/00000/36DE5E0A-3645-E711-8FA1-02163E01A43B.root : FAILED - time: date Thu Mar 15 17:18:48 2018-date Thu Mar 15 17:16:16 2018 s - exit: 34304
cmsRun /cvmfs/cms-ib.cern.ch/nweek-02515/slc6_amd64_gcc630/cms/cmssw-patch/CMSSW_10_0_X_2018-03-15-1100/src/HLTrigger/Configuration/test/OnLine_HLT_GRun.py realData=True globalTag=@ inputFiles=@ : FAILED - time: date Thu Mar 15 17:18:48 2018-date Thu Mar 15 17:16:16 2018 s - exit: 21504
cmsDriver.py RelVal -s HLT:GRun,RAW2DIGI,L1Reco,RECO --data --scenario=pp -n 10 --conditions auto:run2_data_GRun --relval 9000,50 --datatier "RAW-HLT-RECO" --eventcontent FEVTDEBUGHLT --customise=HLTrigger/Configuration/CustomConfigs.L1THLT --era Run2_2018 --processName=HLTRECO --filein file:RelVal_Raw_GRun_DATA.root --fileout file:RelVal_Raw_GRun_DATA_HLT_RECO.root : FAILED - time: date Thu Mar 15 17:18:48 2018-date Thu Mar 15 17:16:16 2018 s - exit: 21504

cmsbuild · 2018-03-15T16:29:44Z

Comparison not run due to runTheMatrix errors (RelVals and Igprof tests were also skipped)

smuzaffar · 2018-03-15T18:06:51Z

please test
there were issues with eos earlier

cmsbuild · 2018-03-15T18:07:08Z

The tests are being triggered in jenkins.
https://cmssdt.cern.ch/jenkins/job/ib-any-integration/26890/console Started: 2018/03/15 19:09

cmsbuild · 2018-03-15T19:58:28Z

+1
Tested at: b86fabc
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-22572/26890/summary.html

cmsbuild · 2018-03-15T19:58:34Z

Comparison job queued.

cmsbuild · 2018-03-15T21:20:58Z

Comparison is ready
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-22572/26890/summary.html

Comparison Summary:

No significant changes to the logs found
Reco comparison results: 0 differences found in the comparisons
DQMHistoTests: Total files compared: 27
DQMHistoTests: Total histograms compared: 2468519
DQMHistoTests: Total failures: 1
DQMHistoTests: Total nulls: 0
DQMHistoTests: Total successes: 2468349
DQMHistoTests: Total skipped: 169
DQMHistoTests: Total Missing objects: 0
DQMHistoSizes: Histogram memory added: 1.08000000009 KiB( 22 files compared)
Checked 111 log files, 9 edm output root files, 27 DQM output files

fabiocos · 2018-03-22T07:48:58Z

+1

updated online GT

cb6d1cb

cmsbuild added this to the CMSSW_10_0_X milestone Mar 10, 2018

cmsbuild added comparison-pending dqm-pending orp-pending pending-signatures tests-pending labels Mar 10, 2018

cmsbuild added backport dqm-approved fully-signed and removed dqm-pending pending-signatures labels Mar 10, 2018

cmsbuild added tests-started and removed tests-pending labels Mar 10, 2018

cmsbuild added tests-approved and removed tests-started labels Mar 10, 2018

cmsbuild added comparison-available backport-ok and removed comparison-pending backport labels Mar 10, 2018

updated online GT to v3 needed for GEM

b86fabc

cmsbuild removed the comparison-available label Mar 15, 2018

cmsbuild added the fully-signed label Mar 15, 2018

cmsbuild added tests-started and removed tests-pending labels Mar 15, 2018

cmsbuild added comparison-notrun tests-rejected and removed comparison-pending tests-started labels Mar 15, 2018

cmsbuild added comparison-pending tests-pending and removed comparison-notrun tests-rejected labels Mar 15, 2018

cmsbuild added tests-started and removed tests-pending labels Mar 15, 2018

cmsbuild added tests-approved and removed tests-started labels Mar 15, 2018

cmsbuild added comparison-available and removed comparison-pending labels Mar 15, 2018

cmsbuild added orp-approved and removed orp-pending labels Mar 22, 2018

cmsbuild merged commit f74d631 into cms-sw:CMSSW_10_0_X Mar 22, 2018

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

updated HLT GT for online DQM #22572

updated HLT GT for online DQM #22572

threus commented Mar 10, 2018 •

edited

cmsbuild commented Mar 10, 2018 •

edited

dmitrijus commented Mar 10, 2018

cmsbuild commented Mar 10, 2018 •

edited

cmsbuild commented Mar 10, 2018

cmsbuild commented Mar 10, 2018

cmsbuild commented Mar 10, 2018

cmsbuild commented Mar 10, 2018

dmitrijus commented Mar 13, 2018

cmsbuild commented Mar 15, 2018 •

edited

cmsbuild commented Mar 15, 2018

cmsbuild commented Mar 15, 2018

cmsbuild commented Mar 15, 2018

smuzaffar commented Mar 15, 2018

cmsbuild commented Mar 15, 2018 •

edited

cmsbuild commented Mar 15, 2018

cmsbuild commented Mar 15, 2018

cmsbuild commented Mar 15, 2018

fabiocos commented Mar 22, 2018

updated HLT GT for online DQM #22572

updated HLT GT for online DQM #22572

Conversation

threus commented Mar 10, 2018 • edited

cmsbuild commented Mar 10, 2018 • edited

dmitrijus commented Mar 10, 2018

cmsbuild commented Mar 10, 2018 • edited

cmsbuild commented Mar 10, 2018

cmsbuild commented Mar 10, 2018

cmsbuild commented Mar 10, 2018

cmsbuild commented Mar 10, 2018

dmitrijus commented Mar 13, 2018

cmsbuild commented Mar 15, 2018 • edited

cmsbuild commented Mar 15, 2018

cmsbuild commented Mar 15, 2018

cmsbuild commented Mar 15, 2018

smuzaffar commented Mar 15, 2018

cmsbuild commented Mar 15, 2018 • edited

cmsbuild commented Mar 15, 2018

cmsbuild commented Mar 15, 2018

cmsbuild commented Mar 15, 2018

fabiocos commented Mar 22, 2018

threus commented Mar 10, 2018 •

edited

cmsbuild commented Mar 10, 2018 •

edited

cmsbuild commented Mar 10, 2018 •

edited

cmsbuild commented Mar 15, 2018 •

edited

cmsbuild commented Mar 15, 2018 •

edited