DQM for BPH paths #22955

anigamova · 2018-04-13T14:24:48Z

Update of paths names in _cff. Removing the bugged prescale provider

cmsbuild · 2018-04-13T14:25:09Z

The code-checks are being triggered in jenkins.

cmsbuild · 2018-04-13T14:28:11Z

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-22955/4341

cmsbuild · 2018-04-13T14:28:27Z

A new Pull Request was created by @anigamova for master.

It involves the following packages:

DQMOffline/Trigger

@vazzolini, @kmaeshima, @dmitrijus, @cmsbuild, @jfernan2, @vanbesien can you please review it and eventually sign? Thanks.
@battibass, @mtosi, @jhgoh, @calderona, @HuguesBrun, @drkovalskyi, @trocino, @folguera, @rociovilar this is something you requested to watch as well.
@davidlange6, @slava77, @fabiocos you are the release manager for this.

cms-bot commands are listed here

jfernan2 · 2018-04-13T14:33:12Z

please test

cmsbuild · 2018-04-13T14:33:31Z

The tests are being triggered in jenkins.
https://cmssdt.cern.ch/jenkins/job/ib-any-integration/27480/console Started: 2018/04/13 16:33

cmsbuild · 2018-04-13T15:21:04Z

The code-checks are being triggered in jenkins.

cmsbuild · 2018-04-13T15:22:47Z

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-22955/4343

cmsbuild · 2018-04-13T15:23:10Z

Pull request #22955 was updated. @vazzolini, @kmaeshima, @dmitrijus, @cmsbuild, @jfernan2, @vanbesien can you please check and sign again.

anigamova · 2018-04-13T15:27:08Z

I'm sorry for interrupting the test, found a typo
Can we start again?

cmsbuild · 2018-04-13T15:28:20Z

-1

Tested at: 63d67ac

You can see the results of the tests here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-22955/27480/summary.html

I found follow errors while testing this PR

Failed tests: RelVals

RelVals:

When I ran the RelVals I found an error in the following worklfows:
136.7611 step2

runTheMatrix-results/136.7611_RunJetHT2016E_reminiaod+RunJetHT2016E_reminiaod+REMINIAOD_data2016_HIPM+HARVESTDR2_REMINIAOD_data2016_HIPM/step2_RunJetHT2016E_reminiaod+RunJetHT2016E_reminiaod+REMINIAOD_data2016_HIPM+HARVESTDR2_REMINIAOD_data2016_HIPM.log

136.8311 step2

runTheMatrix-results/136.8311_RunJetHT2017F_reminiaod+RunJetHT2017F_reminiaod+REMINIAOD_data2017+HARVEST2017_REMINIAOD_data2017/step2_RunJetHT2017F_reminiaod+RunJetHT2017F_reminiaod+REMINIAOD_data2017+HARVEST2017_REMINIAOD_data2017.log

1325.7 step2

runTheMatrix-results/1325.7_TTbar_13_94Xv2NanoAODINPUT+TTbar_13_94Xv2NanoAODINPUT+NANOEDMMC2017_94XMiniAODv2+HARVESTNANOAODMC2017_94XMiniAODv2/step2_TTbar_13_94Xv2NanoAODINPUT+TTbar_13_94Xv2NanoAODINPUT+NANOEDMMC2017_94XMiniAODv2+HARVESTNANOAODMC2017_94XMiniAODv2.log

140.53 step2

runTheMatrix-results/140.53_RunHI2011+RunHI2011+RECOHID11+HARVESTDHI/step2_RunHI2011+RunHI2011+RECOHID11+HARVESTDHI.log

1000.0 step2

runTheMatrix-results/1000.0_RunMinBias2011A+RunMinBias2011A+TIER0+SKIMD+HARVESTDfst2+ALCASPLIT/step2_RunMinBias2011A+RunMinBias2011A+TIER0+SKIMD+HARVESTDfst2+ALCASPLIT.log

1001.0 step2

runTheMatrix-results/1001.0_RunMinBias2011A+RunMinBias2011A+TIER0EXP+ALCAEXP+ALCAHARVD1+ALCAHARVD2+ALCAHARVD3+ALCAHARVD4+ALCAHARVD5+ALCAHARVDSIPIXELCALRUN1/step2_RunMinBias2011A+RunMinBias2011A+TIER0EXP+ALCAEXP+ALCAHARVD1+ALCAHARVD2+ALCAHARVD3+ALCAHARVD4+ALCAHARVD5+ALCAHARVDSIPIXELCALRUN1.log

4.53 step3

runTheMatrix-results/4.53_RunPhoton2012B+RunPhoton2012B+HLTD+RECODR1reHLT+HARVESTDR1reHLT/step3_RunPhoton2012B+RunPhoton2012B+HLTD+RECODR1reHLT+HARVESTDR1reHLT.log

136.731 step3

runTheMatrix-results/136.731_RunSinglePh2016B+RunSinglePh2016B+HLTDR2_2016+RECODR2_2016reHLT_skimSinglePh_HIPM+HARVESTDR2/step3_RunSinglePh2016B+RunSinglePh2016B+HLTDR2_2016+RECODR2_2016reHLT_skimSinglePh_HIPM+HARVESTDR2.log

136.788 step3

runTheMatrix-results/136.788_RunSinglePh2017B+RunSinglePh2017B+HLTDR2_2017+RECODR2_2017reHLT_skimSinglePh_Prompt+HARVEST2017/step3_RunSinglePh2017B+RunSinglePh2017B+HLTDR2_2017+RECODR2_2017reHLT_skimSinglePh_Prompt+HARVEST2017.log

1306.0 step3

runTheMatrix-results/1306.0_SingleMuPt1_UP15+SingleMuPt1_UP15+DIGIUP15+RECOUP15+HARVESTUP15/step3_SingleMuPt1_UP15+SingleMuPt1_UP15+DIGIUP15+RECOUP15+HARVESTUP15.log

1330.0 step3

runTheMatrix-results/1330.0_ZMM_13+ZMM_13+DIGIUP15+RECOUP15_L1TMuDQM+HARVESTUP15_L1TMuDQM/step3_ZMM_13+ZMM_13+DIGIUP15+RECOUP15_L1TMuDQM+HARVESTUP15_L1TMuDQM.log

10042.0 step3

runTheMatrix-results/10042.0_ZMM_13+ZMM_13TeV_TuneCUETP8M1_2017_GenSimFull+DigiFull_2017+RecoFull_2017+ALCAFull_2017+HARVESTFull_2017/step3_ZMM_13+ZMM_13TeV_TuneCUETP8M1_2017_GenSimFull+DigiFull_2017+RecoFull_2017+ALCAFull_2017+HARVESTFull_2017.log

150.0 step3

runTheMatrix-results/150.0_HydjetQ_B12_5020GeV_2018+HydjetQ_B12_5020GeV_2018+DIGIHI2018+RECOHI2018+HARVESTHI2018/step3_HydjetQ_B12_5020GeV_2018+HydjetQ_B12_5020GeV_2018+DIGIHI2018+RECOHI2018+HARVESTHI2018.log

11624.0 step3

runTheMatrix-results/11624.0_TTbar_13+TTbar_13TeV_TuneCUETP8M1_2019_GenSimFull+DigiFull_2019+RecoFull_2019+ALCAFull_2019+HARVESTFull_2019/step3_TTbar_13+TTbar_13TeV_TuneCUETP8M1_2019_GenSimFull+DigiFull_2019+RecoFull_2019+ALCAFull_2019+HARVESTFull_2019.log

9.0 step3

runTheMatrix-results/9.0_Higgs200ChargedTaus+Higgs200ChargedTaus+DIGI+RECO+HARVEST/step3_Higgs200ChargedTaus+Higgs200ChargedTaus+DIGI+RECO+HARVEST.log

10024.0 step3

runTheMatrix-results/10024.0_TTbar_13+TTbar_13TeV_TuneCUETP8M1_2017_GenSimFull+DigiFull_2017+RecoFull_2017+ALCAFull_2017+HARVESTFull_2017/step3_TTbar_13+TTbar_13TeV_TuneCUETP8M1_2017_GenSimFull+DigiFull_2017+RecoFull_2017+ALCAFull_2017+HARVESTFull_2017.log

25.0 step3

runTheMatrix-results/25.0_TTbar+TTbar+DIGI+RECOAlCaCalo+HARVEST+ALCATT/step3_TTbar+TTbar+DIGI+RECOAlCaCalo+HARVEST+ALCATT.log

10824.0 step3

runTheMatrix-results/10824.0_TTbar_13+TTbar_13TeV_TuneCUETP8M1_2018_GenSimFull+DigiFull_2018+RecoFull_2018+ALCAFull_2018+HARVESTFull_2018/step3_TTbar_13+TTbar_13TeV_TuneCUETP8M1_2018_GenSimFull+DigiFull_2018+RecoFull_2018+ALCAFull_2018+HARVESTFull_2018.log

25202.0 step3

runTheMatrix-results/25202.0_TTbar_13+TTbar_13+DIGIUP15_PU25+RECOUP15_PU25+HARVESTUP15_PU25/step3_TTbar_13+TTbar_13+DIGIUP15_PU25+RECOUP15_PU25+HARVESTUP15_PU25.log

10224.0 step3

runTheMatrix-results/10224.0_TTbar_13+TTbar_13TeV_TuneCUETP8M1_2017PU_GenSimFull+DigiFullPU_2017PU+RecoFullPU_2017PU+HARVESTFullPU_2017PU/step3_TTbar_13+TTbar_13TeV_TuneCUETP8M1_2017PU_GenSimFull+DigiFullPU_2017PU+RecoFullPU_2017PU+HARVESTFullPU_2017PU.log

20434.0 step3

runTheMatrix-results/20434.0_TTbar_14TeV+TTbar_14TeV_TuneCUETP8M1_2023D19_GenSimHLBeamSpotFull14+DigiFullTrigger_2023D19+RecoFullGlobal_2023D19+HARVESTFullGlobal_2023D19/step3_TTbar_14TeV+TTbar_14TeV_TuneCUETP8M1_2023D19_GenSimHLBeamSpotFull14+DigiFullTrigger_2023D19+RecoFullGlobal_2023D19+HARVESTFullGlobal_2023D19.log

20034.0 step3

runTheMatrix-results/20034.0_TTbar_14TeV+TTbar_14TeV_TuneCUETP8M1_2023D17_GenSimHLBeamSpotFull14+DigiFullTrigger_2023D17+RecoFullGlobal_2023D17+HARVESTFullGlobal_2023D17/step3_TTbar_14TeV+TTbar_14TeV_TuneCUETP8M1_2023D17_GenSimHLBeamSpotFull14+DigiFullTrigger_2023D17+RecoFullGlobal_2023D17+HARVESTFullGlobal_2023D17.log

21234.0 step3

runTheMatrix-results/21234.0_TTbar_14TeV+TTbar_14TeV_TuneCUETP8M1_2023D21_GenSimHLBeamSpotFull14+DigiFullTrigger_2023D21+RecoFullGlobal_2023D21+HARVESTFullGlobal_2023D21/step3_TTbar_14TeV+TTbar_14TeV_TuneCUETP8M1_2023D21_GenSimHLBeamSpotFull14+DigiFullTrigger_2023D21+RecoFullGlobal_2023D21+HARVESTFullGlobal_2023D21.log

anigamova · 2018-04-17T20:43:51Z

@dmitrijus
I'm not sure what can I do. Should we just run the test again?
When I tried to run runTheMatrix test locally everything went fine.

fabiocos · 2018-04-19T08:18:43Z

please test

I would imagine a temporary glitch...

cmsbuild · 2018-04-19T08:19:04Z

The tests are being triggered in jenkins.
https://cmssdt.cern.ch/jenkins/job/ib-any-integration/27565/console Started: 2018/04/19 10:19

cmsbuild · 2018-04-19T10:31:55Z

+1
Tested at: e25b117
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-22955/27565/summary.html

cmsbuild · 2018-04-19T10:31:57Z

Comparison job queued.

cmsbuild · 2018-04-19T11:59:32Z

Comparison is ready
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-22955/27565/summary.html

Comparison Summary:

No significant changes to the logs found
Reco comparison results: 0 differences found in the comparisons
DQMHistoTests: Total files compared: 29
DQMHistoTests: Total histograms compared: 2490128
DQMHistoTests: Total failures: 1
DQMHistoTests: Total nulls: 0
DQMHistoTests: Total successes: 2489951
DQMHistoTests: Total skipped: 176
DQMHistoTests: Total Missing objects: 0
DQMHistoSizes: Histogram memory added: 0.0 KiB( 8 files compared)
Checked 119 log files, 9 edm output root files, 29 DQM output files

dmitrijus · 2018-04-24T11:50:50Z

+1

cmsbuild · 2018-04-24T11:51:08Z

This pull request is fully signed and it will be integrated in one of the next master IBs (tests are also fine). This pull request will now be reviewed by the release team before it's merged. @davidlange6, @slava77, @smuzaffar, @fabiocos (and backports should be raised in the release meeting by the corresponding L2)

fabiocos · 2018-04-26T08:56:39Z

@smuzaffar according to a local test on 10824.0 I observe a welcome reduction of about 25 KiB in the DQM output, according to dqmMemoryStats.py . In the above report 0 change is reported, this looks a bit strange... I merge this PR, as in itself it looks ok, but I would like to understand better the reason for this behaviour

fabiocos · 2018-04-26T08:56:45Z

+1

Aliya Nigamova added 2 commits April 13, 2018 13:50

Updated the _cff file, deleted the old bugged PrescaleProvider

f44cc96

returning the needed module

63d67ac

cmsbuild added this to the CMSSW_10_2_X milestone Apr 13, 2018

cmsbuild added code-checks-pending comparison-pending dqm-pending orp-pending pending-signatures tests-pending labels Apr 13, 2018

cmsbuild added code-checks-approved and removed code-checks-pending labels Apr 13, 2018

cmsbuild added tests-started and removed tests-pending labels Apr 13, 2018

fixing a typo

e25b117

cmsbuild added code-checks-pending tests-pending and removed code-checks-approved tests-started labels Apr 13, 2018

cmsbuild added code-checks-approved and removed code-checks-pending labels Apr 13, 2018

cmsbuild added the tests-rejected label Apr 17, 2018

cmsbuild added comparison-pending tests-pending and removed comparison-notrun tests-rejected labels Apr 19, 2018

cmsbuild added tests-started and removed tests-pending labels Apr 19, 2018

cmsbuild added tests-approved and removed tests-started labels Apr 19, 2018

cmsbuild added comparison-available and removed comparison-pending labels Apr 19, 2018

cmsbuild added dqm-approved fully-signed and removed dqm-pending pending-signatures labels Apr 24, 2018

cmsbuild added orp-approved and removed orp-pending labels Apr 26, 2018

cmsbuild merged commit cba0559 into cms-sw:master Apr 26, 2018

fabiocos mentioned this pull request Apr 26, 2018

DQM monitor not showing memory reduction cms-sw/cms-bot#979

Closed

dmitrijus mentioned this pull request May 18, 2018

Backporting merged PR 22955 to 10_1_X #23227

Merged

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

DQM for BPH paths #22955

DQM for BPH paths #22955

anigamova commented Apr 13, 2018

cmsbuild commented Apr 13, 2018

cmsbuild commented Apr 13, 2018

cmsbuild commented Apr 13, 2018

jfernan2 commented Apr 13, 2018

cmsbuild commented Apr 13, 2018 •

edited

Loading

cmsbuild commented Apr 13, 2018

cmsbuild commented Apr 13, 2018

cmsbuild commented Apr 13, 2018

anigamova commented Apr 13, 2018

cmsbuild commented Apr 13, 2018

anigamova commented Apr 17, 2018

fabiocos commented Apr 19, 2018

cmsbuild commented Apr 19, 2018 •

edited

Loading

cmsbuild commented Apr 19, 2018

cmsbuild commented Apr 19, 2018

cmsbuild commented Apr 19, 2018

dmitrijus commented Apr 24, 2018

cmsbuild commented Apr 24, 2018

fabiocos commented Apr 26, 2018

fabiocos commented Apr 26, 2018

DQM for BPH paths #22955

DQM for BPH paths #22955

Conversation

anigamova commented Apr 13, 2018

cmsbuild commented Apr 13, 2018

cmsbuild commented Apr 13, 2018

cmsbuild commented Apr 13, 2018

jfernan2 commented Apr 13, 2018

cmsbuild commented Apr 13, 2018 • edited Loading

cmsbuild commented Apr 13, 2018

cmsbuild commented Apr 13, 2018

cmsbuild commented Apr 13, 2018

anigamova commented Apr 13, 2018

cmsbuild commented Apr 13, 2018

anigamova commented Apr 17, 2018

fabiocos commented Apr 19, 2018

cmsbuild commented Apr 19, 2018 • edited Loading

cmsbuild commented Apr 19, 2018

cmsbuild commented Apr 19, 2018

cmsbuild commented Apr 19, 2018

dmitrijus commented Apr 24, 2018

cmsbuild commented Apr 24, 2018

fabiocos commented Apr 26, 2018

fabiocos commented Apr 26, 2018

cmsbuild commented Apr 13, 2018 •

edited

Loading

cmsbuild commented Apr 19, 2018 •

edited

Loading