TRK@HLT DQM: add SIP plots for final tracks collection #24107

mtosi · 2018-07-27T10:03:51Z

checking w/ BTV@HLT conveners (@defranchis @mastrolorenzo ) the possible source of the discrepancy they see in the 10_2_0 validation,
I realized we are missing the important SIP plots in the monitoring of tracks @HLT
=> I'm enabling them for the final tracks collection @HLT used by PF reconstruction

…3 commits. add SIP plots for final tracks collection fix fix

cmsbuild · 2018-07-27T10:04:10Z

The code-checks are being triggered in jenkins.

cmsbuild · 2018-07-27T10:06:55Z

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-24107/5795

cmsbuild · 2018-07-27T10:07:14Z

A new Pull Request was created by @mtosi (mia tosi) for master.

It involves the following packages:

DQMOffline/Trigger

@andrius-k, @kmaeshima, @schneiml, @dmitrijus, @cmsbuild, @jfernan2 can you please review it and eventually sign? Thanks.
@battibass, @jhgoh, @calderona, @HuguesBrun, @trocino, @folguera, @rociovilar this is something you requested to watch as well.
@davidlange6, @slava77, @fabiocos you are the release manager for this.

cms-bot commands are listed here

jfernan2 · 2018-07-27T10:25:03Z

please test

cmsbuild · 2018-07-27T10:25:20Z

The tests are being triggered in jenkins.
https://cmssdt.cern.ch/jenkins/job/ib-any-integration/29528/console Started: 2018/07/27 12:25

cmsbuild · 2018-07-27T12:30:26Z

-1

Tested at: e1c844e

You can see the results of the tests here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-24107/29528/summary.html

I found follow errors while testing this PR

Failed tests: RelVals

RelVals:

When I ran the RelVals I found an error in the following worklfows:
4.53 step3

runTheMatrix-results/4.53_RunPhoton2012B+RunPhoton2012B+HLTD+RECODR1reHLT+HARVESTDR1reHLT/step3_RunPhoton2012B+RunPhoton2012B+HLTD+RECODR1reHLT+HARVESTDR1reHLT.log

136.7611 step2

runTheMatrix-results/136.7611_RunJetHT2016E_reminiaod+RunJetHT2016E_reminiaod+REMINIAOD_data2016_HIPM+HARVESTDR2_REMINIAOD_data2016_HIPM/step2_RunJetHT2016E_reminiaod+RunJetHT2016E_reminiaod+REMINIAOD_data2016_HIPM+HARVESTDR2_REMINIAOD_data2016_HIPM.log

9.0 step3

runTheMatrix-results/9.0_Higgs200ChargedTaus+Higgs200ChargedTaus+DIGI+RECO+HARVEST/step3_Higgs200ChargedTaus+Higgs200ChargedTaus+DIGI+RECO+HARVEST.log

136.8311 step2

runTheMatrix-results/136.8311_RunJetHT2017F_reminiaod+RunJetHT2017F_reminiaod+REMINIAOD_data2017+HARVEST2017_REMINIAOD_data2017/step2_RunJetHT2017F_reminiaod+RunJetHT2017F_reminiaod+REMINIAOD_data2017+HARVEST2017_REMINIAOD_data2017.log

136.731 step3

runTheMatrix-results/136.731_RunSinglePh2016B+RunSinglePh2016B+HLTDR2_2016+RECODR2_2016reHLT_skimSinglePh_HIPM+HARVESTDR2/step3_RunSinglePh2016B+RunSinglePh2016B+HLTDR2_2016+RECODR2_2016reHLT_skimSinglePh_HIPM+HARVESTDR2.log

140.53 step2

runTheMatrix-results/140.53_RunHI2011+RunHI2011+RECOHID11+HARVESTDHI/step2_RunHI2011+RunHI2011+RECOHID11+HARVESTDHI.log

25.0 step3

runTheMatrix-results/25.0_TTbar+TTbar+DIGI+RECOAlCaCalo+HARVEST+ALCATT/step3_TTbar+TTbar+DIGI+RECOAlCaCalo+HARVEST+ALCATT.log

1325.7 step2

runTheMatrix-results/1325.7_TTbar_13_94Xv2NanoAODINPUT+TTbar_13_94Xv2NanoAODINPUT+NANOEDMMC2017_94XMiniAODv2+HARVESTNANOAODMC2017_94XMiniAODv2/step2_TTbar_13_94Xv2NanoAODINPUT+TTbar_13_94Xv2NanoAODINPUT+NANOEDMMC2017_94XMiniAODv2+HARVESTNANOAODMC2017_94XMiniAODv2.log

136.788 step3

runTheMatrix-results/136.788_RunSinglePh2017B+RunSinglePh2017B+HLTDR2_2017+RECODR2_2017reHLT_skimSinglePh_Prompt+HARVEST2017/step3_RunSinglePh2017B+RunSinglePh2017B+HLTDR2_2017+RECODR2_2017reHLT_skimSinglePh_Prompt+HARVEST2017.log

1000.0 step2

runTheMatrix-results/1000.0_RunMinBias2011A+RunMinBias2011A+TIER0+SKIMD+HARVESTDfst2+ALCASPLIT/step2_RunMinBias2011A+RunMinBias2011A+TIER0+SKIMD+HARVESTDfst2+ALCASPLIT.log

1306.0 step3

runTheMatrix-results/1306.0_SingleMuPt1_UP15+SingleMuPt1_UP15+DIGIUP15+RECOUP15+HARVESTUP15/step3_SingleMuPt1_UP15+SingleMuPt1_UP15+DIGIUP15+RECOUP15+HARVESTUP15.log

1001.0 step2

runTheMatrix-results/1001.0_RunMinBias2011A+RunMinBias2011A+TIER0EXP+ALCAEXP+ALCAHARVDSIPIXELCALRUN1+ALCAHARVD1+ALCAHARVD2+ALCAHARVD3+ALCAHARVD4+ALCAHARVD5/step2_RunMinBias2011A+RunMinBias2011A+TIER0EXP+ALCAEXP+ALCAHARVDSIPIXELCALRUN1+ALCAHARVD1+ALCAHARVD2+ALCAHARVD3+ALCAHARVD4+ALCAHARVD5.log

1330.0 step3

runTheMatrix-results/1330.0_ZMM_13+ZMM_13+DIGIUP15+RECOUP15_L1TMuDQM+HARVESTUP15_L1TMuDQM/step3_ZMM_13+ZMM_13+DIGIUP15+RECOUP15_L1TMuDQM+HARVESTUP15_L1TMuDQM.log

136.85 step3

runTheMatrix-results/136.85_RunEGamma2018A+RunEGamma2018A+HLTDR2_2018+RECODR2_2018reHLT_skimEGamma_Prompt_L1TEgDQM+HARVEST2018_L1TEgDQM/step3_RunEGamma2018A+RunEGamma2018A+HLTDR2_2018+RECODR2_2018reHLT_skimEGamma_Prompt_L1TEgDQM+HARVEST2018_L1TEgDQM.log

150.0 step3

runTheMatrix-results/150.0_HydjetQ_B12_5020GeV_2018+HydjetQ_B12_5020GeV_2018+DIGIHI2018+RECOHI2018+HARVESTHI2018/step3_HydjetQ_B12_5020GeV_2018+HydjetQ_B12_5020GeV_2018+DIGIHI2018+RECOHI2018+HARVESTHI2018.log

10042.0 step3

runTheMatrix-results/10042.0_ZMM_13+ZMM_13TeV_TuneCUETP8M1_2017_GenSimFull+DigiFull_2017+RecoFull_2017+HARVESTFull_2017+ALCAFull_2017/step3_ZMM_13+ZMM_13TeV_TuneCUETP8M1_2017_GenSimFull+DigiFull_2017+RecoFull_2017+HARVESTFull_2017+ALCAFull_2017.log

10024.0 step3

runTheMatrix-results/10024.0_TTbar_13+TTbar_13TeV_TuneCUETP8M1_2017_GenSimFull+DigiFull_2017+RecoFull_2017+HARVESTFull_2017+ALCAFull_2017/step3_TTbar_13+TTbar_13TeV_TuneCUETP8M1_2017_GenSimFull+DigiFull_2017+RecoFull_2017+HARVESTFull_2017+ALCAFull_2017.log

25202.0 step3

runTheMatrix-results/25202.0_TTbar_13+TTbar_13+DIGIUP15_PU25+RECOUP15_PU25+HARVESTUP15_PU25/step3_TTbar_13+TTbar_13+DIGIUP15_PU25+RECOUP15_PU25+HARVESTUP15_PU25.log

11624.0 step3

runTheMatrix-results/11624.0_TTbar_13+TTbar_13TeV_TuneCUETP8M1_2019_GenSimFull+DigiFull_2019+RecoFull_2019+HARVESTFull_2019+ALCAFull_2019/step3_TTbar_13+TTbar_13TeV_TuneCUETP8M1_2019_GenSimFull+DigiFull_2019+RecoFull_2019+HARVESTFull_2019+ALCAFull_2019.log

10224.0 step3

runTheMatrix-results/10224.0_TTbar_13+TTbar_13TeV_TuneCUETP8M1_2017PU_GenSimFull+DigiFullPU_2017PU+RecoFullPU_2017PU+HARVESTFullPU_2017PU/step3_TTbar_13+TTbar_13TeV_TuneCUETP8M1_2017PU_GenSimFull+DigiFullPU_2017PU+RecoFullPU_2017PU+HARVESTFullPU_2017PU.log

10824.0 step3

runTheMatrix-results/10824.0_TTbar_13+TTbar_13TeV_TuneCUETP8M1_2018_GenSimFull+DigiFull_2018+RecoFull_2018+HARVESTFull_2018+ALCAFull_2018/step3_TTbar_13+TTbar_13TeV_TuneCUETP8M1_2018_GenSimFull+DigiFull_2018+RecoFull_2018+HARVESTFull_2018+ALCAFull_2018.log

20034.0 step3

runTheMatrix-results/20034.0_TTbar_14TeV+TTbar_14TeV_TuneCUETP8M1_2023D17_GenSimHLBeamSpotFull14+DigiFullTrigger_2023D17+RecoFullGlobal_2023D17+HARVESTFullGlobal_2023D17/step3_TTbar_14TeV+TTbar_14TeV_TuneCUETP8M1_2023D17_GenSimHLBeamSpotFull14+DigiFullTrigger_2023D17+RecoFullGlobal_2023D17+HARVESTFullGlobal_2023D17.log

20434.0 step3

runTheMatrix-results/20434.0_TTbar_14TeV+TTbar_14TeV_TuneCUETP8M1_2023D19_GenSimHLBeamSpotFull14+DigiFullTrigger_2023D19+RecoFullGlobal_2023D19+HARVESTFullGlobal_2023D19/step3_TTbar_14TeV+TTbar_14TeV_TuneCUETP8M1_2023D19_GenSimHLBeamSpotFull14+DigiFullTrigger_2023D19+RecoFullGlobal_2023D19+HARVESTFullGlobal_2023D19.log

21234.0 step3

runTheMatrix-results/21234.0_TTbar_14TeV+TTbar_14TeV_TuneCUETP8M1_2023D21_GenSimHLBeamSpotFull14+DigiFullTrigger_2023D21+RecoFullGlobal_2023D21+HARVESTFullGlobal_2023D21/step3_TTbar_14TeV+TTbar_14TeV_TuneCUETP8M1_2023D21_GenSimHLBeamSpotFull14+DigiFullTrigger_2023D21+RecoFullGlobal_2023D21+HARVESTFullGlobal_2023D21.log

250202.181 step4

runTheMatrix-results/250202.181_TTbar_13UP18+TTbar_13UP18+PREMIXUP18_PU25+DIGIPRMXLOCALUP18_PU25+RECOPRMXUP18_PU25+HARVESTUP18_PU25/step4_TTbar_13UP18+TTbar_13UP18+PREMIXUP18_PU25+DIGIPRMXLOCALUP18_PU25+RECOPRMXUP18_PU25+HARVESTUP18_PU25.log

cmsbuild · 2018-07-27T12:30:28Z

Comparison not run due to runTheMatrix errors (RelVals and Igprof tests were also skipped)

cmsbuild · 2018-07-27T12:54:23Z

The code-checks are being triggered in jenkins.

cmsbuild · 2018-07-27T12:57:56Z

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-24107/5796

cmsbuild · 2018-07-27T12:58:13Z

Pull request #24107 was updated. @andrius-k, @kmaeshima, @schneiml, @dmitrijus, @cmsbuild, @jfernan2 can you please check and sign again.

andrius-k · 2018-07-27T13:13:52Z

please test

cmsbuild · 2018-07-27T13:14:08Z

The tests are being triggered in jenkins.
https://cmssdt.cern.ch/jenkins/job/ib-any-integration/29532/console Started: 2018/07/27 15:16

cmsbuild · 2018-07-27T16:06:23Z

+1
Tested at: 98b79cd
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-24107/29532/summary.html

cmsbuild · 2018-07-27T16:06:26Z

Comparison job queued.

cmsbuild · 2018-07-27T17:28:15Z

Comparison is ready
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-24107/29532/summary.html

Comparison Summary:

No significant changes to the logs found
Reco comparison results: 0 differences found in the comparisons
DQMHistoTests: Total files compared: 31
DQMHistoTests: Total histograms compared: 2890394
DQMHistoTests: Total failures: 2
DQMHistoTests: Total nulls: 0
DQMHistoTests: Total successes: 2890202
DQMHistoTests: Total skipped: 190
DQMHistoTests: Total Missing objects: 0
DQMHistoSizes: Histogram memory added: 60.564 KiB( 30 files compared)
DQMHistoSizes: changed ( 10824.0,... ): 5.047 KiB HLT/Tracking
Checked 128 log files, 14 edm output root files, 31 DQM output files

andrius-k · 2018-07-30T08:19:49Z

+1

cmsbuild · 2018-07-30T08:20:06Z

This pull request is fully signed and it will be integrated in one of the next master IBs (tests are also fine). This pull request will now be reviewed by the release team before it's merged. @davidlange6, @slava77, @smuzaffar, @fabiocos (and backports should be raised in the release meeting by the corresponding L2)

kpedro88 · 2018-07-30T16:06:59Z

+1

TRK@HLT DQM: add SIP plots for final tracks collection [backport of #24107]

git push -f my-cmssw TRKHLTDQM_addSIPplots# This is a combination of …

e1c844e

…3 commits. add SIP plots for final tracks collection fix fix

cmsbuild added this to the CMSSW_10_3_X milestone Jul 27, 2018

cmsbuild added code-checks-pending comparison-pending dqm-pending orp-pending pending-signatures tests-pending labels Jul 27, 2018

cmsbuild added code-checks-approved and removed code-checks-pending labels Jul 27, 2018

cmsbuild added tests-started and removed tests-pending labels Jul 27, 2018

mtosi mentioned this pull request Jul 27, 2018

TRK@HLT DQM: add SIP plots for final tracks collection [backport of #24107] #24108

Merged

cmsbuild added comparison-notrun tests-rejected and removed comparison-pending tests-started labels Jul 27, 2018

fix

98b79cd

cmsbuild added code-checks-pending comparison-pending and removed code-checks-approved comparison-notrun tests-rejected labels Jul 27, 2018

cmsbuild added the tests-pending label Jul 27, 2018

cmsbuild added code-checks-approved and removed code-checks-pending labels Jul 27, 2018

cmsbuild added tests-started and removed tests-pending labels Jul 27, 2018

cmsbuild added tests-approved and removed tests-started labels Jul 27, 2018

cmsbuild added comparison-available and removed comparison-pending labels Jul 27, 2018

cmsbuild added dqm-approved fully-signed and removed dqm-pending pending-signatures labels Jul 30, 2018

cmsbuild added orp-approved and removed orp-pending labels Jul 30, 2018

cmsbuild merged commit a89d5d9 into cms-sw:master Jul 30, 2018

cmsbuild added a commit that referenced this pull request Aug 17, 2018

Merge pull request #24108 from mtosi/TRKHLTDQM_addSIPplots_102X

fd77524

TRK@HLT DQM: add SIP plots for final tracks collection [backport of #24107]

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

TRK@HLT DQM: add SIP plots for final tracks collection #24107

TRK@HLT DQM: add SIP plots for final tracks collection #24107

mtosi commented Jul 27, 2018

cmsbuild commented Jul 27, 2018

cmsbuild commented Jul 27, 2018

cmsbuild commented Jul 27, 2018

jfernan2 commented Jul 27, 2018

cmsbuild commented Jul 27, 2018 •

edited

cmsbuild commented Jul 27, 2018

cmsbuild commented Jul 27, 2018

cmsbuild commented Jul 27, 2018

cmsbuild commented Jul 27, 2018

cmsbuild commented Jul 27, 2018

andrius-k commented Jul 27, 2018

cmsbuild commented Jul 27, 2018 •

edited

cmsbuild commented Jul 27, 2018

cmsbuild commented Jul 27, 2018

cmsbuild commented Jul 27, 2018

andrius-k commented Jul 30, 2018

cmsbuild commented Jul 30, 2018

kpedro88 commented Jul 30, 2018

TRK@HLT DQM: add SIP plots for final tracks collection #24107

TRK@HLT DQM: add SIP plots for final tracks collection #24107

Conversation

mtosi commented Jul 27, 2018

cmsbuild commented Jul 27, 2018

cmsbuild commented Jul 27, 2018

cmsbuild commented Jul 27, 2018

jfernan2 commented Jul 27, 2018

cmsbuild commented Jul 27, 2018 • edited

cmsbuild commented Jul 27, 2018

cmsbuild commented Jul 27, 2018

cmsbuild commented Jul 27, 2018

cmsbuild commented Jul 27, 2018

cmsbuild commented Jul 27, 2018

andrius-k commented Jul 27, 2018

cmsbuild commented Jul 27, 2018 • edited

cmsbuild commented Jul 27, 2018

cmsbuild commented Jul 27, 2018

cmsbuild commented Jul 27, 2018

andrius-k commented Jul 30, 2018

cmsbuild commented Jul 30, 2018

kpedro88 commented Jul 30, 2018

cmsbuild commented Jul 27, 2018 •

edited

cmsbuild commented Jul 27, 2018 •

edited