Update to HLT menu V2.1 - Minotaur (92X) #19503

Martin-Grunewald · 2017-07-02T04:48:28Z

Update to HLT menu V2.1 - Minotaur (92X)
Based on CMSSW_9_2_7

cmsbuild · 2017-07-02T04:48:49Z

A new Pull Request was created by @Martin-Grunewald (Martin Grunewald) for CMSSW_9_2_X.

It involves the following packages:

Configuration/AlCa
Configuration/HLT
HLTrigger/Configuration
Utilities/ReleaseScripts

@ghellwig, @smuzaffar, @Dr15Jones, @silviodonato, @arunhep, @franzoni, @cerminar, @Martin-Grunewald, @cmsbuild, @fwyzard, @davidlange6, @lpernie can you please review it and eventually sign? Thanks.
@ghellwig, @makortel, @wddgit, @tocheng, @jalimena, @mmusich, @geoff-smith this is something you requested to watch as well.
@davidlange6 you are the release manager for this.

cms-bot commands are listed here

Backported from HLT menu "Phlegyas" (V2) plus GT work (93X) #19502

Martin-Grunewald · 2017-07-02T04:49:49Z

backport of #19502

Martin-Grunewald · 2017-07-02T04:49:56Z

please test

cmsbuild · 2017-07-02T04:50:07Z

The tests are being triggered in jenkins.
https://cmssdt.cern.ch/jenkins/job/ib-any-integration/21056/console Started: 2017/07/02 06:51

cmsbuild · 2017-07-02T07:09:33Z

-1

Tested at: bb2075b

The following merge commits were also included on top of IB + this PR after doing git cms-merge-topic:
1a9d118
f3ec9cc
af675a6
d57a581
88b4d4b
50ad124
fc51b5b
You can see more details here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-19503/21056/git-log-recent-commits
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-19503/21056/git-merge-result

You can see the results of the tests here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-19503/21056/summary.html

I found follow errors while testing this PR

Failed tests: RelVals

RelVals:

When I ran the RelVals I found an error in the following worklfows:
10042.0 step2

runTheMatrix-results/10042.0_ZMM_13+ZMM_13TeV_TuneCUETP8M1_2017_GenSimFull+DigiFull_2017+RecoFull_2017+ALCAFull_2017+HARVESTFull_2017/step2_ZMM_13+ZMM_13TeV_TuneCUETP8M1_2017_GenSimFull+DigiFull_2017+RecoFull_2017+ALCAFull_2017+HARVESTFull_2017.log

10024.0 step2

runTheMatrix-results/10024.0_TTbar_13+TTbar_13TeV_TuneCUETP8M1_2017_GenSimFull+DigiFull_2017+RecoFull_2017+ALCAFull_2017+HARVESTFull_2017/step2_TTbar_13+TTbar_13TeV_TuneCUETP8M1_2017_GenSimFull+DigiFull_2017+RecoFull_2017+ALCAFull_2017+HARVESTFull_2017.log

10824.0 step2

runTheMatrix-results/10824.0_TTbar_13+TTbar_13TeV_TuneCUETP8M1_2018_GenSimFull+DigiFull_2018+RecoFull_2018+ALCAFull_2018+HARVESTFull_2018/step2_TTbar_13+TTbar_13TeV_TuneCUETP8M1_2018_GenSimFull+DigiFull_2018+RecoFull_2018+ALCAFull_2018+HARVESTFull_2018.log

The following merge commits were also included on top of IB + this PR after doing git cms-merge-topic:
1a9d118
f3ec9cc
af675a6
d57a581
88b4d4b
50ad124
fc51b5b
You can see more details here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-19503/21056/git-log-recent-commits
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-19503/21056/git-merge-result

cmsbuild · 2017-07-02T07:09:36Z

Comparison not run due to runTheMatrix errors (RelVals and Igprof tests were also skipped)

Martin-Grunewald · 2017-07-02T07:29:11Z

Test failures are due to new L1T menu L1Menu_Collisions2017_dev_r6_woCDC_m6_xml needed for the V2 HLT menu in the standard 92X GT keys.

Martin-Grunewald · 2017-07-05T09:42:55Z

hold

cmsbuild · 2017-07-05T09:43:18Z

Pull request has been put on hold by @Martin-Grunewald
They need to issue an unhold command to remove the hold state or L1 can unhold it for all

Martin-Grunewald · 2017-07-24T13:24:56Z

@arunhep @franzoni @Dr15Jones
please check and sign.

cmsbuild · 2017-07-24T15:49:07Z

Pull request #19503 was updated. @ghellwig, @smuzaffar, @Dr15Jones, @silviodonato, @arunhep, @franzoni, @cerminar, @Martin-Grunewald, @cmsbuild, @fwyzard, @davidlange6, @lpernie can you please check and sign again.

Martin-Grunewald · 2017-07-24T15:49:32Z

please test

cmsbuild · 2017-07-24T15:49:53Z

The tests are being triggered in jenkins.
https://cmssdt.cern.ch/jenkins/job/ib-any-integration/21713/console Started: 2017/07/24 17:51

cmsbuild · 2017-07-24T17:11:23Z

+1
Tested at: e522981
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-19503/21713/summary.html

The following merge commits were also included on top of IB + this PR after doing git cms-merge-topic:
b862234
You can see more details here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-19503/21713/git-log-recent-commits
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-19503/21713/git-merge-result

cmsbuild · 2017-07-24T17:11:26Z

Comparison job queued.

Martin-Grunewald · 2017-07-24T17:54:30Z

+1

cmsbuild · 2017-07-24T19:00:32Z

Comparison is ready
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-19503/21713/summary.html

Comparison Summary:

No significant changes to the logs found
ROOTFileChecks: Some differences in event products or their sizes found
Reco comparison results: 3721 differences found in the comparisons
DQMHistoTests: Total files compared: 22
DQMHistoTests: Total histograms compared: 1763994
DQMHistoTests: Total failures: 50831
DQMHistoTests: Total nulls: 540
DQMHistoTests: Total successes: 1712457
DQMHistoTests: Total skipped: 166
DQMHistoTests: Total Missing objects: 0
Checked 90 log files, 14 edm output root files, 22 DQM output files

arunhep · 2017-07-24T20:54:50Z

@Martin-Grunewald
checking wf10024 : 2017 ttbar MC
many changes in different directories which are expected because of change of L1 and HLT menu.
could not understand this directory : https://cmssdt.cern.ch/SDT/jenkins-artifacts/baseLineComparisons/CMSSW_9_2_X_2017-07-24-1100+19503/21523/10024.0_TTbar_13+TTbar_13TeV_TuneCUETP8M1_2017_GenSimFull+DigiFull_2017+RecoFull_2017+ALCAFull_2017+HARVESTFull_2017/TrackerHitsV_TrackerHit.html
where for some of the distributions, reference had 0 entries and with new menu we got entries like here.
it needs more investigation.
@makortel @fioriNTU can you please help in getting more information about these quantities?

no change in data wf 136.731 as expected.
no change in wf 1001 which is express-like

franzoni · 2017-07-25T14:42:49Z

@arunhep

there are indications for the 2017 Full sim that the simhits have changed

(see for instance HCAL and ECAL), a plausible consequence of the changes in GeometryFileRcd/Extended and ( see details of the tag changes between GT's ) which are known to affect the reproducibility of the pseudo-random nunber sequence

The tracker related difference you report , @arunhep , are largely in plots with ~1 entry where hits go from 0 to 1 or viceversa.

no change in data wf 136.731 as expected.
no change in wf 1001 which is express-like

Confirm the picture.

franzoni · 2017-07-25T14:42:53Z

+1

Martin-Grunewald · 2017-07-25T15:35:58Z

@Dr15Jones
Chris, please sign (for addOnTests.py)

davidlange6 · 2017-07-25T15:58:52Z

merge

cmsbuild added this to the CMSSW_9_2_X milestone Jul 2, 2017

cmsbuild added alca-pending comparison-pending core-pending hlt-pending orp-pending pending-signatures tests-pending labels Jul 2, 2017

cmsbuild added the backport label Jul 2, 2017

cmsbuild added tests-started and removed tests-pending labels Jul 2, 2017

cmsbuild added comparison-notrun tests-rejected and removed comparison-pending tests-started labels Jul 2, 2017

cmsbuild added the hold label Jul 5, 2017

Martin-Grunewald force-pushed the HLTMenuV2_92X_auto branch from bb2075b to dda11aa Compare July 12, 2017 07:39

cmsbuild removed alca-pending comparison-notrun core-pending tests-rejected labels Jul 12, 2017

Remove extra payloads from TSG GTs

e522981

cmsbuild added hlt-pending tests-pending and removed hlt-approved tests-approved labels Jul 24, 2017

cmsbuild added tests-started and removed tests-pending labels Jul 24, 2017

cmsbuild added tests-approved and removed tests-started labels Jul 24, 2017

cmsbuild added hlt-approved and removed hlt-pending labels Jul 24, 2017

cmsbuild added comparison-available and removed comparison-pending labels Jul 24, 2017

cmsbuild added alca-approved and removed alca-pending labels Jul 25, 2017

cmsbuild merged commit 084ff62 into cms-sw:CMSSW_9_2_X Jul 25, 2017

Martin-Grunewald deleted the HLTMenuV2_92X_auto branch September 7, 2017 13:53

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Update to HLT menu V2.1 - Minotaur (92X) #19503

Update to HLT menu V2.1 - Minotaur (92X) #19503

Martin-Grunewald commented Jul 2, 2017 •

edited

cmsbuild commented Jul 2, 2017 •

edited by smuzaffar

Martin-Grunewald commented Jul 2, 2017

Martin-Grunewald commented Jul 2, 2017

cmsbuild commented Jul 2, 2017 •

edited

cmsbuild commented Jul 2, 2017

cmsbuild commented Jul 2, 2017

Martin-Grunewald commented Jul 2, 2017

Martin-Grunewald commented Jul 5, 2017

cmsbuild commented Jul 5, 2017

Martin-Grunewald commented Jul 24, 2017

cmsbuild commented Jul 24, 2017

Martin-Grunewald commented Jul 24, 2017

cmsbuild commented Jul 24, 2017 •

edited

cmsbuild commented Jul 24, 2017

cmsbuild commented Jul 24, 2017

Martin-Grunewald commented Jul 24, 2017

cmsbuild commented Jul 24, 2017

arunhep commented Jul 24, 2017

franzoni commented Jul 25, 2017

franzoni commented Jul 25, 2017

Martin-Grunewald commented Jul 25, 2017

davidlange6 commented Jul 25, 2017

Update to HLT menu V2.1 - Minotaur (92X) #19503

Update to HLT menu V2.1 - Minotaur (92X) #19503

Conversation

Martin-Grunewald commented Jul 2, 2017 • edited

cmsbuild commented Jul 2, 2017 • edited by smuzaffar

Martin-Grunewald commented Jul 2, 2017

Martin-Grunewald commented Jul 2, 2017

cmsbuild commented Jul 2, 2017 • edited

cmsbuild commented Jul 2, 2017

cmsbuild commented Jul 2, 2017

Martin-Grunewald commented Jul 2, 2017

Martin-Grunewald commented Jul 5, 2017

cmsbuild commented Jul 5, 2017

Martin-Grunewald commented Jul 24, 2017

cmsbuild commented Jul 24, 2017

Martin-Grunewald commented Jul 24, 2017

cmsbuild commented Jul 24, 2017 • edited

cmsbuild commented Jul 24, 2017

cmsbuild commented Jul 24, 2017

Martin-Grunewald commented Jul 24, 2017

cmsbuild commented Jul 24, 2017

arunhep commented Jul 24, 2017

franzoni commented Jul 25, 2017

franzoni commented Jul 25, 2017

Martin-Grunewald commented Jul 25, 2017

davidlange6 commented Jul 25, 2017

Martin-Grunewald commented Jul 2, 2017 •

edited

cmsbuild commented Jul 2, 2017 •

edited by smuzaffar

cmsbuild commented Jul 2, 2017 •

edited

cmsbuild commented Jul 24, 2017 •

edited