HLT menu 2017 v1.1

[Martin-Grunewald]

HLT menu 2017 v1.1
Based on 923.
rebased to CMSSW_9_2_X_2017-06-22-2300 (23 June 2017)

[cmsbuild]

A new Pull Request was created by @Martin-Grunewald (Martin Grunewald) for master.

It involves the following packages:

Configuration/HLT
HLTrigger/Configuration

@Martin-Grunewald, @silviodonato, @cmsbuild, @fwyzard, @davidlange6 can you please review it and eventually sign? Thanks.
@ghellwig, @makortel, @geoff-smith, @jalimena this is something you requested to watch as well.
@davidlange6 you are the release manager for this.

cms-bot commands are listed here

[Martin-Grunewald]

please test

[cmsbuild]

The tests are being triggered in jenkins.
https://cmssdt.cern.ch/jenkins/job/ib-any-integration/20583/console Started: 2017/06/15 08:44

[cmsbuild]

-1

Tested at: 19d80d9

You can see the results of the tests here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-19235/20583/summary.html

I found follow errors while testing this PR

Failed tests: RelVals AddOn

• RelVals:

When I ran the RelVals I found an error in the following worklfows:
10042.0 step2

runTheMatrix-results/10042.0_ZMM_13+ZMM_13TeV_TuneCUETP8M1_2017_GenSimFull+DigiFull_2017+RecoFull_2017+ALCAFull_2017+HARVESTFull_2017/step2_ZMM_13+ZMM_13TeV_TuneCUETP8M1_2017_GenSimFull+DigiFull_2017+RecoFull_2017+ALCAFull_2017+HARVESTFull_2017.log

10024.0 step2

runTheMatrix-results/10024.0_TTbar_13+TTbar_13TeV_TuneCUETP8M1_2017_GenSimFull+DigiFull_2017+RecoFull_2017+ALCAFull_2017+HARVESTFull_2017/step2_TTbar_13+TTbar_13TeV_TuneCUETP8M1_2017_GenSimFull+DigiFull_2017+RecoFull_2017+ALCAFull_2017+HARVESTFull_2017.log

10824.0 step2

runTheMatrix-results/10824.0_TTbar_13+TTbar_13TeV_TuneCUETP8M1_2018_GenSimFull+DigiFull_2018+RecoFull_2018+ALCAFull_2018+HARVESTFull_2018/step2_TTbar_13+TTbar_13TeV_TuneCUETP8M1_2018_GenSimFull+DigiFull_2018+RecoFull_2018+ALCAFull_2018+HARVESTFull_2018.log

• AddOn:

I found errors in the following addon tests:

cmsRun /cvmfs/cms-ib.cern.ch/nweek-02476/slc6_amd64_gcc530/cms/cmssw/CMSSW_9_2_X_2017-06-14-2300/src/HLTrigger/Configuration/test/OnLine_HLT_PRef.py realData=True globalTag=@ inputFiles=@ : FAILED - time: date Thu Jun 15 09:25:16 2017-date Thu Jun 15 09:20:42 2017 s - exit: 18688
cmsRun /cvmfs/cms-ib.cern.ch/nweek-02476/slc6_amd64_gcc530/cms/cmssw/CMSSW_9_2_X_2017-06-14-2300/src/HLTrigger/Configuration/test/OnLine_HLT_PRef.py realData=False globalTag=@ inputFiles=@ : FAILED - time: date Thu Jun 15 09:28:49 2017-date Thu Jun 15 09:20:59 2017 s - exit: 18688

[cmsbuild]

Comparison not run due to runTheMatrix errors (RelVals and Igprof tests were also skipped)

[cmsbuild]

Pull request #19235 was updated. @Martin-Grunewald, @silviodonato, @cmsbuild, @fwyzard, @davidlange6 can you please check and sign again.

[Martin-Grunewald]

please test

[cmsbuild]

The tests are being triggered in jenkins.
https://cmssdt.cern.ch/jenkins/job/ib-any-integration/20589/console Started: 2017/06/15 10:52

[Martin-Grunewald]

addOn tests should be cured by adding missing OnLine_HLT_PRef.py file.

relval tests need an update of GTs for the L1T menu used by the updated HLT menu,
requested here: https://hypernews.cern.ch/HyperNews/CMS/get/calibrations/3001.html

[cmsbuild]

-1

Tested at: 3cc154a

The following merge commits were also included on top of IB + this PR after doing git cms-merge-topic:
41495b4
You can see more details here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-19235/20589/git-log-recent-commits
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-19235/20589/git-merge-result

You can see the results of the tests here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-19235/20589/summary.html

I found follow errors while testing this PR

Failed tests: RelVals

• RelVals:

When I ran the RelVals I found an error in the following worklfows:
10042.0 step2

runTheMatrix-results/10042.0_ZMM_13+ZMM_13TeV_TuneCUETP8M1_2017_GenSimFull+DigiFull_2017+RecoFull_2017+ALCAFull_2017+HARVESTFull_2017/step2_ZMM_13+ZMM_13TeV_TuneCUETP8M1_2017_GenSimFull+DigiFull_2017+RecoFull_2017+ALCAFull_2017+HARVESTFull_2017.log

10024.0 step2

runTheMatrix-results/10024.0_TTbar_13+TTbar_13TeV_TuneCUETP8M1_2017_GenSimFull+DigiFull_2017+RecoFull_2017+ALCAFull_2017+HARVESTFull_2017/step2_TTbar_13+TTbar_13TeV_TuneCUETP8M1_2017_GenSimFull+DigiFull_2017+RecoFull_2017+ALCAFull_2017+HARVESTFull_2017.log

10824.0 step2

runTheMatrix-results/10824.0_TTbar_13+TTbar_13TeV_TuneCUETP8M1_2018_GenSimFull+DigiFull_2018+RecoFull_2018+ALCAFull_2018+HARVESTFull_2018/step2_TTbar_13+TTbar_13TeV_TuneCUETP8M1_2018_GenSimFull+DigiFull_2018+RecoFull_2018+ALCAFull_2018+HARVESTFull_2018.log

The following merge commits were also included on top of IB + this PR after doing git cms-merge-topic:
41495b4
You can see more details here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-19235/20589/git-log-recent-commits
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-19235/20589/git-merge-result

[cmsbuild]

Comparison not run due to runTheMatrix errors (RelVals and Igprof tests were also skipped)

[franzoni]

@rekovic reported at AlCa/Db meeting of reproducing locally the problem and indeed ZeroBias not firing. The origin is under investigation , an ETA for the fix in the making.

Given the other parallel condition integration fronts
what we propose is to sign this PR and have it merged even though the L1 menu is sub-performant. Benefits are that we do get the HLT updates and we can in parallel integrate PF calibrations.
We'll provide a GT update with the fix to the L1T menu as soon as available.

@Martin-Grunewald @rekovic @arunhep @kkotov
agreed to this proposal.

[franzoni]

+1

[cmsbuild]

This pull request is fully signed and it will be integrated in one of the next master IBs (tests are also fine). This pull request requires discussion in the ORP meeting before it's merged. @davidlange6, @smuzaffar

[davidlange6]

+1

[mmusich]

@franzoni

Given the other parallel condition integration fronts
what we propose is to sign this PR and have it merged even though the L1 menu is sub-performant. Benefits are that we do get the HLT updates and we can in parallel integrate PF calibrations.
We'll provide a GT update with the fix to the L1T menu as soon as available.

I hope this enters the next release, otherwise it will be difficult to validate on the Strips side @boudoul

[fwyzard]

Hi people,
sorry, but I miss one detail: which workflow was working before, and is broken by this PR ?

[fwyzard]

Nevermind, Vladimir pointed me to 10024.0 .

[Martin-Grunewald]

@davidlange6
Is this PR integrated in 92X or 93X or both?

[fwyzard]

CMSSW_9_3_X

[Martin-Grunewald]

thanks!

[rekovic]

Looking at this issue and keeping track of it here
cms-l1t-offline#571

[franzoni]

I hope this enters the next release, otherwise it will be difficult to validate on the Strips side @boudoul

Alca will integrate the fix as soon as available, if, as it seems to date, the origin is the l1 menu
ETA will be provided by L1T team as soon as they'll have it
The goal is for the moment still having L1T and hlt updated to 2017 for the V1 dog-pog mc campaign

[hatakeyamak]

@deguio can you confirm that this is not part of the hcal validation suite?:

https://github.com/cms-sw/cmssw/blob/CMSSW_9_2_X/Validation/GlobalRecHits/src/GlobalRecHitsAnalyzer.cc
is not a part of the HCAL release validation. I am not sure who uses it.

[Dr15Jones]

I think that this pull request may be what is causing the RleVal failure for 1325.0.
https://cmssdt.cern.ch/SDT/cgi-bin/buildlogs/slc7_amd64_gcc530/CMSSW_9_3_X_2017-06-26-2300/pyRelValMatrixLogs/run/1325.0_TTbar_13+TTbar_13INPUT+DIGIUP15+RECOUP15+HARVESTUP15+ALCATTUP15/step5_TTbar_13+TTbar_13INPUT+DIGIUP15+RECOUP15+HARVESTUP15+ALCATTUP15.log

The failure does not happen in 9_2 but does start with the first 9_3. Can anyone confirm or refute the connection?

[Martin-Grunewald]

Correct - that wf uses HLT:@relval2016 which now redirects to the Fake2 menu containing just a few basic paths. BTW, the filter throwing the exception in question can be configured to print a MessageLogger LogInfo message rather than throw an exception; I suggest doing so, or of course updating the requested pattern "AlCa_EcalPhiSym*"

[Martin-Grunewald]

L1_ZeroBias fix - PR is #19492

[arunhep]

Summary of changes in Global Tags

RunII data

• RunII HLT relval processing : 92X_dataRun2_HLT_relval_v1 as 91X_dataRun2_HLT_relval_v3 with the following changes:
  • update of L1T menu for 2017

Upgrade

• PhaseII realistic scenario : 91X_upgrade2023_realistic_v5 as 91X_upgrade2023_realistic_v3 with the following changes:

  • update of L1T menu for 2017
  • update of L1 caloParams

• PhaseI 2017 cosmics peak scenario : 92X_upgrade2017cosmics_realistic_peak_v4 as 92X_upgrade2017cosmics_realistic_peak_v2 with the following changes:

  • update of L1T menu for 2017
  • update of L1T calibrations

• PhaseI 2017 cosmics scenario : 92X_upgrade2017cosmics_realistic_deco_v4 as 92X_upgrade2017cosmics_realistic_deco_v2 with the following changes:

  • update of L1T menu for 2017
  • update of L1T calibrations

• PhaseI 2017 design scenario : 92X_upgrade2017_design_IdealBS_v4 as 92X_upgrade2017_design_IdealBS_v2 with the following changes:

  • update of L1T menu for 2017
  • update of L1T calibrations

• PhaseI 2017 realistic scenario : 92X_upgrade2017_realistic_v4 as 92X_upgrade2017_realistic_v2 with the following changes:

  • update of L1T menu for 2017
  • update of L1T calibrations

• PhaseI 2018 cosmics scenario : 92X_upgrade2018cosmics_realistic_deco_v4 as 92X_upgrade2018cosmics_realistic_deco_v2 with the following changes:

  • update of L1T menu for 2017
  • update of L1T calibrations

• PhaseI 2018 design scenario : 92X_upgrade2018_design_IdealBS_v3 as 92X_upgrade2018_design_IdealBS_v1 with the following changes:

  • update of L1T menu for 2017
  • update of L1T calibrations

• PhaseI 2018 realistic scenario : 92X_upgrade2018_realistic_v4 as 92X_upgrade2018_realistic_v2 with the following changes:

  • update of L1T menu for 2017
  • update of L1T calibrations