HLT menu migration to CMSSW 12_0_0_pre5 template [12_1_X] #34740

Martin-Grunewald · 2021-08-03T12:18:42Z

PR description:

HLT menu migration to CMSSW 12_0_0_pre5 template [12_1_X]

PR validation:

TSG tests

if this PR is a backport please specify the original PR and why you need to backport that PR:

N/A

Martin-Grunewald · 2021-08-03T12:21:07Z

please test

cmsbuild · 2021-08-03T12:25:30Z

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-34740/24393

This PR adds an extra 952KB to repository
There are other open Pull requests which might conflict with changes you have proposed:
- File HLTrigger/Configuration/python/customizeHLTforCMSSW.py modified in PR(s): Update DT DQM, calibration scripts, and local reco code to allow using "new" DB format #34612

cmsbuild · 2021-08-03T12:25:53Z

A new Pull Request was created by @Martin-Grunewald (Martin Grunewald) for master.

It involves the following packages:

HLTrigger/Configuration (hlt)

@Martin-Grunewald can you please review it and eventually sign? Thanks.
@silviodonato, @dpiparo, @qliphy, @perrotta you are the release manager for this.

cms-bot commands are listed here

cmsbuild · 2021-08-03T13:32:11Z

-1

Failed Tests: RelVals RelVals-INPUT AddOn
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-9eb401/17462/summary.html
COMMIT: 37739b5
CMSSW: CMSSW_12_1_X_2021-08-02-2300/slc7_amd64_gcc900
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmssw/34740/17462/install.sh to create a dev area with all the needed externals and cmssw changes.

RelVals

11634.0

----- Begin Fatal Exception 03-Aug-2021 14:54:56 CEST-----------------------
An exception of category 'EventSetupConflict' occurred while
   [0] Calling beginJob
Exception Message:
two EventSetup Producers want to deliver type="PTrackerAdditionalParametersPerDet" label=""
 from record PTrackerAdditionalParametersPerDetRcd. The two providers are 
1) type="TrackerAdditionalParametersPerDetESModule" label=""
2) type="TrackerAdditionalParametersPerDetESModule" label="TrackerAdditionalParametersPerDet"
Please either
   remove one of these Producers
   or find a way of configuring one of them so it does not deliver this data
   or use an es_prefer statement in the configuration to choose one.
----- End Fatal Exception -------------------------------------------------

11634.911

----- Begin Fatal Exception 03-Aug-2021 14:56:06 CEST-----------------------
An exception of category 'EventSetupConflict' occurred while
   [0] Calling beginJob
Exception Message:
two EventSetup Producers want to deliver type="PTrackerAdditionalParametersPerDet" label=""
 from record PTrackerAdditionalParametersPerDetRcd. The two providers are 
1) type="TrackerAdditionalParametersPerDetESModule" label=""
2) type="TrackerAdditionalParametersPerDetESModule" label="TrackerAdditionalParametersPerDet"
Please either
   remove one of these Producers
   or find a way of configuring one of them so it does not deliver this data
   or use an es_prefer statement in the configuration to choose one.
----- End Fatal Exception -------------------------------------------------

12434.0

----- Begin Fatal Exception 03-Aug-2021 14:56:14 CEST-----------------------
An exception of category 'EventSetupConflict' occurred while
   [0] Calling beginJob
Exception Message:
two EventSetup Producers want to deliver type="PTrackerAdditionalParametersPerDet" label=""
 from record PTrackerAdditionalParametersPerDetRcd. The two providers are 
1) type="TrackerAdditionalParametersPerDetESModule" label=""
2) type="TrackerAdditionalParametersPerDetESModule" label="TrackerAdditionalParametersPerDet"
Please either
   remove one of these Producers
   or find a way of configuring one of them so it does not deliver this data
   or use an es_prefer statement in the configuration to choose one.
----- End Fatal Exception -------------------------------------------------

Expand to see more relval errors ...

11634.912

RelVals-INPUT

158.1158.1_QCD_Pt_80_120_13_HI+QCD_Pt_80_120_13_HIINPUT+DIGIHI2018PPRECO+RECOHI2018PPRECO+HARVESTHI2018PPRECO/step2_QCD_Pt_80_120_13_HI+QCD_Pt_80_120_13_HIINPUT+DIGIHI2018PPRECO+RECOHI2018PPRECO+HARVESTHI2018PPRECO.log
158.2158.2_PhotonJets_Pt_10_13_HI+PhotonJets_Pt_10_13_HIINPUT+DIGIHI2018PPRECO+RECOHI2018PPRECO+HARVESTHI2018PPRECO/step2_PhotonJets_Pt_10_13_HI+PhotonJets_Pt_10_13_HIINPUT+DIGIHI2018PPRECO+RECOHI2018PPRECO+HARVESTHI2018PPRECO.log
158.3158.3_ZEEMM_13_HI+ZEEMM_13_HIINPUT+DIGIHI2018PPRECO+RECOHI2018PPRECO+HARVESTHI2018PPRECO/step2_ZEEMM_13_HI+ZEEMM_13_HIINPUT+DIGIHI2018PPRECO+RECOHI2018PPRECO+HARVESTHI2018PPRECO.log

Expand to see more relval errors ...

AddOn Tests

hlt_mc_GRun

----- Begin Fatal Exception 03-Aug-2021 14:49:00 CEST-----------------------
An exception of category 'EventSetupConflict' occurred while
   [0] Calling beginJob
Exception Message:
two EventSetup Producers want to deliver type="PTrackerAdditionalParametersPerDet" label=""
 from record PTrackerAdditionalParametersPerDetRcd. The two providers are 
1) type="TrackerAdditionalParametersPerDetESModule" label=""
2) type="TrackerAdditionalParametersPerDetESModule" label="TrackerAdditionalParametersPerDet"
Please either
   remove one of these Producers
   or find a way of configuring one of them so it does not deliver this data
   or use an es_prefer statement in the configuration to choose one.
----- End Fatal Exception -------------------------------------------------

hlt_mc_HIon

----- Begin Fatal Exception 03-Aug-2021 14:45:33 CEST-----------------------
An exception of category 'EventSetupConflict' occurred while
   [0] Calling beginJob
Exception Message:
two EventSetup Producers want to deliver type="PTrackerAdditionalParametersPerDet" label=""
 from record PTrackerAdditionalParametersPerDetRcd. The two providers are 
1) type="TrackerAdditionalParametersPerDetESModule" label=""
2) type="TrackerAdditionalParametersPerDetESModule" label="TrackerAdditionalParametersPerDet"
Please either
   remove one of these Producers
   or find a way of configuring one of them so it does not deliver this data
   or use an es_prefer statement in the configuration to choose one.
----- End Fatal Exception -------------------------------------------------

hlt_mc_PIon

----- Begin Fatal Exception 03-Aug-2021 14:44:36 CEST-----------------------
An exception of category 'EventSetupConflict' occurred while
   [0] Calling beginJob
Exception Message:
two EventSetup Producers want to deliver type="PTrackerAdditionalParametersPerDet" label=""
 from record PTrackerAdditionalParametersPerDetRcd. The two providers are 
1) type="TrackerAdditionalParametersPerDetESModule" label=""
2) type="TrackerAdditionalParametersPerDetESModule" label="TrackerAdditionalParametersPerDet"
Please either
   remove one of these Producers
   or find a way of configuring one of them so it does not deliver this data
   or use an es_prefer statement in the configuration to choose one.
----- End Fatal Exception -------------------------------------------------

Expand to see more addon errors ...

Martin-Grunewald · 2021-08-03T14:52:07Z

please test

cmsbuild · 2021-08-03T14:57:03Z

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-34740/24408

This PR adds an extra 528KB to repository
There are other open Pull requests which might conflict with changes you have proposed:
- File HLTrigger/Configuration/python/customizeHLTforCMSSW.py modified in PR(s): Update DT DQM, calibration scripts, and local reco code to allow using "new" DB format #34612

cmsbuild · 2021-08-03T18:11:54Z

+1

Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-9eb401/17473/summary.html
COMMIT: 10cf748
CMSSW: CMSSW_12_1_X_2021-08-02-2300/slc7_amd64_gcc900
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmssw/34740/17473/install.sh to create a dev area with all the needed externals and cmssw changes.

Comparison Summary

The workflows 140.53 have different files in step1_dasquery.log than the ones found in the baseline. You may want to check and retrigger the tests if necessary. You can check it in the "files" directory in the results of the comparisons

Summary:

No significant changes to the logs found
Reco comparison results: 1299 differences found in the comparisons
DQMHistoTests: Total files compared: 39
DQMHistoTests: Total histograms compared: 2998558
DQMHistoTests: Total failures: 3672
DQMHistoTests: Total nulls: 19
DQMHistoTests: Total successes: 2994845
DQMHistoTests: Total skipped: 22
DQMHistoTests: Total Missing objects: 0
DQMHistoSizes: Histogram memory added: -45.703 KiB( 38 files compared)
DQMHistoSizes: changed ( 140.53 ): -44.531 KiB Hcal/DigiRunHarvesting
DQMHistoSizes: changed ( 140.53 ): -1.172 KiB RPC/DCSInfo
Checked 165 log files, 37 edm output root files, 39 DQM output files
TriggerResults: found differences in 4 / 38 workflows

Dr15Jones · 2021-08-03T21:51:37Z

Please test

cmsbuild · 2021-08-04T02:35:03Z

-1

Failed Tests: RelVals-INPUT
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-9eb401/17493/summary.html
COMMIT: 10cf748
CMSSW: CMSSW_12_1_X_2021-08-03-1100/slc7_amd64_gcc900
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmssw/34740/17493/install.sh to create a dev area with all the needed externals and cmssw changes.

RelVals-INPUT

11630.011630.0_QCD_Pt_3000_3500_14TeV+2021+QCD_Pt_3000_3500_14TeV_TuneCUETP8M1_GenSimINPUT+Digi+Reco+HARVEST+ALCA/step2_QCD_Pt_3000_3500_14TeV+2021+QCD_Pt_3000_3500_14TeV_TuneCUETP8M1_GenSimINPUT+Digi+Reco+HARVEST+ALCA.log
11602.011602.0_SingleElectronPt35+2021+SingleElectronPt35_pythia8_GenSimINPUT+Digi+Reco+HARVEST+ALCA/step2_SingleElectronPt35+2021+SingleElectronPt35_pythia8_GenSimINPUT+Digi+Reco+HARVEST+ALCA.log
11601.011601.0_SingleElectronPt10+2021+SingleElectronPt10_pythia8_GenSimINPUT+Digi+Reco+HARVEST+ALCA/step2_SingleElectronPt10+2021+SingleElectronPt10_pythia8_GenSimINPUT+Digi+Reco+HARVEST+ALCA.log

Expand to see more relval errors ...

Comparison Summary

Summary:

No significant changes to the logs found
Reco comparison results: 0 differences found in the comparisons
DQMHistoTests: Total files compared: 39
DQMHistoTests: Total histograms compared: 2998558
DQMHistoTests: Total failures: 1
DQMHistoTests: Total nulls: 0
DQMHistoTests: Total successes: 2998535
DQMHistoTests: Total skipped: 22
DQMHistoTests: Total Missing objects: 0
DQMHistoSizes: Histogram memory added: 0.0 KiB( 38 files compared)
Checked 165 log files, 37 edm output root files, 39 DQM output files
TriggerResults: found differences in 4 / 38 workflows

Dr15Jones · 2021-08-04T03:23:35Z

Please test

Martin-Grunewald · 2021-08-04T06:58:55Z

+1

cmsbuild · 2021-08-04T06:59:22Z

This pull request is fully signed and it will be integrated in one of the next master IBs after it passes the integration tests. This pull request will now be reviewed by the release team before it's merged. @silviodonato, @dpiparo, @qliphy, @perrotta (and backports should be raised in the release meeting by the corresponding L2)

cmsbuild · 2021-08-04T09:32:12Z

+1

Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-9eb401/17497/summary.html
COMMIT: 10cf748
CMSSW: CMSSW_12_1_X_2021-08-03-2300/slc7_amd64_gcc900
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmssw/34740/17497/install.sh to create a dev area with all the needed externals and cmssw changes.

Comparison Summary

Summary:

No significant changes to the logs found
Reco comparison results: 4 differences found in the comparisons
DQMHistoTests: Total files compared: 39
DQMHistoTests: Total histograms compared: 2998558
DQMHistoTests: Total failures: 7
DQMHistoTests: Total nulls: 0
DQMHistoTests: Total successes: 2998529
DQMHistoTests: Total skipped: 22
DQMHistoTests: Total Missing objects: 0
DQMHistoSizes: Histogram memory added: 0.0 KiB( 38 files compared)
Checked 165 log files, 37 edm output root files, 39 DQM output files
TriggerResults: found differences in 4 / 38 workflows

perrotta · 2021-08-04T10:26:13Z

+1

HLT menu migration to CMSSW 12_0_0_pre5

37739b5

cmsbuild added this to the CMSSW_12_1_X milestone Aug 3, 2021

cmsbuild added code-checks-pending hlt-pending orp-pending pending-signatures tests-pending labels Aug 3, 2021

Martin-Grunewald mentioned this pull request Aug 3, 2021

HLT menu migration to CMSSW 12_0_0_pre5 template [12_0_X] #34741

Merged

cmsbuild added tests-started and removed tests-pending labels Aug 3, 2021

Martin-Grunewald mentioned this pull request Aug 3, 2021

Rewrote checkForModuleDependencyCorrectness #34735

Merged

cmsbuild added code-checks-approved and removed code-checks-pending labels Aug 3, 2021

cmsbuild added tests-rejected and removed tests-started labels Aug 3, 2021

HLT menu migration to CMSSW 12_0_0_pre5

10cf748

cmsbuild added code-checks-pending tests-pending and removed code-checks-approved tests-rejected labels Aug 3, 2021

cmsbuild added tests-started and removed tests-pending labels Aug 3, 2021

cmsbuild added code-checks-approved and removed code-checks-pending labels Aug 3, 2021

cmsbuild added tests-approved and removed tests-started labels Aug 3, 2021

cmsbuild added tests-started and removed tests-approved labels Aug 3, 2021

cmsbuild added tests-rejected and removed tests-started labels Aug 4, 2021

cmsbuild added tests-started and removed tests-rejected labels Aug 4, 2021

cmsbuild added fully-signed hlt-approved and removed hlt-pending pending-signatures labels Aug 4, 2021

cmsbuild added tests-approved and removed tests-started labels Aug 4, 2021

cmsbuild added orp-approved and removed orp-pending labels Aug 4, 2021

cmsbuild merged commit 2164b1a into cms-sw:master Aug 4, 2021

Martin-Grunewald deleted the HLTmigrationTo1200pre5 branch October 27, 2021 07:51

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

HLT menu migration to CMSSW 12_0_0_pre5 template [12_1_X] #34740

HLT menu migration to CMSSW 12_0_0_pre5 template [12_1_X] #34740

Martin-Grunewald commented Aug 3, 2021

Martin-Grunewald commented Aug 3, 2021

cmsbuild commented Aug 3, 2021

cmsbuild commented Aug 3, 2021

cmsbuild commented Aug 3, 2021

Martin-Grunewald commented Aug 3, 2021

cmsbuild commented Aug 3, 2021

cmsbuild commented Aug 3, 2021

Dr15Jones commented Aug 3, 2021

cmsbuild commented Aug 4, 2021

Dr15Jones commented Aug 4, 2021

Martin-Grunewald commented Aug 4, 2021

cmsbuild commented Aug 4, 2021

cmsbuild commented Aug 4, 2021

perrotta commented Aug 4, 2021

HLT menu migration to CMSSW 12_0_0_pre5 template [12_1_X] #34740

HLT menu migration to CMSSW 12_0_0_pre5 template [12_1_X] #34740

Conversation

Martin-Grunewald commented Aug 3, 2021

PR description:

PR validation:

if this PR is a backport please specify the original PR and why you need to backport that PR:

Martin-Grunewald commented Aug 3, 2021

cmsbuild commented Aug 3, 2021

cmsbuild commented Aug 3, 2021

cmsbuild commented Aug 3, 2021

RelVals

RelVals-INPUT

AddOn Tests

Martin-Grunewald commented Aug 3, 2021

cmsbuild commented Aug 3, 2021

cmsbuild commented Aug 3, 2021

Comparison Summary

Dr15Jones commented Aug 3, 2021

cmsbuild commented Aug 4, 2021

RelVals-INPUT

Comparison Summary

Dr15Jones commented Aug 4, 2021

Martin-Grunewald commented Aug 4, 2021

cmsbuild commented Aug 4, 2021

cmsbuild commented Aug 4, 2021

Comparison Summary

perrotta commented Aug 4, 2021