Fix prodlike workflows

[kskovpen]

PR description:

Hopefully, fixes #35966

PR validation:

Tested on standard and prodlike wfs

if this PR is a backport please specify the original PR and why you need to backport that PR:

Not a backport

[cmsbuild]

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-36050/26511

• This PR adds an extra 12KB to repository

[cmsbuild]

A new Pull Request was created by @kskovpen for master.

It involves the following packages:

• Configuration/PyReleaseValidation (pdmv, upgrade)

@jordan-martins, @bbilin, @wajidalikhan, @cmsbuild, @AdrianoDee, @srimanob, @kskovpen can you please review it and eventually sign? Thanks.
@makortel, @kpedro88, @Martin-Grunewald, @missirol, @fabiocos, @slomeo this is something you requested to watch as well.
@perrotta, @dpiparo, @qliphy you are the release manager for this.

cms-bot commands are listed here

[kskovpen]

assign reconstruction

[kskovpen]

please test

[cmsbuild]

New categories assigned: reconstruction

@slava77,@jpata you have been requested to review this Pull request/Issue and eventually sign? Thanks

[cmsbuild]

-1

Failed Tests: RelVals
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-6d03ff/20362/summary.html
COMMIT: da36f62
CMSSW: CMSSW_12_2_X_2021-11-08-2300/slc7_amd64_gcc900
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmssw/36050/20362/install.sh to create a dev area with all the needed externals and cmssw changes.

The following merge commits were also included on top of IB + this PR after doing git cms-merge-topic:

• @dan131riley Fix errors in RepeatingCachedRootSource test #36006
• @tvami Change to new method in PoolDBOutputService for SiPixel CPE #36027
• @missirol improvement of a workaround in customizeHLTforPatatrack #36031
• @iarspider Remove references to standalone keras #36032
• @cms-tsg-storm HLT menu development for 12_2_X #36034
• @Dr15Jones Fixed crash in RepeatingCachedRootSource #36042
• @Sam-Harper Adding Proxy Support to hltGetConfiguration and fixing converter/db specification bugs with hltIntegrationTests #35987

You can see more details here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-6d03ff/20362/git-recent-commits.json
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-6d03ff/20362/git-merge-result

RelVals

• 11634.911

----- Begin Fatal Exception 09-Nov-2021 10:59:58 CET-----------------------
An exception of category 'PluginNotFound' occurred while
   [0] Constructing the EventProcessor
Exception Message:
Unable to find plugin 'EcalBarrelGeometryEPdd4hep' in category 'CMS EDM Framework ParameterSet Description'. Please check spelling of name.
----- End Fatal Exception -------------------------------------------------

[srimanob]

@cmsbuild please test with #36021

[cmsbuild]

+1

Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-6d03ff/20364/summary.html
COMMIT: da36f62
CMSSW: CMSSW_12_2_X_2021-11-08-2300/slc7_amd64_gcc900
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmssw/36050/20364/install.sh to create a dev area with all the needed externals and cmssw changes.

The following merge commits were also included on top of IB + this PR after doing git cms-merge-topic:

• @dan131riley Fix errors in RepeatingCachedRootSource test #36006
• @tvami Change to new method in PoolDBOutputService for SiPixel CPE #36027
• @missirol improvement of a workaround in customizeHLTforPatatrack #36031
• @iarspider Remove references to standalone keras #36032
• @cms-tsg-storm HLT menu development for 12_2_X #36034
• @Dr15Jones Fixed crash in RepeatingCachedRootSource #36042
• @Sam-Harper Adding Proxy Support to hltGetConfiguration and fixing converter/db specification bugs with hltIntegrationTests #35987

You can see more details here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-6d03ff/20364/git-recent-commits.json
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-6d03ff/20364/git-merge-result

Comparison Summary

There are some workflows for which there are errors in the baseline:
11634.911 step 1
The results for the comparisons for these workflows could be incomplete
This means most likely that the IB is having errors in the relvals.The error does NOT come from this pull request

Summary:

• No significant changes to the logs found
• Reco comparison results: 0 differences found in the comparisons
• DQMHistoTests: Total files compared: 41
• DQMHistoTests: Total histograms compared: 2694539
• DQMHistoTests: Total failures: 13
• DQMHistoTests: Total nulls: 0
• DQMHistoTests: Total successes: 2694504
• DQMHistoTests: Total skipped: 22
• DQMHistoTests: Total Missing objects: 0
• DQMHistoSizes: Histogram memory added: 0.0 KiB( 40 files compared)
• Checked 173 log files, 37 edm output root files, 41 DQM output files
• TriggerResults: found differences in 4 / 40 workflows

[cmsbuild]

Pull request #36050 was updated. @jordan-martins, @bbilin, @wajidalikhan, @cmsbuild, @AdrianoDee, @srimanob, @kskovpen, @slava77, @jpata can you please check and sign again.

[kskovpen]

please test

[cmsbuild]

-1

Failed Tests: RelVals
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-6d03ff/20601/summary.html
COMMIT: 2dfd1a9
CMSSW: CMSSW_12_2_X_2021-11-17-2300/slc7_amd64_gcc900
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/36050/20601/install.sh to create a dev area with all the needed externals and cmssw changes.

RelVals

[kpedro88]

@kskovpen this PR is still not consistent with my branch. e.g. having a Reco step that doesn't have Reco in the name ("RecNan") can cause problems for custom workflows that check for this. Please use the consistent implementation that I provided instead of making haphazard changes.

[kpedro88]

some changes from master...kpedro88:Phase2-WF75v2 are still missing here. what is the problem?

[cmsbuild]

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-36050/26723

• This PR adds an extra 60KB to repository

• There are other open Pull requests which might conflict with changes you have proposed:

  • File Configuration/PyReleaseValidation/python/relval_steps.py modified in PR(s): Add PilotBeam data in relval matrix tests #36133, Python3syntaxupgrade #36160, Add DQM Matrix to RelVals #35678
  • File Configuration/PyReleaseValidation/python/upgradeWorkflowComponents.py modified in PR(s): Add run3 tracking low pu era #33532, Phase 2 HLT menu targetting 7.5×10³⁴ cm⁻²s⁻¹ #35342

[cmsbuild]

Pull request #36050 was updated. @jordan-martins, @bbilin, @wajidalikhan, @cmsbuild, @AdrianoDee, @srimanob, @kskovpen, @slava77, @jpata can you please check and sign again.

[kpedro88]

superseded by #36167, please close this.

[cmsbuild]

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-36050/26725

• This PR adds an extra 60KB to repository

• There are other open Pull requests which might conflict with changes you have proposed:

  • File Configuration/PyReleaseValidation/python/relval_steps.py modified in PR(s): Add PilotBeam data in relval matrix tests #36133, Python3syntaxupgrade #36160, consistent implementation of nano step for Run 3 #36167, Add DQM Matrix to RelVals #35678
  • File Configuration/PyReleaseValidation/python/relval_upgrade.py modified in PR(s): consistent implementation of nano step for Run 3 #36167
  • File Configuration/PyReleaseValidation/python/upgradeWorkflowComponents.py modified in PR(s): consistent implementation of nano step for Run 3 #36167, Add run3 tracking low pu era #33532, Phase 2 HLT menu targetting 7.5×10³⁴ cm⁻²s⁻¹ #35342

[cmsbuild]

Pull request #36050 was updated. @jordan-martins, @bbilin, @wajidalikhan, @cmsbuild, @AdrianoDee, @srimanob, @kskovpen, @slava77, @jpata can you please check and sign again.