Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

HLT menu development for 14_0_X (5/N) [14_1_X] #44717

Merged
merged 7 commits into from
Apr 12, 2024

Conversation

mmusich
Copy link
Contributor

@mmusich mmusich commented Apr 11, 2024

PR description:

Development of HLT menus for CMSSW_14_0_X (branch CMSSW_14_1_X).

  • This is the PR for the master branch, which will then be backported down to 14_0_X (the latter is the release cycle currently used for Run-3 HLT-menu development).
  • This version of the GRun HLT menu corresponds to the list of updates to the "V1.1" menu for the 2024 pp data-taking period.

This update includes the integration of the following JIRA tickets:

  • CMSHLT-3087 [HIG] New HLT Path (low pT single lepton + HT + B-tag) for HH to bbWW for 2024
  • CMSHLT-3104 [BTV] Migration of MC_PFBTag to ParticleNet
  • CMSHLT-3110 [HIG] Moving HLT_QuadJet* control paths to ParkingVBF
  • CMSHLT-3119 [EXO] Migration of the QuadPFJet with 3 B-tag trigger to Particle Net
  • CMSHLT-3120 [JME] Adding Dimuon+Jets & Photon+Jets paths for monitoring (CaloJet/Ak8PFJet/Ak8CaloJet)
  • CMSHLT-3122 [EXO] Adding new barrel-only displaced single muon paths
  • CMSHLT-3125 [TSG] Integrate Alpaka version of Status_On* Paths and Pixel local+track+vertex reconstruction
  • CMSHLT-3127 [BTV] Set PS=0 for HLT_Mu8_*_Ele23_*_PFBtagDeepJet_*_v
  • CMSHLT-3132 [TSG] Enforce a naming convention for Alpaka-related modules and their "SerialSync" variants
  • CMSHLT-3133 [TSG] Add PS column "2p0E34_NoScouting"
  • CMSHLT-3134 [TSG] Technical: "drop" statement in EventContents of Calibration, EcalCalibration and HLTMonitor streams
  • CMSHLT-3135 [TSG] Fix "prescale offsets" of Special* PDs
  • CMSHLT-3136 [TSG] Remove unused global PSets (post Run2023)
  • CMSHLT-3138 [Scouting] Update of the smart prescale of the DoubleEG path in the ScoutingPFMonitor PD
  • CMSHLT-3140 [TSG] Set smartPS=1 for HLT_ZeroBias_Alignment_v in ExpressPhysics
  • CMSHLT-3141 [TRK] Add Doublet-Recovery Track collection to EventContent of DQM stream
  • CMSHLT-3142 [TSG/EXO] Fix crashes from hltDisplacedhltIter4PixelLessHitDoubletsForDisplacedTkMuons at start of Run2024B
  • CMSHLT-3144 [PF] Increase hltParticleFlowClusterHBHESoA*.pfRecHitFractionAllocation to 250
  • CMSHLT-3145 [TSG] Disable Ele28+HT and Ele30+Jet cross-triggers
  • CMSHLT-3146 [TSG] Remove (temporarily) paths with reproducibility issues (in PRef and HIon)
  • CMSHLT-3150 [PF] Modify DQMGPUvsCPU EventContent to include hltParticleFlowClusterHCAL and SerialSync version
  • CMSHLT-3151 [TSG] Backport of online updates to cosmics and circulating menus (V1.1)

Also, move the HLT release template to CMSSW_14_0_5, remove customizeHLTfor44597

In addition, the following changes are included:

  • d518462: update customizeHLTforAlpakaPixelReco
  • a36ab43: equip HLT offline customization function to remove unnecessary strain on Frontier
  • 0108c38: update of L1T FULL,GRun,2024v10,Special menus in TSG GTs to L1Menu_Collisions2024_v1_1_0_xml
  • a36b697: update the list of HLT path owners: menu 2024 V1.1
  • 7ae4b6e: added customizeHLTforAlpakaRename and removed customizeHLTforAlpaka calls in customizeHLTforCMSSW
  • e467a17: Introduce 2024v1.1 frozen menu and remove 2024v1.0

PR validation:

TSG Integration tests

If this PR is a backport please specify the original PR and why you need to backport that PR. If this PR will be backported please specify to which release cycle the backport is meant for:

Not a backport, but it will be backported to CMSSW_14_0_X.

mmusich and others added 7 commits April 11, 2024 22:44
This version of the GRun HLT menu corresponds to the list of updates to the "V1.1" menu for the 2024 pp data-taking period.
This update includes the integration of the following JIRA tickets:
- [CMSHLT-3087](https://its.cern.ch/jira/browse/CMSHLT-3087) [HIG] New HLT Path (low pT single lepton + HT + B-tag) for HH to bbWW for 2024
- [CMSHLT-3104](https://its.cern.ch/jira/browse/CMSHLT-3104) [BTV] Migration of MC_PFBTag to ParticleNet
- [CMSHLT-3110](https://its.cern.ch/jira/browse/CMSHLT-3110) [HIG] Moving HLT_QuadJet* control paths to ParkingVBF
- [CMSHLT-3119](https://its.cern.ch/jira/browse/CMSHLT-3119) [EXO] Migration of the QuadPFJet with 3 B-tag trigger to Particle Net
- [CMSHLT-3120](https://its.cern.ch/jira/browse/CMSHLT-3120) [JME] Adding Dimuon+Jets & Photon+Jets paths for monitoring (CaloJet/Ak8PFJet/Ak8CaloJet)
- [CMSHLT-3122](https://its.cern.ch/jira/browse/CMSHLT-3122) [EXO] Adding new barrel-only displaced single muon paths
- [CMSHLT-3125](https://its.cern.ch/jira/browse/CMSHLT-3125) [TSG] Integrate Alpaka version of Status_On* Paths and Pixel local+track+vertex reconstruction
- [CMSHLT-3127](https://its.cern.ch/jira/browse/CMSHLT-3127) [BTV] Set PS=0 for HLT_Mu8_*_Ele23_*_PFBtagDeepJet_*_v
- [CMSHLT-3132](https://its.cern.ch/jira/browse/CMSHLT-3132) [TSG] Enforce a naming convention for Alpaka-related modules and their "SerialSync" variants
- [CMSHLT-3133](https://its.cern.ch/jira/browse/CMSHLT-3133) [TSG] Add PS column "2p0E34_NoScouting"
- [CMSHLT-3134](https://its.cern.ch/jira/browse/CMSHLT-3134) [TSG] Technical: "drop" statement in EventContents of Calibration, EcalCalibration and HLTMonitor streams
- [CMSHLT-3135](https://its.cern.ch/jira/browse/CMSHLT-3135) [TSG] Fix "prescale offsets" of Special* PDs
- [CMSHLT-3136](https://its.cern.ch/jira/browse/CMSHLT-3136) [TSG] Remove unused global PSets (post Run2023)
- [CMSHLT-3138](https://its.cern.ch/jira/browse/CMSHLT-3138) [Scouting] Update of the smart prescale of the DoubleEG path in the ScoutingPFMonitor PD
- [CMSHLT-3140](https://its.cern.ch/jira/browse/CMSHLT-3140) [TSG] Set smartPS=1 for HLT_ZeroBias_Alignment_v in ExpressPhysics
- [CMSHLT-3141](https://its.cern.ch/jira/browse/CMSHLT-3141) [TRK] Add Doublet-Recovery Track collection to EventContent of DQM stream
- [CMSHLT-3142](https://its.cern.ch/jira/browse/CMSHLT-3142) [TSG/EXO] Fix crashes from hltDisplacedhltIter4PixelLessHitDoubletsForDisplacedTkMuons at start of Run2024B
- [CMSHLT-3144](https://its.cern.ch/jira/browse/CMSHLT-3144) [PF] Increase hltParticleFlowClusterHBHESoA*.pfRecHitFractionAllocation to 250
- [CMSHLT-3145](https://its.cern.ch/jira/browse/CMSHLT-3145) [TSG] Disable Ele28+HT and Ele30+Jet cross-triggers
- [CMSHLT-3146](https://its.cern.ch/jira/browse/CMSHLT-3146) [TSG] Remove (temporarily) paths with reproducibility issues (in PRef and HIon)
- [CMSHLT-3150](https://its.cern.ch/jira/browse/CMSHLT-3150) [PF] Modify DQMGPUvsCPU EventContent to include hltParticleFlowClusterHCAL and SerialSync version
- [CMSHLT-3151](https://its.cern.ch/jira/browse/CMSHLT-3151) [TSG] Backport of online updates to cosmics and circulating menus (V1.1)

Also, move the HLT release template to CMSSW_14_0_5, remove customizeHLTfor44597
Co-authored-by: missirol <m.missiroli@cern.ch>
… on Frontier

- see [CMSHLT-3123](https://its.cern.ch/jira/browse/CMSHLT-3123) [TSG] Remove refreshing of Frontier conditions for offline processing
@mmusich
Copy link
Contributor Author

mmusich commented Apr 11, 2024

type hlt-integration

@cmsbuild
Copy link
Contributor

cmsbuild commented Apr 11, 2024

cms-bot internal usage

@mmusich
Copy link
Contributor Author

mmusich commented Apr 11, 2024

enable gpu

@mmusich
Copy link
Contributor Author

mmusich commented Apr 11, 2024

@cmsbuild, please test

@cmsbuild
Copy link
Contributor

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-44717/39919

@cmsbuild
Copy link
Contributor

A new Pull Request was created by @mmusich for master.

It involves the following packages:

  • Configuration/HLT (hlt)
  • HLTrigger/Configuration (hlt)

@mmusich, @Martin-Grunewald can you please review it and eventually sign? Thanks.
@silviodonato, @fabiocos, @missirol, @Martin-Grunewald this is something you requested to watch as well.
@antoniovilela, @rappoccio, @sextonkennedy you are the release manager for this.

cms-bot commands are listed here

@cmsbuild
Copy link
Contributor

+1

Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-277853/38797/summary.html
COMMIT: e467a17
CMSSW: CMSSW_14_1_X_2024-04-11-1100/el8_amd64_gcc12
Additional Tests: GPU
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmssw/44717/38797/install.sh to create a dev area with all the needed externals and cmssw changes.

Comparison Summary

Summary:

  • You potentially removed 2 lines from the logs
  • ROOTFileChecks: Some differences in event products or their sizes found
  • Reco comparison results: 48 differences found in the comparisons
  • DQMHistoTests: Total files compared: 48
  • DQMHistoTests: Total histograms compared: 3304360
  • DQMHistoTests: Total failures: 3167
  • DQMHistoTests: Total nulls: 87
  • DQMHistoTests: Total successes: 3301086
  • DQMHistoTests: Total skipped: 20
  • DQMHistoTests: Total Missing objects: 0
  • DQMHistoSizes: Histogram memory added: 616.119 KiB( 47 files compared)
  • DQMHistoSizes: changed ( 12834.0,... ): 130.517 KiB HLT/HLTEgammaValidation
  • DQMHistoSizes: changed ( 12834.0,... ): 13.436 KiB HLT/Filters
  • DQMHistoSizes: changed ( 139.001,... ): 0.001 KiB HLT/Filters
  • Checked 202 log files, 165 edm output root files, 48 DQM output files
  • TriggerResults: found differences in 4 / 46 workflows

GPU Comparison Summary

Summary:

  • No significant changes to the logs found
  • Reco comparison results: 8 differences found in the comparisons
  • DQMHistoTests: Total files compared: 3
  • DQMHistoTests: Total histograms compared: 39740
  • DQMHistoTests: Total failures: 326
  • DQMHistoTests: Total nulls: 0
  • DQMHistoTests: Total successes: 39414
  • DQMHistoTests: Total skipped: 0
  • DQMHistoTests: Total Missing objects: 0
  • DQMHistoSizes: Histogram memory added: 0.0 KiB( 2 files compared)
  • Checked 8 log files, 10 edm output root files, 3 DQM output files
  • TriggerResults: no differences found

@mmusich
Copy link
Contributor Author

mmusich commented Apr 12, 2024

+hlt

@cmsbuild
Copy link
Contributor

This pull request is fully signed and it will be integrated in one of the next master IBs (tests are also fine). This pull request will now be reviewed by the release team before it's merged. @antoniovilela, @rappoccio, @sextonkennedy (and backports should be raised in the release meeting by the corresponding L2)

@rappoccio
Copy link
Contributor

+1

@cmsbuild cmsbuild merged commit e21c749 into cms-sw:master Apr 12, 2024
14 checks passed
@mmusich mmusich deleted the HLTdevelopment140X_for141X branch April 12, 2024 21:02
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

4 participants