HLT release validation and offline DQM for EXO Run 3 HLT paths (12_4_X)

[jalimena]

PR description:

This PR is a backport of #38848 (which I didn't realize I needed at the time) and #39799

#38848:

This PR updates the exotica HLT release validation (in HLTriggerOffline/Exotica) and the HLT offline DQM (in DQMOffline/Trigger) to include the new long-lived particle (LLP) paths that went into V1.2 and 1.3 of the Run 3 HLT menu [1]. Complying with the request from STEAM to limit the number of histograms produced, only signal paths are monitored, and not backup or control paths. So, these paths have been added to the monitoring:

HLT_HT170_L1SingleLLPJet_DisplacedDijet40_DisplacedTrack_v (CMSHLT-2280)
HLT_HT320_L1SingleLLPJet_DisplacedDijet60_Inclusive_v (CMSHLT-2280)
HLT_HT200_L1SingleLLPJet_DelayedJet40_SingleDelay1nsTrackless_v (CMSHLT-2280)
HLT_HT200_L1SingleLLPJet_DelayedJet40_DoubleDelay0p5nsTrackless_v (CMSHLT-2280)
HLT_HT200_L1SingleLLPJet_DisplacedDijet30_Inclusive1PtrkShortSig5_v (CMSHLT-2280)

HLT_DiPhoton10Time1p4ns_v (CMSHLT-2280)
HLT_DiPhoton10sminlt0p1_v (CMSHLT-2280)

HLT_DoubleL3dTksMu16_10NoVtx_DxyMin0p01cm_v (CMSHLT-2301, CMSHLT-2326)
HLT_DoubleL3Mu16_10NoVtx_DxyMin0p01cm_v (CMSHLT-2279)
HLT_DoubleL2Mu10NoVtx_2Cha_VetoL3Mu0DxyMax1cm_v (CMSHLT-2279)
HLT_DoubleL2Mu_L3Mu16NoVtx_VetoL3Mu0DxyMax0p1cm_v (CMSHLT-2361) 
HLT_DoubleL2Mu10NoVtx_2Cha_CosmicSeed_VetoL3Mu0DxyMax1cm_v (CMSHLT-2361)

and these paths have been removed (since they have been superseded by some paths above):

HLT_DoubleL3Mu10NoVtx_Displaced_v (CMSHLT-2279)
HLT_DoubleL2Mu10NoVtx_2Cha_PromptL3Mu0Veto_v (CMSHLT-2279)

As a result, some histograms will be added, and a few will be removed.

#39799:

This PR:

1. removes the offline DQM monitoring of two obsolete HLT paths, which are no longer in the 2022 menu: HLT_TrkMu16_DoubleTrkMu6NoFiltersNoVtx_v and HLT_TrkMu17_DoubleTrkMu8NoFiltersNoVtx_v
2. make it not required to have all paths be valid in the numerator and denominator, for the paths monitored in MuonMonitor_cff

The reason for the second part is because in the HLT 2022 v1.3 menu, one of the paths in the denominator was removed. As a result, the DQM plots did not get made, although they would have been fine, physics-wise. Changing this flag to false is the easiest way to have similar DQM plots with the earlier and later HLT menus, and it fixes this bug.

As a result of this PR, some DQM plots will be removed, and some will reappear.

PR validation:

Using the 11634.0 ttbar workflow, I have tested that the correct histograms are produced and filled in the harvested DQM file.

If this PR is a backport please specify the original PR and why you need to backport that PR. If this PR will be backported please specify to which release cycle the backport is meant for:

Backport of #38848 and #39799 . This backport is needed so that the plots show up in the offline DQM GUI, which uses 12_4_X.

[cmsbuild]

A new Pull Request was created by @jalimena (Juliette Alimena) for CMSSW_12_4_X.

It involves the following packages:

• DQMOffline/Trigger (dqm)
• HLTriggerOffline/Exotica (dqm)

@emanueleusai, @ahmad3213, @cmsbuild, @jfernan2, @syuvivida, @pmandrik, @micsucmed, @rvenditti can you please review it and eventually sign? Thanks.
@mtosi, @Fedespring, @missirol, @HuguesBrun, @jhgoh, @trocino, @cericeci, @rociovilar this is something you requested to watch as well.
@perrotta, @dpiparo, @rappoccio you are the release manager for this.

cms-bot commands are listed here

• Backported from Update & bug fix for offline DQM for EXO & HIG Run 3 muon paths #39799

[emanueleusai]

please test

[cmsbuild]

+1

Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-645837/28412/summary.html
COMMIT: 3ac4e7b
CMSSW: CMSSW_12_4_X_2022-10-20-2300/el8_amd64_gcc10
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/39800/28412/install.sh to create a dev area with all the needed externals and cmssw changes.

Comparison Summary

Summary:

• No significant changes to the logs found
• Reco comparison results: 8 differences found in the comparisons
• DQMHistoTests: Total files compared: 50
• DQMHistoTests: Total histograms compared: 3674732
• DQMHistoTests: Total failures: 19
• DQMHistoTests: Total nulls: 7
• DQMHistoTests: Total successes: 3674684
• DQMHistoTests: Total skipped: 22
• DQMHistoTests: Total Missing objects: 0
• DQMHistoSizes: Histogram memory added: 26027.395999999997 KiB( 49 files compared)
• DQMHistoSizes: changed ( 1000.0,... ): 971.459 KiB HLT/EXO
• DQMHistoSizes: changed ( 11634.0,... ): 3782.808 KiB HLT/EXO
• DQMHistoSizes: changed ( 11634.0,... ): 60.707 KiB HLT/Exotica
• DQMHistoSizes: changed ( 139.001 ): 1023.392 KiB HLT/EXO
• DQMHistoSizes: changed ( 312.0 ): -0.004 KiB MessageLogger/Warnings
• Checked 208 log files, 45 edm output root files, 50 DQM output files
• TriggerResults: no differences found

[emanueleusai]

+1

[cmsbuild]

This pull request is fully signed and it will be integrated in one of the next CMSSW_12_4_X IBs (tests are also fine) and once validation in the development release cycle CMSSW_12_6_X is complete. This pull request will now be reviewed by the release team before it's merged. @perrotta, @dpiparo, @rappoccio (and backports should be raised in the release meeting by the corresponding L2)

[perrotta]

@jalimena since you are backporting to 12_4, please also provide the backport for the intermediate cycle 12_5_X

[jalimena]

@jalimena since you are backporting to 12_4, please also provide the backport for the intermediate cycle 12_5_X

Ah ok @perrotta , thanks for letting me know. Done here: #39856

[perrotta]

backport of #39799

[rappoccio]

@jalimena just to confirm, there are a lot more files changed here than in the 12_6 version, is that expected?

[jalimena]

@rappoccio , Yes, because, as I said, it is a backport of both #38848 and #39799

[perrotta]

+1

• backport of both HLT release validation and offline DQM for EXO-LLP Run 3 HLT paths, updated to HLT menu V1.3 (2022) #38848 and Update & bug fix for offline DQM for EXO & HIG Run 3 muon paths #39799 (the first one having been already merged when the master was in 12_5_X)