BTV OfflineDQM preparations for Run 3

[marco-link]

PR description:

• add DeepJet to @miniAODDQM
• move DeepCSV to @miniAODDQM
• update DeepCSV WPs

Changes presented in the Btag WG Meeting

PR validation:

runTheMatrix.py -l 12034.0 to verify histograms are filled correctly

runTheMatrix.py -l limited -i all

[cmsbuild]

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-35985/26415

• This PR adds an extra 88KB to repository

• Found files with invalid states:

  • DQMOffline/RecoB/python/DeepCSV.py:
    • Added: f686f58
    • Deleted: e57ad02
  • DQMOffline/RecoB/python/dqmMiniCommon_cff.py:
    • Added: f686f58
    • Deleted: e57ad02
  • DQMOffline/RecoB/python/dqmMiniAnalyzer_cff.py:
    • Added: 3aea6b7
    • Modified: 1b3b533, 280040f, f686f58
    • Deleted: e57ad02
  • DQMOffline/RecoB/python/DeepFlavour.py:
    • Added: f686f58
    • Deleted: e57ad02

• There are other open Pull requests which might conflict with changes you have proposed:

  • File Configuration/StandardSequences/python/Validation_cff.py modified in PR(s): Use pdigi_hi_nogen for HI MC wfs #35028
  • File DQMOffline/Configuration/python/DQMOffline_SecondStep_cff.py modified in PR(s): TkDQM: Introduce monitoring package for pixel SoA products #35965
  • File DQMOffline/Configuration/python/DQMOffline_cff.py modified in PR(s): TkDQM: Introduce monitoring package for pixel SoA products #35965

[cmsbuild]

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-35985/26643

• This PR adds an extra 16KB to repository

• Found files with invalid states:

  • DQMOffline/RecoB/python/DeepCSV.py:
    • Added: f686f58
    • Deleted: e57ad02
  • DQMOffline/RecoB/python/dqmMiniCommon_cff.py:
    • Added: f686f58
    • Deleted: e57ad02
  • DQMOffline/RecoB/python/dqmMiniAnalyzer_cff.py:
    • Added: 3aea6b7
    • Modified: 1b3b533, 280040f, f686f58
    • Deleted: e57ad02
  • DQMOffline/RecoB/python/DeepFlavour.py:
    • Added: f686f58
    • Deleted: e57ad02

• There are other open Pull requests which might conflict with changes you have proposed:

  • File Configuration/StandardSequences/python/Validation_cff.py modified in PR(s): Use pdigi_hi_nogen for HI MC wfs #35028
  • File DQMOffline/Configuration/python/DQMOffline_SecondStep_cff.py modified in PR(s): TkDQM: Introduce monitoring package for pixel SoA products #35965
  • File DQMOffline/Configuration/python/DQMOffline_cff.py modified in PR(s): TkDQM: Introduce monitoring package for pixel SoA products #35965

[cmsbuild]

Pull request #35985 was updated. @perrotta, @pmandrik, @emanueleusai, @ahmad3213, @cmsbuild, @jfernan2, @qliphy, @davidlange6, @fabiocos, @pbo0, @rvenditti can you please check and sign again.

[perrotta]

please test

[cmsbuild]

+1

Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-19a9e1/20548/summary.html
COMMIT: 696c60c
CMSSW: CMSSW_12_2_X_2021-11-15-1100/slc7_amd64_gcc900
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/35985/20548/install.sh to create a dev area with all the needed externals and cmssw changes.

Comparison Summary

Summary:

• No significant changes to the logs found
• Reco comparison results: 0 differences found in the comparisons
• DQMHistoTests: Total files compared: 42
• DQMHistoTests: Total histograms compared: 3314358
• DQMHistoTests: Total failures: 0
• DQMHistoTests: Total nulls: 7
• DQMHistoTests: Total successes: 3314329
• DQMHistoTests: Total skipped: 22
• DQMHistoTests: Total Missing objects: 0
• DQMHistoSizes: Histogram memory added: 2753.077 KiB( 41 files compared)
• DQMHistoSizes: changed ( 1000.0 ): 0.589 KiB Btag/DeepFlavour_BvsAll_ETA_1v4-2v5
• DQMHistoSizes: changed ( 1000.0 ): 0.581 KiB Btag/DeepFlavour_BvsAll_ETA_0-1v4
• DQMHistoSizes: changed ( 1000.0 ): 0.581 KiB Btag/DeepFlavour_CvsB_ETA_1v4-2v5
• DQMHistoSizes: changed ( 1000.0 ): 0.581 KiB Btag/DeepFlavour_CvsL_ETA_1v4-2v5
• DQMHistoSizes: changed ( 1000.0 ): 0.573 KiB Btag/DeepCSV_BvsAll_ETA_1v4-2v5
• DQMHistoSizes: changed ( 1000.0 ): 0.573 KiB Btag/DeepFlavour_CvsB_ETA_0-1v4
• DQMHistoSizes: changed ( 1000.0 ): 0.573 KiB Btag/DeepFlavour_CvsL_ETA_0-1v4
• DQMHistoSizes: changed ( 1000.0 ): -0.573 KiB Btag/deepCSV_BvsAll_ETA_1v4-2v5
• DQMHistoSizes: changed ( 1000.0 ): 0.569 KiB Btag/DeepFlavour_BvsAll_GLOBAL
• DQMHistoSizes: changed ( 1000.0 ): 0.565 KiB Btag/DeepCSV_BvsAll_ETA_0-1v4
• DQMHistoSizes: changed ( 1000.0 ): ...
• Checked 177 log files, 37 edm output root files, 42 DQM output files
• TriggerResults: found differences in 24 / 41 workflows

[jfernan2]

+1

[perrotta]

+operations

[cmsbuild]

This pull request is fully signed and it will be integrated in one of the next master IBs (tests are also fine). This pull request will now be reviewed by the release team before it's merged. @perrotta, @dpiparo, @qliphy (and backports should be raised in the release meeting by the corresponding L2)

[perrotta]

+1