PPS DQM error plots

[fabferro]

PR description:

This PR introduces new plots for monitoring the errors in PPS Pixel data taking and unpacking.
The plots are created per FED and per DetId to ease the error understanding and debugging.

PR validation:

Use of Run2 data via 136 WFs

[cmsbuild]

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-40688/34044

• This PR adds an extra 20KB to repository

[cmsbuild]

A new Pull Request was created by @fabferro (Fabrizio Ferro) for master.

It involves the following packages:

• DQM/CTPPS (dqm)

@emanueleusai, @ahmad3213, @cmsbuild, @syuvivida, @pmandrik, @micsucmed, @rvenditti can you please review it and eventually sign? Thanks.
@grzanka this is something you requested to watch as well.
@perrotta, @dpiparo, @rappoccio you are the release manager for this.

cms-bot commands are listed here

[perrotta]

please test

[cmsbuild]

-1

Failed Tests: RelVals RelVals-INPUT
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-878101/30407/summary.html
COMMIT: 71caacd
CMSSW: CMSSW_13_0_X_2023-02-05-0000/el8_amd64_gcc11
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/40688/30407/install.sh to create a dev area with all the needed externals and cmssw changes.

RelVals

• 138.4

----- Begin Fatal Exception 05-Feb-2023 21:00:48 CET-----------------------
An exception of category 'Configuration' occurred while
   [0] Constructing the EventProcessor
   [1] Constructing module: class=CTPPSPixelDQMSource label='ctppsPixelDQMOfflineSource'
Exception Message:
MissingParameter: The required parameter 'tagTrigResults' was not specified.
----- End Fatal Exception -------------------------------------------------

• 140.56

----- Begin Fatal Exception 05-Feb-2023 21:04:56 CET-----------------------
An exception of category 'Configuration' occurred while
   [0] Constructing the EventProcessor
   [1] Constructing module: class=CTPPSPixelDQMSource label='ctppsPixelDQMOfflineSource'
Exception Message:
MissingParameter: The required parameter 'tagTrigResults' was not specified.
----- End Fatal Exception -------------------------------------------------

• 1306.0

----- Begin Fatal Exception 05-Feb-2023 21:07:50 CET-----------------------
An exception of category 'Configuration' occurred while
   [0] Constructing the EventProcessor
   [1] Constructing module: class=CTPPSPixelDQMSource label='ctppsPixelDQMOfflineSource'
Exception Message:
MissingParameter: The required parameter 'tagTrigResults' was not specified.
----- End Fatal Exception -------------------------------------------------

Expand to see more relval errors ...

• 1330.0
• 312.0
• 10042.0
• 25202.0
• 10024.0
• 10824.0
• 11634.914
• 11634.0
• 11634.7
• 10224.0
• 11634.911
• 12434.0
• 11834.0
• 250202.181

RelVals-INPUT

• 138.4138.4_PromptCollisions2021/step2_PromptCollisions2021.log
• 140.56140.56_RunHI2018/step2_RunHI2018.log
• 140.6140.6_RunHI2022/step2_RunHI2022.log

Expand to see more relval errors ...

• 140.57
• 140.61

[cmsbuild]

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-40688/34075

• This PR adds an extra 24KB to repository

[cmsbuild]

Pull request #40688 was updated. @emanueleusai, @cmsbuild, @syuvivida, @rvenditti, @micsucmed, @pmandrik can you please check and sign again.

[emanueleusai]

please test

[cmsbuild]

+1

Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-878101/30439/summary.html
COMMIT: 331e598
CMSSW: CMSSW_13_0_X_2023-02-06-1100/el8_amd64_gcc11
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/40688/30439/install.sh to create a dev area with all the needed externals and cmssw changes.

Comparison Summary

Summary:

• You potentially added 15 lines to the logs
• Reco comparison results: 7 differences found in the comparisons
• DQMHistoTests: Total files compared: 49
• DQMHistoTests: Total histograms compared: 3555495
• DQMHistoTests: Total failures: 9
• DQMHistoTests: Total nulls: 0
• DQMHistoTests: Total successes: 3555464
• DQMHistoTests: Total skipped: 22
• DQMHistoTests: Total Missing objects: 0
• DQMHistoSizes: Histogram memory added: 8746.788999999999 KiB( 48 files compared)
• DQMHistoSizes: changed ( 10024.0,... ): 514.517 KiB CTPPS/TrackingPixel
• Checked 213 log files, 164 edm output root files, 49 DQM output files
• TriggerResults: no differences found

[emanueleusai]

+1

[cmsbuild]

This pull request is fully signed and it will be integrated in one of the next master IBs (tests are also fine). This pull request will now be reviewed by the release team before it's merged. @perrotta, @dpiparo, @rappoccio (and backports should be raised in the release meeting by the corresponding L2)

[emanueleusai]

If you need this code for the upcoming data taking period, could you please provide a backport to 12_6?

[perrotta]

+1

[fabferro]

If you need this code for the upcoming data taking period, could you please provide a backport to 12_6?

@emanueleusai Ok. Does this mean that I also have to backport PR #40660 that fixes a bug in error identification at the Event filter level?

[emanueleusai]

apologies, my language wasn't precise enough. The backport is needed is you need this PR for the upcoming MWGR. If you need it only for actual collision data, assuming we will use 13_X for that, then a backport to 12_6 is not needed.

[fabferro]

apologies, my language wasn't precise enough. The backport is needed is you need this PR for the upcoming MWGR. If you need it only for actual collision data, assuming we will use 13_X for that, then a backport to 12_6 is not needed.

Ah, ok. Then I'll do no backport.