OnlineDQM: Add Chi2 2D Quality Test

[stahlleiton]

Description:
Add a new Chi2 Quality Test to compare a 2D test histogram versus a 2D reference histogram for Online DQM. The Chi2 test is based on the test already implemented in the ROOT framework which is described here https://root.cern.ch/doc/master/classTH1.html#aa2cecbf3c6a20a1ec3d39b5ec139b6f2 and can be applied to 1D/2D/3D histograms.

Purpose:
The new Chi2 2D Quality Test will be used to compare 2D Online DQM histograms in order to build DQM automatic alarms for L1T.

[cmsbuild]

A new Pull Request was created by @stahlleiton (Andre Stahl) for master.

It involves the following packages:

DQMServices/ClientConfig
DQMServices/Core

@cmsbuild, @dmitrijus, @vanbesien, @davidlange6 can you please review it and eventually sign? Thanks.
@barvic this is something you requested to watch as well.
@davidlange6 you are the release manager for this.

cms-bot commands are listed here

[stahlleiton]

Hi

[stahlleiton]

Sorry, I closed this PR by mistake. So I reopened it.
@dmitrijus, could you start the test? thanks.

[dmitrijus]

please test

[cmsbuild]

The tests are being triggered in jenkins.
https://cmssdt.cern.ch/jenkins/job/ib-any-integration/20248/console Started: 2017/05/31 16:49

[cmsbuild]

+1
Tested at: e2c69bf
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-18965/20248/summary.html

[cmsbuild]

Comparison job queued.

[cmsbuild]

Comparison is ready
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-18965/20248/summary.html

@slava77 comparisons for the following workflows were not done due to missing matrix map:

• /build/cmsbld/jenkins-workarea/workspace/compare-root-files-short-matrix/results/JR-comparison/PR-18965/20434.0_TTbar_14TeV+TTbar_14TeV_TuneCUETP8M1_2023D10_GenSimHLBeamSpotFull14+DigiFullTrigger_2023D10+RecoFullGlobal_2023D10+HARVESTFullGlobal_2023D10
• /build/cmsbld/jenkins-workarea/workspace/compare-root-files-short-matrix/results/JR-comparison/PR-18965/23234.0_TTbar_14TeV+TTbar_14TeV_TuneCUETP8M1_2023D18_GenSimHLBeamSpotFull14+DigiFull_2023D18+RecoFullGlobal_2023D18+HARVESTFullGlobal_2023D18
• /build/cmsbld/jenkins-workarea/workspace/compare-root-files-short-matrix/results/JR-comparison/PR-18965/27434.0_TTbar_14TeV+TTbar_14TeV_TuneCUETP8M1_2023D17_GenSimHLBeamSpotFull14+DigiFull_2023D17+RecoFullGlobal_2023D17+HARVESTFullGlobal_2023D17

Comparison Summary:

• No significant changes to the logs found
• Reco comparison results: 1693 differences found in the comparisons
• DQMHistoTests: Total files compared: 23
• DQMHistoTests: Total histograms compared: 1786072
• DQMHistoTests: Total failures: 39325
• DQMHistoTests: Total nulls: 0
• DQMHistoTests: Total successes: 1746574
• DQMHistoTests: Total skipped: 173
• DQMHistoTests: Total Missing objects: 0
• Checked 94 log files, 14 edm output root files, 23 DQM output files

[dmitrijus]

+1

[cmsbuild]

This pull request is fully signed and it will be integrated in one of the next master IBs (tests are also fine). This pull request requires discussion in the ORP meeting before it's merged. @davidlange6, @smuzaffar

[davidlange6]

+1