Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

RPC DQM occupancy bugfix + cleanup #20356

Merged
merged 7 commits into from Sep 11, 2017
Merged

Conversation

jhgoh
Copy link
Contributor

@jhgoh jhgoh commented Sep 1, 2017

This PR fixes problems in the RPC offline DQM.

Problem:
In the RPC summary plots (offline DQM), ring3/A,C shows very low occupancy in 2D plots (https://goo.gl/sWUTxU). This is not consistent with <Run2016 nor the online DQM. It also disagree with 1D distributions. Same symptoms are observed in release validation.

Observation:
We could reproduce the same problem with RelVal samples with multi-threading.
The distribution becomes OK with single thread mode.
Affected histograms have custom labels in each axis, without calling setBinLabel() restores nominal shapes.

Solution:
Explicitly call TAxis::SetNoAlphanumeric() for the MonitorElements before setting bin labels.

image

image

Other changes:
We also added some changes for cleanup the codes and remove obsolete scripts.

@slezki @mileva @andresib

@cmsbuild
Copy link
Contributor

cmsbuild commented Sep 1, 2017

The code-checks are being triggered in jenkins.

@cmsbuild
Copy link
Contributor

cmsbuild commented Sep 1, 2017

A new Pull Request was created by @jhgoh (Junghwan John Goh) for master.

It involves the following packages:

DQM/RPCMonitorDigi

@kmaeshima, @cmsbuild, @vanbesien, @vazzolini, @dmitrijus can you please review it and eventually sign? Thanks.
@acimmino this is something you requested to watch as well.
@davidlange6, @slava77 you are the release manager for this.

cms-bot commands are listed here

@cmsbuild
Copy link
Contributor

cmsbuild commented Sep 1, 2017

-code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/PR-20356/462

Code check has found code style and quality issues which could be resolved by applying a patch in https://cmssdt.cern.ch/SDT/code-checks/PR-20356/462/git-diff.patch
e.g. curl https://cmssdt.cern.ch/SDT/code-checks/PR-20356/462/git-diff.patch | patch -p1

You can run scram build code-checks to apply code checks directly (this will soon be required for PRs to be considered)

@cmsbuild
Copy link
Contributor

cmsbuild commented Sep 1, 2017

The code-checks are being triggered in jenkins.

@cmsbuild
Copy link
Contributor

cmsbuild commented Sep 1, 2017

Pull request #20356 was updated. @kmaeshima, @cmsbuild, @vanbesien, @vazzolini, @dmitrijus can you please check and sign again.

@cmsbuild
Copy link
Contributor

cmsbuild commented Sep 1, 2017

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/PR-20356/463

@dmitrijus
Copy link
Contributor

+1

@dmitrijus
Copy link
Contributor

@davidlange6 I find that suggestion was a just temporary "workaround".
DQM has nothing against alphanumeric histograms.

The issue back then was that alphanumeric histograms could be implicitly extended via fill / findBin. (axis extension is problematic for DQM, since we can no longer use TH1::Add()).

And it was fixed by this commit, root-project/root@1796bf2

This RPC DQM bug looks very similar to how an axis extension would look like.
There a big mess will all the root TH1 flags and implicit toggles of them, I am still investigating.

Either way, this PR should be merged. If a subsystem/module wants to explicitly avoid having alphanumeric histograms, they should disable it just like it was done in this PR.

@dmitrijus
Copy link
Contributor

+1

@cmsbuild
Copy link
Contributor

cmsbuild commented Sep 5, 2017

The tests are being triggered in jenkins.
https://cmssdt.cern.ch/jenkins/job/ib-any-integration/22728/console Started: 2017/09/05 17:33

@cmsbuild
Copy link
Contributor

cmsbuild commented Sep 5, 2017

This pull request is fully signed and it will be integrated in one of the next master IBs after it passes the integration tests. This pull request will now be reviewed by the release team before it's merged. @davidlange6, @slava77, @smuzaffar (and backports should be raised in the release meeting by the corresponding L2)

@cmsbuild
Copy link
Contributor

cmsbuild commented Sep 5, 2017

@cmsbuild
Copy link
Contributor

cmsbuild commented Sep 5, 2017

Comparison job queued.

@cmsbuild
Copy link
Contributor

cmsbuild commented Sep 5, 2017

Comparison is ready
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-20356/22728/summary.html

Comparison Summary:

  • No significant changes to the logs found
  • Reco comparison results: 0 differences found in the comparisons
  • DQMHistoTests: Total files compared: 26
  • DQMHistoTests: Total histograms compared: 2656434
  • DQMHistoTests: Total failures: 201
  • DQMHistoTests: Total nulls: 0
  • DQMHistoTests: Total successes: 2656044
  • DQMHistoTests: Total skipped: 189
  • DQMHistoTests: Total Missing objects: 0
  • Checked 107 log files, 14 edm output root files, 26 DQM output files

@davidlange6
Copy link
Contributor

+1

@cmsbuild cmsbuild merged commit 5c883f6 into cms-sw:master Sep 11, 2017
@jhgoh
Copy link
Contributor Author

jhgoh commented Sep 11, 2017

@dmitrijus should I prepare backport(s) to apply this bugfix as well?

@dmitrijus
Copy link
Contributor

@jhgoh That would welcome, yes :)

@jhgoh
Copy link
Contributor Author

jhgoh commented Sep 11, 2017

93X backport is created. Better to prepare one more for 92X?

@jhgoh jhgoh deleted the cleanupRPCDQM branch September 26, 2017 02:08
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

5 participants