Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Trigger Object Tag and Probe DQM source #24319

Merged
merged 3 commits into from Aug 24, 2018

Conversation

Sam-Harper
Copy link
Contributor

Dear All,

This PR adds a DQM module which aims to monitor trigger efficiencies using only information calculated by the trigger. In principle it is completely agnostic of the particle type, in practice it is probably only applicable to electrons.

It is intended that this module is run as part of the HLT job, hence why its not include in any "DQM" sequence. Running in the HLT was seen as the optimal solution as

  1. it needs the full stats (excludes online DQM, express)
  2. it requires a short latency (excludes offline DQM)
  3. it has no need for any quantities calculated outside the HLT.

This module just provides the source histograms. The client will be run outside of the CMSSW framework and will be maintained in a separate git repo. The client will acquire the histograms via the DQM gui api.

The goal of this DQM is to allow fast feedback of current E/gamma data taking efficiency with a latency of ~30-60mins from the fill ending.

Finally, it is reasonable to ask, why bother? Two reasons. I am still paranoid about possible pixel issues causing efficiency losses and this will reduce the latency of finding them from <1 week> to <1 day>. More importantly, I want this up and running before the end of the Run so it doesn't get forgotten about for the start of RunIII where it will be extremely useful.

We will need this running at P5 so expect backports to 10_2 and 10_1.

@Martin-Grunewald @silviodonato

@cmsbuild
Copy link
Contributor

The code-checks are being triggered in jenkins.

@cmsbuild
Copy link
Contributor

@cmsbuild
Copy link
Contributor

A new Pull Request was created by @Sam-Harper (Sam Harper) for master.

It involves the following packages:

DQM/HLTEvF
DQMOffline/Trigger

@cmsbuild, @andrius-k, @kmaeshima, @schneiml, @Martin-Grunewald, @silviodonato, @jfernan2, @fwyzard can you please review it and eventually sign? Thanks.
@battibass, @mtosi, @jhgoh, @calderona, @HuguesBrun, @trocino, @folguera, @rociovilar this is something you requested to watch as well.
@davidlange6, @slava77, @fabiocos you are the release manager for this.

cms-bot commands are listed here

@davidlange6
Copy link
Contributor

please test

@cmsbuild
Copy link
Contributor

cmsbuild commented Aug 16, 2018

The tests are being triggered in jenkins.
https://cmssdt.cern.ch/jenkins/job/ib-any-integration/29890/console Started: 2018/08/16 22:43

@cmsbuild
Copy link
Contributor

@cmsbuild
Copy link
Contributor

Comparison job queued.

@cmsbuild
Copy link
Contributor

Comparison is ready
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-24319/29890/summary.html

Comparison Summary:

  • No significant changes to the logs found
  • Reco comparison results: 0 differences found in the comparisons
  • DQMHistoTests: Total files compared: 31
  • DQMHistoTests: Total histograms compared: 2983602
  • DQMHistoTests: Total failures: 7
  • DQMHistoTests: Total nulls: 0
  • DQMHistoTests: Total successes: 2983405
  • DQMHistoTests: Total skipped: 190
  • DQMHistoTests: Total Missing objects: 0
  • DQMHistoSizes: Histogram memory added: 0.0 KiB( 30 files compared)
  • Checked 129 log files, 14 edm output root files, 31 DQM output files

@Martin-Grunewald
Copy link
Contributor

+1

@cmsbuild
Copy link
Contributor

cmsbuild commented Aug 23, 2018

The tests are being triggered in jenkins.
https://cmssdt.cern.ch/jenkins/job/ib-any-integration/30001/console Started: 2018/08/23 12:41

@cmsbuild
Copy link
Contributor

@cmsbuild
Copy link
Contributor

Comparison job queued.

@cmsbuild
Copy link
Contributor

Comparison is ready
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-24319/30001/summary.html

There are some workflows for which there are errors in the baseline:
4.22 step 2
The results for the comparisons for these workflows could be incomplete
This means most likely that the IB is having errors in the relvals.The error does NOT come from this pull request

Comparison Summary:

  • You potentially added 800 lines to the logs
  • Reco comparison results: 2300 differences found in the comparisons
  • DQMHistoTests: Total files compared: 30
  • DQMHistoTests: Total histograms compared: 2951098
  • DQMHistoTests: Total failures: 11863
  • DQMHistoTests: Total nulls: 9
  • DQMHistoTests: Total successes: 2939045
  • DQMHistoTests: Total skipped: 181
  • DQMHistoTests: Total Missing objects: 0
  • DQMHistoSizes: Histogram memory added: -0.363 KiB( 29 files compared)
  • DQMHistoSizes: changed ( 250202.181 ): -0.363 KiB SiStrip/MechanicalView
  • Checked 126 log files, 14 edm output root files, 30 DQM output files

@Martin-Grunewald
Copy link
Contributor

+1

@andrius-k
Copy link

+1

@cmsbuild
Copy link
Contributor

This pull request is fully signed and it will be integrated in one of the next master IBs (tests are also fine). This pull request will now be reviewed by the release team before it's merged. @davidlange6, @slava77, @smuzaffar, @fabiocos (and backports should be raised in the release meeting by the corresponding L2)

@kpedro88
Copy link
Contributor

+1

@cmsbuild cmsbuild merged commit 38e8730 into cms-sw:master Aug 24, 2018
@@ -32,6 +32,7 @@
<use name="MagneticField/Records"/>
<use name="MagneticField/Engine"/>
<use name="TrackingTools/TrajectoryState"/>
<use name="DQMOffline/Trigger"/>
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@@ -31,4 +31,6 @@

<use name="root"/>
<use name="boost"/>
<flags EDM_PLUGIN="1"/>
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is the change that is breaking the IBs

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

To make things work, DQMOffline/Trigger/src/SealModule.cc would have to move to the plugins directory. Even better, all the modules used in that file would also move to that directory.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

sorry about that! Fixed now. All plugins are now in plugins dir

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

#24390, its the same branch with the fix

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

9 participants