Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix LuminosityBlockSummaryCache & concurrent lumis #28362

Merged
merged 1 commit into from
Nov 8, 2019

Conversation

wddgit
Copy link
Contributor

@wddgit wddgit commented Nov 7, 2019

PR description:

Fix a bug affecting LuminosityBlockSummaryCache only when processing more than 1 lumi concurrently. Nothing in production runs with more than 1 concurrent lumis yet, so I am guessing the impact of this bug has been small. Outside of Core tests, the only modules in the CMSSW repository using this cache at this point in time are HLTriggerJSONMonitoring and L1TriggerJSONMonitoring.

This fixes the problem reported by Srecko Morovic on the Framework hyper news on 10/31/19.

PR validation:

Added a new Core unit test to verify correct behavior. This test would have detected the original problem reported.

Fix a bug affecting LuminosityBlockSummaryCache
when processing more than 1 lumi concurrently.
Nothing in production runs with concurrent lumis
yet so I am guessing the impact of this is small.
Outside of Core tests, the only modules using
this cache at this point in time are
HLTriggerJSONMonitoring and
L1TriggerJSONMonitoring.
@cmsbuild
Copy link
Contributor

cmsbuild commented Nov 7, 2019

The code-checks are being triggered in jenkins.

@cmsbuild
Copy link
Contributor

cmsbuild commented Nov 7, 2019

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-28362/12664

  • This PR adds an extra 48KB to repository

@cmsbuild
Copy link
Contributor

cmsbuild commented Nov 7, 2019

A new Pull Request was created by @wddgit (W. David Dagenhart) for master.

It involves the following packages:

FWCore/Framework

@cmsbuild, @smuzaffar, @Dr15Jones can you please review it and eventually sign? Thanks.
@makortel, @Martin-Grunewald this is something you requested to watch as well.
@davidlange6, @slava77, @fabiocos you are the release manager for this.

cms-bot commands are listed here

@wddgit
Copy link
Contributor Author

wddgit commented Nov 7, 2019

please test

@cmsbuild
Copy link
Contributor

cmsbuild commented Nov 7, 2019

The tests are being triggered in jenkins.
https://cmssdt.cern.ch/jenkins/job/ib-run-pr-tests/3382/console Started: 2019/11/07 21:37

@cmsbuild
Copy link
Contributor

cmsbuild commented Nov 7, 2019

@cmsbuild
Copy link
Contributor

cmsbuild commented Nov 7, 2019

Comparison job queued.

@Dr15Jones
Copy link
Contributor

+1

@cmsbuild
Copy link
Contributor

cmsbuild commented Nov 7, 2019

This pull request is fully signed and it will be integrated in one of the next master IBs (tests are also fine). This pull request will now be reviewed by the release team before it's merged. @davidlange6, @slava77, @smuzaffar, @fabiocos (and backports should be raised in the release meeting by the corresponding L2)

@cmsbuild
Copy link
Contributor

cmsbuild commented Nov 8, 2019

Comparison is ready
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-21357c/3382/summary.html

Comparison Summary:

  • No significant changes to the logs found
  • Reco comparison results: 4 differences found in the comparisons
  • DQMHistoTests: Total files compared: 34
  • DQMHistoTests: Total histograms compared: 2936360
  • DQMHistoTests: Total failures: 27
  • DQMHistoTests: Total nulls: 0
  • DQMHistoTests: Total successes: 2935992
  • DQMHistoTests: Total skipped: 341
  • DQMHistoTests: Total Missing objects: 0
  • DQMHistoSizes: Histogram memory added: 0.0 KiB( 33 files compared)
  • Checked 147 log files, 16 edm output root files, 34 DQM output files

@fabiocos
Copy link
Contributor

fabiocos commented Nov 8, 2019

please test

the DQM changes look strange, likely unrelated to this PR, I wonder whether they are related to #28330

@cmsbuild
Copy link
Contributor

cmsbuild commented Nov 8, 2019

The tests are being triggered in jenkins.
https://cmssdt.cern.ch/jenkins/job/ib-run-pr-tests/3390/console Started: 2019/11/08 10:47

@fabiocos
Copy link
Contributor

fabiocos commented Nov 8, 2019

+1

the changes appear also in other PRs, so I consider ok to merge this one. Anyway the test will be useful

@fabiocos
Copy link
Contributor

fabiocos commented Nov 8, 2019

merge

@cmsbuild cmsbuild merged commit 1663c37 into cms-sw:master Nov 8, 2019
@cmsbuild
Copy link
Contributor

cmsbuild commented Nov 8, 2019

@cmsbuild
Copy link
Contributor

cmsbuild commented Nov 8, 2019

Comparison job queued.

@cmsbuild
Copy link
Contributor

cmsbuild commented Nov 8, 2019

Comparison is ready
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-21357c/3390/summary.html

Comparison Summary:

  • No significant changes to the logs found
  • Reco comparison results: 0 differences found in the comparisons
  • DQMHistoTests: Total files compared: 34
  • DQMHistoTests: Total histograms compared: 2936360
  • DQMHistoTests: Total failures: 17
  • DQMHistoTests: Total nulls: 0
  • DQMHistoTests: Total successes: 2936002
  • DQMHistoTests: Total skipped: 341
  • DQMHistoTests: Total Missing objects: 0
  • DQMHistoSizes: Histogram memory added: 0.0 KiB( 33 files compared)
  • Checked 147 log files, 16 edm output root files, 34 DQM output files

@wddgit wddgit deleted the fixLumiSummaryCache branch January 31, 2020 15:59
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

4 participants