Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

era 2017 updated with zs thresholds #21931

Merged
merged 3 commits into from Jan 27, 2018

Conversation

amassiro
Copy link
Contributor

From a physics point of view this should be the same as the current configuration, but it should be "cleaner", with less commented lines, and with the possibility to put later the best thresholds for both 2017 and 2018.

@crovelli @argiro

@cmsbuild
Copy link
Contributor

The code-checks are being triggered in jenkins.

@cmsbuild
Copy link
Contributor

@cmsbuild
Copy link
Contributor

A new Pull Request was created by @amassiro (Andrea Massironi) for master.

It involves the following packages:

RecoParticleFlow/PFClusterProducer

@perrotta, @cmsbuild, @slava77 can you please review it and eventually sign? Thanks.
@mmarionncern, @felicepantaleo, @rovere, @lgray, @seemasharmafnal, @cbernet, @bachtis this is something you requested to watch as well.
@davidlange6, @slava77, @fabiocos you are the release manager for this.

cms-bot commands are listed here

@slava77
Copy link
Contributor

slava77 commented Jan 23, 2018

@cmsbuild please test

@cmsbuild
Copy link
Contributor

cmsbuild commented Jan 23, 2018

The tests are being triggered in jenkins.
https://cmssdt.cern.ch/jenkins/job/ib-any-integration/25584/console Started: 2018/01/23 22:01

@cmsbuild
Copy link
Contributor

@cmsbuild
Copy link
Contributor

Comparison job queued.

@cmsbuild
Copy link
Contributor

Comparison is ready
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-21931/25584/summary.html

@slava77 comparisons for the following workflows were not done due to missing matrix map:

  • /build/cmsbld/jenkins/workspace/compare-root-files-short-matrix/results/JR-comparison/PR-21931/1325.7_TTbar_13_94XNanoAODINPUT+TTbar_13_94XNanoAODINPUT+NANOEDMMC2017

Comparison Summary:

  • No significant changes to the logs found
  • Reco comparison results: 2 differences found in the comparisons
  • DQMHistoTests: Total files compared: 26
  • DQMHistoTests: Total histograms compared: 2467599
  • DQMHistoTests: Total failures: 1
  • DQMHistoTests: Total nulls: 0
  • DQMHistoTests: Total successes: 2467429
  • DQMHistoTests: Total skipped: 169
  • DQMHistoTests: Total Missing objects: 0
  • DQMHistoSizes: Histogram memory added: 0.900000000089 KiB( 22 files compared)
  • Checked 110 log files, 9 edm output root files, 26 DQM output files

@@ -19,22 +19,19 @@
)

_particle_flow_zero_suppression_ECAL_2017 = cms.PSet(
thresholds = cms.vdouble(_pfZeroSuppressionThresholds_EB_2017 + _pfZeroSuppressionThresholds_EEminus_2017 + _pfZeroSuppressionThresholds_EEplus_2017
thresholds = cms.vdouble(pfZeroSuppressionThresholds_EB + pfZeroSuppressionThresholds_EEminus + pfZeroSuppressionThresholds_EEplus
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

After a more careful look, I'd like to propose to move up the change to the arrays in the beginning of the file.

So, please leave this line unchanged and change the arrays above to be

#These are expected to be adjusted soon, while the thresholds for older setups will remain unchanged.
_pfZeroSuppressionThresholds_EB_2017 = pfZeroSuppressionThresholds_EB
_pfZeroSuppressionThresholds_EEminus_2017 = pfZeroSuppressionThresholds_EEminus

This implies that my current understanding is correct that the adjustments will apply only to 2017+ data periods while the range up to 2016 will remain unchanged.
If this is correct, when we need to make a change, that change will affect only the 2017 arrays above without a requirement to recode this line as well.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

For sake of a re-reco of all run2 collected data, also 2016 ones should have these thresholds included.

If I understand correctly how these modifiers are handled, with the current configuration if we run on 2016 we have:
particle_flow_zero_suppression_ECAL
while if we run on 2017/2018 the one to be used is:
_particle_flow_zero_suppression_ECAL_2017

Is this correct?

In the future we may need to put different thresholds depending on the year (definitely moving to Tags in DB would help a lot, but the exact values will have to be studied by POGs before deciding on the best values).

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

For sake of a re-reco of all run2 collected data, also 2016 ones should have these thresholds included.

do you mean the future to-be-tuned thresholds?

How deep does this "for sake of re-reco" argument apply? If common thresholds are expected, they have to be implemented as common explicitly with a single common setting instead of copy-pasting.
Imagine we need to rereco Run-1 data. Would the updated thresholds apply there as well?
If so, then all the modifiers should be removed and we should just use the only thresholds in place in the arrays pfZeroSuppressionThresholds_EB, pfZeroSuppressionThresholds_EEminus, and pfZeroSuppressionThresholds_EEplus.
This file can then be cleaned up by removing everything after line 6

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Ok, now I see your point.
New commit with the suggested changes just done

@cmsbuild
Copy link
Contributor

The code-checks are being triggered in jenkins.

@cmsbuild
Copy link
Contributor

@cmsbuild
Copy link
Contributor

Pull request #21931 was updated. @perrotta, @cmsbuild, @slava77 can you please check and sign again.

@slava77
Copy link
Contributor

slava77 commented Jan 24, 2018 via email

@amassiro
Copy link
Contributor Author

The best, from ECAL physics perspective, will be to have different settings for each year (2015, 2016, 2017, 2018) since the noise is evolving, or even more fine granularity, depending on what may get this year in terms of luminosity.

Since, though, the changes of these settings can have non-negligible effects on physics performance, it has been decided so far not to touch them, but to keep them as they were in the past (Run 1). The final decision about re-tuning these thresholds, though motivated by (effective) noise increase in ECAL, will have to be agreed between POGs and PAGs, to limit the objects degradation and to improve performance. Studies are ongoing, and they have not reached a conclusion.

The most important thing right now is to have for 2018 (MC and Data) the settings as they are set now (80 MeV and 300 MeV).

Please, let us know what do you think the best implementation of this configuration would be, and would fit better the needs of central production, conformity among subdetectors, cleanliness. We don't have a strong opinion on this, apart from the fact that the thresholds are set correctly.

@slava77
Copy link
Contributor

slava77 commented Jan 24, 2018 via email

@slava77
Copy link
Contributor

slava77 commented Jan 24, 2018

@cmsbuild please test

@cmsbuild
Copy link
Contributor

cmsbuild commented Jan 24, 2018

The tests are being triggered in jenkins.
https://cmssdt.cern.ch/jenkins/job/ib-any-integration/25609/console Started: 2018/01/24 21:56

@cmsbuild
Copy link
Contributor

@cmsbuild
Copy link
Contributor

Comparison job queued.

@cmsbuild
Copy link
Contributor

Comparison is ready
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-21931/25609/summary.html

@slava77 comparisons for the following workflows were not done due to missing matrix map:

  • /build/cmsbld/jenkins/workspace/compare-root-files-short-matrix/results/JR-comparison/PR-21931/1325.7_TTbar_13_94XNanoAODINPUT+TTbar_13_94XNanoAODINPUT+NANOEDMMC2017

Comparison Summary:

  • No significant changes to the logs found
  • Reco comparison results: 4 differences found in the comparisons
  • DQMHistoTests: Total files compared: 26
  • DQMHistoTests: Total histograms compared: 2467599
  • DQMHistoTests: Total failures: 1
  • DQMHistoTests: Total nulls: 0
  • DQMHistoTests: Total successes: 2467429
  • DQMHistoTests: Total skipped: 169
  • DQMHistoTests: Total Missing objects: 0
  • DQMHistoSizes: Histogram memory added: 0.890000000116 KiB( 22 files compared)
  • Checked 110 log files, 9 edm output root files, 26 DQM output files

@slava77
Copy link
Contributor

slava77 commented Jan 26, 2018

+1

for #21931 52f404a

  • technical update; cleanup in RecoParticleFlow/PFClusterProducer/python/particleFlowZeroSuppressionECAL_cff.py, this also allows to more easily test alternative threshold choices for possible private tests
  • jenkins tests pass and comparisons show no differences

@cmsbuild
Copy link
Contributor

This pull request is fully signed and it will be integrated in one of the next master IBs (tests are also fine). This pull request will now be reviewed by the release team before it's merged. @davidlange6, @slava77, @smuzaffar, @fabiocos (and backports should be raised in the release meeting by the corresponding L2)

@fabiocos
Copy link
Contributor

+1

@cmsbuild cmsbuild merged commit ec8707a into cms-sw:master Jan 27, 2018
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

5 participants