Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Removed stub EGM regressor producers from production #24769

Merged
merged 1 commit into from Oct 2, 2018
Merged

Removed stub EGM regressor producers from production #24769

merged 1 commit into from Oct 2, 2018

Conversation

guitargeek
Copy link
Contributor

Hi,

while checking out how the EGM energy regression is done a few weeks ago, I realized there were some old producers ElectronRegressionValueMapProducer and PhotonRegressionValueMapProducer. They produce nothing, but are still in MiniAOD and NanoAOD production sequence. Maybe it would be good to remove them to get rid of the overhead they provide?

Local matrix tests all pass.

Cheers,
Jonas

@cmsbuild
Copy link
Contributor

cmsbuild commented Oct 1, 2018

The code-checks are being triggered in jenkins.

@cmsbuild
Copy link
Contributor

cmsbuild commented Oct 1, 2018

@cmsbuild
Copy link
Contributor

cmsbuild commented Oct 1, 2018

A new Pull Request was created by @guitargeek (Jonas Rembser) for master.

It involves the following packages:

PhysicsTools/NanoAOD
PhysicsTools/PatAlgos
RecoEgamma/ElectronIdentification
RecoEgamma/PhotonIdentification

@perrotta, @monttj, @cmsbuild, @slava77, @gpetruc, @arizzi can you please review it and eventually sign? Thanks.
@TaiSakuma, @gouskos, @jainshilpi, @rappoccio, @HeinerTholen, @varuns23, @seemasharmafnal, @mmarionncern, @imarches, @ahinzmann, @smoortga, @acaudron, @lgray, @jdolen, @drkovalskyi, @ferencek, @Sam-Harper, @jdamgov, @nhanvtran, @gkasieczka, @schoef, @clelange, @JyothsnaKomaragiri, @mverzett, @gpetruc, @mariadalfonso, @pvmulder this is something you requested to watch as well.
@davidlange6, @slava77, @fabiocos you are the release manager for this.

cms-bot commands are listed here

@slava77
Copy link
Contributor

slava77 commented Oct 1, 2018

@cmsbuild please test

@cmsbuild
Copy link
Contributor

cmsbuild commented Oct 1, 2018

The tests are being triggered in jenkins.
https://cmssdt.cern.ch/jenkins/job/ib-any-integration/30822/console Started: 2018/10/01 15:53

@slava77
Copy link
Contributor

slava77 commented Oct 1, 2018

@Sam-Harper @jainshilpi
do you happen to know when was the last time these producers (removed in this PR) were useful?

@guitargeek guitargeek changed the title Remove stub EGM regressor classes from production Removed stub EGM regressor producers from production Oct 1, 2018
@Sam-Harper
Copy link
Contributor

@Sam-Harper @jainshilpi
do you happen to know when was the last time these producers (removed in this PR) were useful?

No not off the top of my head exactly. My guess for this is when there were showershape variables not in the electron/photon that wanted to be used in the regression. Probably not been used for a while now as everything is in the electron/photon. If we need it back, we can always add it back but I would like to avoid doing that as much as possible.

Its probably better to clean out dead code rather than having it hanging around, thanks @guitargeek

@cmsbuild
Copy link
Contributor

cmsbuild commented Oct 1, 2018

@cmsbuild
Copy link
Contributor

cmsbuild commented Oct 1, 2018

Comparison job queued.

@cmsbuild
Copy link
Contributor

cmsbuild commented Oct 1, 2018

Comparison is ready
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-24769/30822/summary.html

Comparison Summary:

  • No significant changes to the logs found
  • Reco comparison results: 0 differences found in the comparisons
  • DQMHistoTests: Total files compared: 32
  • DQMHistoTests: Total histograms compared: 3162800
  • DQMHistoTests: Total failures: 1
  • DQMHistoTests: Total nulls: 0
  • DQMHistoTests: Total successes: 3162602
  • DQMHistoTests: Total skipped: 197
  • DQMHistoTests: Total Missing objects: 0
  • DQMHistoSizes: Histogram memory added: 0.0 KiB( 31 files compared)
  • Checked 134 log files, 14 edm output root files, 32 DQM output files

@slava77
Copy link
Contributor

slava77 commented Oct 2, 2018

+1

for #24769 661272f

  • cleanup of unused code (the removed producers were still loaded/constructed, but not running in mini/nano- AOD workflows)
  • jenkins tests pass

@guitargeek
Copy link
Contributor Author

Hi @slava77, I'm just curious to know how you could tell it doesn't run in the workflows. From my naive understanding, if it's in a sequence that is used like here in NanoAOD [1], then it runs each event. But apparently that doesn't seem to be the case. Can you please point me to an explanation? Thanks!

[1] https://github.com/cms-sw/cmssw/pull/24769/files#diff-6d69831bd3675c40ea80698b6ba12887R17

@Sam-Harper
Copy link
Contributor

Hi @guitargeek , which exact tool Slava uses to determine this I dont know. However when CMSSW is run in unschedualled mode, it only runs modules whose output is used. So if nothing is consuming the module and no output module is writing it out, the module is simply not run. Our framework is actually pretty smart :)

@guitargeek
Copy link
Contributor Author

Thank you Sam, that's what I wanted to know!

@slava77
Copy link
Contributor

slava77 commented Oct 2, 2018 via email

@guitargeek
Copy link
Contributor Author

Thank you Slava, that is a very handy tool.

@fabiocos
Copy link
Contributor

fabiocos commented Oct 2, 2018

@slava77 @guitargeek indeed these modules do not spend time in wf 136.85

TimeReport 0.000000 0.000000 0.000000 electronRegressionValueMapProducer
TimeReport 0.000000 0.000000 0.000000 photonRegressionValueMapProducer

But also using the Tracer shows that they are initialized but never used in theevent processing:

++++ finished: begin stream for module: stream = 3 label = 'photonRegressionValueMapProducer' id = 2248
++++++ starting: begin run for module: stream = 3 label = 'photonRegressionValueMapProducer' id = 2248
++++++ finished: begin run for module: stream = 3 label = 'photonRegressionValueMapProducer' id = 2248
++++++ starting: begin run for module: stream = 0 label = 'photonRegressionValueMapProducer' id = 2248
++++++ finished: begin run for module: stream = 0 label = 'photonRegressionValueMapProducer' id = 2248
++++++ starting: begin run for module: stream = 2 label = 'photonRegressionValueMapProducer' id = 2248
++++++ finished: begin run for module: stream = 2 label = 'photonRegressionValueMapProducer' id = 2248
++++++ starting: begin run for module: stream = 1 label = 'photonRegressionValueMapProducer' id = 2248
++++++ finished: begin run for module: stream = 1 label = 'photonRegressionValueMapProducer' id = 2248
++++++ starting: begin run for module: stream = 1 label = 'electronRegressionValueMapProducer' id = 1027
++++++ starting: begin run for module: stream = 2 label = 'electronRegressionValueMapProducer' id = 1027
++++++ finished: begin run for module: stream = 2 label = 'electronRegressionValueMapProducer' id = 1027
++++++ starting: begin lumi for module: stream = 3 label = 'photonRegressionValueMapProducer' id = 2248
++++++ starting: begin lumi for module: stream = 2 label = 'photonRegressionValueMapProducer' id = 2248
++++++ finished: begin lumi for module: stream = 2 label = 'photonRegressionValueMapProducer' id = 2248
++++++ finished: begin lumi for module: stream = 3 label = 'electronRegressionValueMapProducer' id = 1027
++++++ finished: end lumi for module: stream = 3 label = 'photonRegressionValueMapProducer' id = 2248
++++++ finished: end lumi for module: stream = 3 label = 'electronRegressionValueMapProducer' id = 1027
++++++ starting: end lumi for module: stream = 2 label = 'photonRegressionValueMapProducer' id = 2248
++++++ starting: end lumi for module: stream = 0 label = 'photonRegressionValueMapProducer' id = 2248
++++++ finished: end lumi for module: stream = 0 label = 'photonRegressionValueMapProducer' id = 2248
++++ starting: end stream for module: stream = 0 label = 'electronRegressionValueMapProducer' id = 1027

@fabiocos
Copy link
Contributor

fabiocos commented Oct 2, 2018

+1

cleaning of sequences

@fabiocos
Copy link
Contributor

fabiocos commented Oct 2, 2018

merge

@cmsbuild cmsbuild merged commit 896137d into cms-sw:master Oct 2, 2018
@guitargeek guitargeek deleted the egm_regression branch October 2, 2018 12:57
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

5 participants