Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

include dark current contribution in M2 pedestal constraint for Phase2 #20422

Merged
merged 3 commits into from Sep 12, 2017

Conversation

kpedro88
Copy link
Contributor

@kpedro88 kpedro88 commented Sep 7, 2017

When SiPM aging is enabled, the dark current (an extra source of electronics noise, separate from the regular pedestal) can increase drastically. The pedestal constraint in HCAL Method 2 reconstruction did not account for this increase, leading to biased energy for some RecHits. Now it is included, but only enabled for Phase2. An additional parameter is added to the Method 2 parameter set, which must eventually be propagated to HLT separately (since M2 parameters are not kept in fillDescriptions).

See the presentation https://indico.cern.ch/event/664043/contributions/2713101/attachments/1519347/2372809/hcal_raddam_phase2_status_sept_6_2017.pdf and this plot that demonstrates improvement in jet energy response:
JER w/ M2 fix

This PR will be backported to 93X for inclusion in the HGCal TDR release (hopefully).

attn: @abdoulline @mariadalfonso @hatakeyamak

@cmsbuild
Copy link
Contributor

cmsbuild commented Sep 7, 2017

The code-checks are being triggered in jenkins.

@cmsbuild
Copy link
Contributor

cmsbuild commented Sep 7, 2017

A new Pull Request was created by @kpedro88 (Kevin Pedro) for master.

It involves the following packages:

HLTrigger/Configuration
RecoLocalCalo/HcalRecAlgos
RecoLocalCalo/HcalRecProducers

@perrotta, @cmsbuild, @silviodonato, @slava77, @Martin-Grunewald, @fwyzard can you please review it and eventually sign? Thanks.
@makortel, @argiro, @Martin-Grunewald, @jalimena, @mariadalfonso, @geoff-smith this is something you requested to watch as well.
@davidlange6, @slava77 you are the release manager for this.

cms-bot commands are listed here

@cmsbuild
Copy link
Contributor

cmsbuild commented Sep 7, 2017

The code-checks are being triggered in jenkins.

@cmsbuild
Copy link
Contributor

cmsbuild commented Sep 7, 2017

Pull request #20422 was updated. @perrotta, @cmsbuild, @silviodonato, @slava77, @Martin-Grunewald, @fwyzard can you please check and sign again.

@kpedro88
Copy link
Contributor Author

kpedro88 commented Sep 7, 2017

please test

@cmsbuild
Copy link
Contributor

cmsbuild commented Sep 7, 2017

The tests are being triggered in jenkins.

@cmsbuild
Copy link
Contributor

cmsbuild commented Sep 7, 2017

-code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/PR-20422/563

Code check has found code style and quality issues which could be resolved by applying a patch in https://cmssdt.cern.ch/SDT/code-checks/PR-20422/563/git-diff.patch
e.g. curl https://cmssdt.cern.ch/SDT/code-checks/PR-20422/563/git-diff.patch | patch -p1

You can run scram build code-checks to apply code checks directly (this will soon be required for PRs to be considered)

@cmsbuild
Copy link
Contributor

cmsbuild commented Sep 7, 2017

The code-checks are being triggered in jenkins.

@cmsbuild
Copy link
Contributor

cmsbuild commented Sep 7, 2017

Pull request #20422 was updated. @perrotta, @cmsbuild, @silviodonato, @slava77, @Martin-Grunewald, @fwyzard can you please check and sign again.

@cmsbuild
Copy link
Contributor

cmsbuild commented Sep 7, 2017

@cmsbuild
Copy link
Contributor

cmsbuild commented Sep 7, 2017

Comparison job queued.

@cmsbuild
Copy link
Contributor

cmsbuild commented Sep 8, 2017

Comparison is ready
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-20422/22789/summary.html

Comparison Summary:

  • No significant changes to the logs found
  • Reco comparison results: 416 differences found in the comparisons
  • DQMHistoTests: Total files compared: 26
  • DQMHistoTests: Total histograms compared: 2642440
  • DQMHistoTests: Total failures: 193
  • DQMHistoTests: Total nulls: 0
  • DQMHistoTests: Total successes: 2642058
  • DQMHistoTests: Total skipped: 189
  • DQMHistoTests: Total Missing objects: 0
  • Checked 107 log files, 14 edm output root files, 26 DQM output files

@kpedro88
Copy link
Contributor Author

kpedro88 commented Sep 8, 2017

Minor changes in HCAL reconstruction for Phase2 workflows, as expected; no changes otherwise. Examples:

log10(chi2)
log10(energy)

@kpedro88
Copy link
Contributor Author

kpedro88 commented Sep 8, 2017

+1

@kpedro88
Copy link
Contributor Author

Further demonstration of effectiveness of the fix: restoration of expected JER
JER

@Martin-Grunewald
Copy link
Contributor

+1

channelData.tsPedestalWidth(2)*channelData.tsPedestalWidth(2)*channelData.tsGain(2)*channelData.tsGain(2) +
channelData.tsPedestalWidth(3)*channelData.tsPedestalWidth(3)*channelData.tsGain(3)*channelData.tsGain(3));
double sipmDarkCurrentWidth2 = 0.;
if(dcConstraint_) sipmDarkCurrentWidth2 = sipmDarkCurrentWidth*sipmDarkCurrentWidth;
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

IIRC, the dark current distribution is substantially non-Gaussian. So, the constraint done this way is perhaps not the best solution.
If so, I guess it's still OK for a trial for phase-2 studies.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

yes, that will need to be a long-term development item for M2.

@slava77
Copy link
Contributor

slava77 commented Sep 11, 2017

@kpedro88
has there been much progress towards implementing the fillDescriptions for HCAL local reco?

@slava77
Copy link
Contributor

slava77 commented Sep 11, 2017

@kpedro88
chi2 in the plots in 2023 workflows in jenkins didn't change much.
Is this because the default inputs have no aging (and the effect of the dark current is small)?

@kpedro88
Copy link
Contributor Author

@slava77

  1. You'll have to ask @igv4321 about fillDescriptions for HCAL reco code; well beyond the scope of this PR, and also I'm not even sure if it makes sense with an algorithm plugin system like the one we have.
  2. Yes, the default inputs have no aging, so the effect of slightly reducing the constraint from the third term of M2 is small. The default dark current is tiny (less than an MeV). If you look at the presentation I linked in the PR description, you can see the effect of the fix with aging (slide 9).

@slava77
Copy link
Contributor

slava77 commented Sep 11, 2017 via email

@slava77
Copy link
Contributor

slava77 commented Sep 11, 2017

+1

for #20422 5051416

@cmsbuild
Copy link
Contributor

This pull request is fully signed and it will be integrated in one of the next master IBs (tests are also fine). This pull request will now be reviewed by the release team before it's merged. @davidlange6, @slava77, @smuzaffar (and backports should be raised in the release meeting by the corresponding L2)

@davidlange6
Copy link
Contributor

+1

@cmsbuild cmsbuild merged commit ba83c88 into cms-sw:master Sep 12, 2017
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

5 participants