Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merge ShallowGainCalibration logic in SiStripGainsPCLWorker and a minor bugfix #33523

Merged
merged 5 commits into from May 4, 2021

Conversation

pieterdavid
Copy link
Contributor

PR description:

To minimise the risk of diverging during data-taking, the SiStrip gains PCL reused the flat tree maker (ShallowGainCalibration), and read the branches it produced. We are reorganising the calibration tree code for run 3 (moving to the NanoAOD framework / ALCANANO, see this presentation, which will replace ShallowGainCalibration), so now it seems cleaner to remove the intermediate step (that brings the track and cluster selection logic together in the PCL worker, where most of it already was).
In the process, I found a bug in the old code that checks if a cluster crosses or touches an APV boundary (group of 128 strips), and fixed that (the cut removed a bit too many clusters, so the only effect is a small increase, of about 1%, in the number of clusters considered - all distributions should be compatible).

PR validation:

Compared workflow 1001.2, which contains the SiStrip gain calibration PCL. No changes before the last commit; with that change included a small increase in cluster statistics.

CC: @ataliercio @mdelcourt @robervalwalsh @mmusich

@cmsbuild
Copy link
Contributor

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-33523/22282

  • This PR adds an extra 32KB to repository

@cmsbuild
Copy link
Contributor

A new Pull Request was created by @pieterdavid (Pieter David) for master.

It involves the following packages:

CalibTracker/SiStripChannelGain
Calibration/TkAlCaRecoProducers

@malbouis, @yuanchao, @christopheralanwest, @cmsbuild, @tlampen, @pohsun, @francescobrivio can you please review it and eventually sign? Thanks.
@echabert, @robervalwalsh, @gbenelli, @tocheng, @alesaggio, @mmusich, @threus this is something you requested to watch as well.
@silviodonato, @dpiparo, @qliphy you are the release manager for this.

cms-bot commands are listed here

@mmusich
Copy link
Contributor

mmusich commented Apr 26, 2021

@cmsbuild, please test

@cmsbuild
Copy link
Contributor

+1

Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-421d03/14574/summary.html
COMMIT: bdb19a4
CMSSW: CMSSW_12_0_X_2021-04-25-2300/slc7_amd64_gcc900
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmssw/33523/14574/install.sh to create a dev area with all the needed externals and cmssw changes.

Comparison Summary

Summary:

  • No significant changes to the logs found
  • Reco comparison results: 4 differences found in the comparisons
  • DQMHistoTests: Total files compared: 38
  • DQMHistoTests: Total histograms compared: 2877605
  • DQMHistoTests: Total failures: 55
  • DQMHistoTests: Total nulls: 0
  • DQMHistoTests: Total successes: 2877528
  • DQMHistoTests: Total skipped: 22
  • DQMHistoTests: Total Missing objects: 0
  • DQMHistoSizes: Histogram memory added: 0.0 KiB( 37 files compared)
  • Checked 160 log files, 37 edm output root files, 38 DQM output files
  • TriggerResults: no differences found

@pieterdavid
Copy link
Contributor Author

@mmusich noticed a difference in the histograms that was not expected (cluster count in AlCaReco/SiStripGainsAAG/EventStats for 1001.0), but after some discussion we find it more logical to fill the actual number of clusters that are used for the calibration than the total number of clusters on all tracks - so with the last commit the difference in that bin is larger but expected (this histogram is not used downstream, the harvester takes everything from the 2D Charge_Vs_Index histogram); sorry for the extra noise.

@cmsbuild
Copy link
Contributor

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-33523/22289

  • This PR adds an extra 32KB to repository

@cmsbuild
Copy link
Contributor

Pull request #33523 was updated. @malbouis, @yuanchao, @christopheralanwest, @cmsbuild, @tlampen, @pohsun, @francescobrivio can you please check and sign again.

@mmusich
Copy link
Contributor

mmusich commented Apr 26, 2021

test parameters:

  • workflow = 1001.2

@mmusich
Copy link
Contributor

mmusich commented Apr 26, 2021

@cmsbuild, please test

@cmsbuild
Copy link
Contributor

+1

Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-421d03/14579/summary.html
COMMIT: 760741a
CMSSW: CMSSW_12_0_X_2021-04-26-1100/slc7_amd64_gcc900
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmssw/33523/14579/install.sh to create a dev area with all the needed externals and cmssw changes.

Comparison Summary

@slava77 comparisons for the following workflows were not done due to missing matrix map:

  • /data/cmsbld/jenkins/workspace/compare-root-files-short-matrix/data/PR-421d03/1001.2_RunZeroBias2017F+RunZeroBias2017F+TIER0EXPRUN2+ALCAEXPRUN2+ALCAHARVDSIPIXELCAL

Summary:

  • No significant changes to the logs found
  • Reco comparison results: 4 differences found in the comparisons
  • DQMHistoTests: Total files compared: 38
  • DQMHistoTests: Total histograms compared: 2877605
  • DQMHistoTests: Total failures: 55
  • DQMHistoTests: Total nulls: 0
  • DQMHistoTests: Total successes: 2877528
  • DQMHistoTests: Total skipped: 22
  • DQMHistoTests: Total Missing objects: 0
  • DQMHistoSizes: Histogram memory added: 0.0 KiB( 37 files compared)
  • Checked 160 log files, 37 edm output root files, 38 DQM output files
  • TriggerResults: no differences found

@yuanchao
Copy link
Contributor

yuanchao commented May 4, 2021

+1

  • ShallowGainCalibration replaced; fixed a bug on APV boundary
  • workflow 1001.0 statistics changed for the fix
  • build warnings are irrelevant; all tests passed

@cmsbuild
Copy link
Contributor

cmsbuild commented May 4, 2021

This pull request is fully signed and it will be integrated in one of the next master IBs (tests are also fine). This pull request will now be reviewed by the release team before it's merged. @silviodonato, @dpiparo, @qliphy (and backports should be raised in the release meeting by the corresponding L2)

@silviodonato
Copy link
Contributor

+1

@cmsbuild cmsbuild merged commit 7a3999f into cms-sw:master May 4, 2021
@silviodonato
Copy link
Contributor

cc @cms-sw/trk-dpg

@silviodonato
Copy link
Contributor

cc @cms-sw/trk-dpg-l2

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

5 participants