Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Pixel Cluster Counting Automation Integration - LumiPOG on 10_1_X #22439

Merged
merged 4 commits into from Mar 9, 2018

Conversation

samhiggie
Copy link
Contributor

Hello,

This pull request represents continued work from our PCC Automation from 2017 an extension from Calibration/LumiAlCaRecoProducers/

The LumiPOG wants to incorporate these changes into the live release 10_1_X if possible, and would need to integrate a combined process involving RawPCCProducer and CorrPCCProducer into PCL to derive corrections for the luminosity using the Random Triggers that the LumiPOG uses.
We have yet to merge into PCL and might need extra tips to do this.

Looking forward to these changes!

Cheers,
Sam H. and the LumiPOG

@cmsbuild
Copy link
Contributor

cmsbuild commented Mar 2, 2018

The code-checks are being triggered in jenkins.

@cmsbuild
Copy link
Contributor

cmsbuild commented Mar 2, 2018

-code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-22439/3700

Code check has found code style and quality issues which could be resolved by applying a patch in https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-22439/3700/git-diff.patch
e.g. curl https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-22439/3700/git-diff.patch | patch -p1

You can run scram build code-checks to apply code checks directly

@arunhep
Copy link
Contributor

arunhep commented Mar 5, 2018

please test

@capalmer85
Copy link
Contributor

@arunhep Is this where we should be putting the PR? Does "please test" not work if in state "code-checks-rejected"? It looks like that is a problem for all 10_1_X PRs.

@arunhep
Copy link
Contributor

arunhep commented Mar 6, 2018

@capalmer85 @samhiggie can you please update the PR so that code checks can be successful. Then only we can trigger tests.

FYI @cerminar @franzoni

@capalmer85
Copy link
Contributor

capalmer85 commented Mar 6, 2018 via email

@boudoul
Copy link
Contributor

boudoul commented Mar 6, 2018

hi @capalmer85 , the needed changes are proposed by the link provided by the code-check, I recall the link here : https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-22439/3700/git-diff.patch

@cmsbuild
Copy link
Contributor

cmsbuild commented Mar 6, 2018

The code-checks are being triggered in jenkins.

@cmsbuild
Copy link
Contributor

cmsbuild commented Mar 6, 2018

@cmsbuild
Copy link
Contributor

cmsbuild commented Mar 6, 2018

A new Pull Request was created by @samhiggie for master.

It involves the following packages:

Calibration/LumiAlCaRecoProducers

@ghellwig, @arunhep, @cerminar, @cmsbuild, @franzoni, @lpernie can you please review it and eventually sign? Thanks.
@ghellwig, @mmusich, @tocheng this is something you requested to watch as well.
@davidlange6, @slava77, @fabiocos you are the release manager for this.

cms-bot commands are listed here

@capalmer85
Copy link
Contributor

@boudoul Thanks for the link. That was easy. :-)

@arunhep
Copy link
Contributor

arunhep commented Mar 6, 2018

please test

@cmsbuild
Copy link
Contributor

cmsbuild commented Mar 6, 2018

The tests are being triggered in jenkins.
https://cmssdt.cern.ch/jenkins/job/ib-any-integration/26556/console Started: 2018/03/06 15:57

@cmsbuild
Copy link
Contributor

cmsbuild commented Mar 6, 2018

@cmsbuild
Copy link
Contributor

cmsbuild commented Mar 6, 2018

Comparison job queued.

@cmsbuild
Copy link
Contributor

cmsbuild commented Mar 6, 2018

Comparison is ready
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-22439/26556/summary.html

Comparison Summary:

  • No significant changes to the logs found
  • Reco comparison results: 4 differences found in the comparisons
  • DQMHistoTests: Total files compared: 29
  • DQMHistoTests: Total histograms compared: 2479021
  • DQMHistoTests: Total failures: 1
  • DQMHistoTests: Total nulls: 0
  • DQMHistoTests: Total successes: 2478844
  • DQMHistoTests: Total skipped: 176
  • DQMHistoTests: Total Missing objects: 0
  • DQMHistoSizes: Histogram memory added: 1.19999999995 KiB( 23 files compared)
  • Checked 118 log files, 9 edm output root files, 29 DQM output files

@cerminar
Copy link
Contributor

cerminar commented Mar 7, 2018

@samhiggie
Do I understand correctly that:
Calibration/LumiAlCaRecoProducers/test/raw_corr_Random_cfg.py
would be the configuration for PCL while
Calibration/LumiAlCaRecoProducers/test/raw_ZeroBias_cfg.py

Is the configuration that you would like to run in an alcareco in prompt?

I guess this would need to be put in the standard format for having an ALCARECO and the PCL workflow called by ConfigBuilder...unless you have already done the cooking of the confuguration.
is that right?

@capalmer85
Copy link
Contributor

capalmer85 commented Mar 7, 2018 via email

@cerminar
Copy link
Contributor

cerminar commented Mar 8, 2018

@capalmer85 sounds good I just wanted to make sure I got the point. I can start working at the configurations looking at these files as reference. As you said this will go in a separate PR.
BTW, as requested by @arunhep in out mail thread, we will need a payload for testing the prompt-reco alcareco in relvals on real data. (it just needs to ensure functionality not physics quality results).

@arunhep
Copy link
Contributor

arunhep commented Mar 8, 2018

+1

@cmsbuild
Copy link
Contributor

cmsbuild commented Mar 8, 2018

This pull request is fully signed and it will be integrated in one of the next master IBs (tests are also fine). This pull request will now be reviewed by the release team before it's merged. @davidlange6, @slava77, @smuzaffar, @fabiocos (and backports should be raised in the release meeting by the corresponding L2)

@fabiocos
Copy link
Contributor

fabiocos commented Mar 8, 2018

@arunhep this PR does not add this extra code to the ALCARECO workflows for the time being, only standalone test configurations are provided. Were they used to test and validate the code? Was this presented somewhere?

@capalmer85
Copy link
Contributor

capalmer85 commented Mar 8, 2018 via email

@fabiocos
Copy link
Contributor

fabiocos commented Mar 9, 2018

+1

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

7 participants