Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Validation/Geometry: No histos ROOT file being created by configuration scripts && CleanUp [Backport] #25139

Merged
merged 7 commits into from Nov 21, 2018

Conversation

vargasa
Copy link
Contributor

@vargasa vargasa commented Nov 6, 2018

In the past, the statement to save the histograms in a ROOT file
was written in the destructors of some classes, with the later use of
Smart Pointers the ROOT file was not being written.

endOfRun(), which should be called explicitely from MaterialBudgetAction
includes a call to TestHistoMgr::save().
Replacing std::cout for edm::Log* methods to clean up output.
@cmsbuild
Copy link
Contributor

cmsbuild commented Nov 6, 2018

A new Pull Request was created by @vargasa (Andres Vargas) for CMSSW_10_3_X.

It involves the following packages:

Validation/Geometry

@andrius-k, @Dr15Jones, @kmaeshima, @cvuosalo, @schneiml, @ianna, @mdhildreth, @cmsbuild, @jfernan2, @civanch can you please review it and eventually sign? Thanks.
@rovere this is something you requested to watch as well.
@davidlange6, @slava77, @fabiocos you are the release manager for this.

cms-bot commands are listed here

@andrius-k
Copy link

please test

@cmsbuild
Copy link
Contributor

cmsbuild commented Nov 6, 2018

The tests are being triggered in jenkins.
https://cmssdt.cern.ch/jenkins/job/ib-any-integration/31499/console Started: 2018/11/06 17:15

@andrius-k
Copy link

Hi @vargasa, the changes seem to be different between this PR and a forward-port. Can you confirm that this is because of the different bases?

@cmsbuild
Copy link
Contributor

cmsbuild commented Nov 6, 2018

Pull request #25139 was updated. @andrius-k, @Dr15Jones, @kmaeshima, @cvuosalo, @schneiml, @ianna, @mdhildreth, @cmsbuild, @jfernan2, @civanch can you please check and sign again.

@vargasa
Copy link
Contributor Author

vargasa commented Nov 6, 2018

@andrius-k I added the rest of the commits. From #24625 the latest commits were added as requested to change in the context, not in the changes itself. Please let me know if you see any differences after this

@vargasa
Copy link
Contributor Author

vargasa commented Nov 6, 2018

backport of #24625

@andrius-k
Copy link

please test

@vargasa, now diffs seem to be the same, thanks.

@cmsbuild
Copy link
Contributor

cmsbuild commented Nov 6, 2018

The tests are being triggered in jenkins.
https://cmssdt.cern.ch/jenkins/job/ib-any-integration/31504/console Started: 2018/11/06 18:01

@cmsbuild
Copy link
Contributor

cmsbuild commented Nov 6, 2018

Comparison is ready
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-25139/31504/summary.html

Comparison Summary:

  • No significant changes to the logs found
  • Reco comparison results: 4 differences found in the comparisons
  • DQMHistoTests: Total files compared: 32
  • DQMHistoTests: Total histograms compared: 3163099
  • DQMHistoTests: Total failures: 1
  • DQMHistoTests: Total nulls: 0
  • DQMHistoTests: Total successes: 3162901
  • DQMHistoTests: Total skipped: 197
  • DQMHistoTests: Total Missing objects: 0
  • DQMHistoSizes: Histogram memory added: 0.0 KiB( 31 files compared)
  • Checked 134 log files, 14 edm output root files, 32 DQM output files

@andrius-k
Copy link

+1

@fabiocos
Copy link
Contributor

fabiocos commented Nov 8, 2018

@vargasa for which specific task is the backport of this PR to 10_3_X needed? It would naively look a tool for future developments

Copy link
Contributor

@ianna ianna left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Perhaps, the comments could be addressed in 10_4.

theID=0;
thePt=0;
theEnergy=0;
theMass=0;

theSupportMB = 0.;
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@vargasa - to avoid a conversion from double to float, please use 0.f
theSupportMB is float, 0. is double:
https://en.cppreference.com/w/cpp/language/floating_literal

@@ -20,217 +16,39 @@ MaterialBudgetData::MaterialBudgetData()

MaterialBudgetData::~MaterialBudgetData() {
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

MaterialBudgetData::~MaterialBudgetData() = default;

@@ -369,8 +226,10 @@ void MaterialBudgetData::dataPerStep( const G4Step* aStep )
theOtherFractionMB = myMaterialBudgetCategorizer->x0fraction(materialName)[5];
theAirFractionMB = myMaterialBudgetCategorizer->x0fraction(materialName)[6];

if(theOtherFractionMB!=0) std::cout << " material found with no category " << materialName
<< " in volume " << volumeName << std::endl;
if(theOtherFractionMB!=0)
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

theOtherFractionMB is float, 0 is an integer

@ianna
Copy link
Contributor

ianna commented Nov 8, 2018

+1

@cmsbuild
Copy link
Contributor

cmsbuild commented Nov 8, 2018

This pull request is fully signed and it will be integrated in one of the next CMSSW_10_3_X IBs (tests are also fine) and once validation in the development release cycle CMSSW_10_4_X is complete. This pull request will now be reviewed by the release team before it's merged. @davidlange6, @slava77, @smuzaffar, @fabiocos (and backports should be raised in the release meeting by the corresponding L2)

@vargasa
Copy link
Contributor Author

vargasa commented Nov 8, 2018

@fabiocos Please check #23770 (comment) With no ROOT files being produced the module is useless :(

@fabiocos
Copy link
Contributor

fabiocos commented Nov 9, 2018

@vargasa @kpedro88 the fact that there is a problem is not the issue. My question is: which study must be done in CMSSW_10_3_X that needs it? In my understanding upgrade work (which appears to be the main target of this development) is now moving in 10_4_X

@vargasa
Copy link
Contributor Author

vargasa commented Nov 9, 2018

My question is: which study must be done in CMSSW_10_3_X that needs it?

Perhaps @mmusich can address this question

@mmusich
Copy link
Contributor

mmusich commented Nov 9, 2018

@fabiocos, we are planning to revamp material budget validation as part of release validation, hence needs to be functional in all open release cycles

@fabiocos
Copy link
Contributor

@mmusich "all open release cycles" includes back to 7_1_X and 5_3_X, I doubt you mean this. "Open development cycle" (where BTW next upgrade activities are planned) is 10_4_X. 10_3_X is for HI data taking and MC, possibly B-parking (although I haven't seen anything about this so far). Not sure which material budget studies should be done here, may be you have a plan about this and could clarify.

Although merging this PR in 10_3_X should be harmless, I would like to get a logic and a plan, backporting whatever wherever without a clear target is not a good practice in my view.

@vargasa
Copy link
Contributor Author

vargasa commented Nov 11, 2018

backporting whatever wherever without a clear target is not a good practice in my view.

@fabiocos this is not random. As explained in the original PR #24625 another previously merged PR #23770 introduced a bug #23770 (comment) which is being fixed by #24625 and being backported here. Why 10_3_X? because this is the earliest release that includes the commit (as you can check here) producing the bug (which is the absence of these ROOT files, which are required for any analysis using Validation/Geometry package) .

As you pointed out it is harmless to merge it but it is harmful not to do it as the release will feature a bug which has already been fixed in the master branch #25072. Please keep in mind that this is not feature development but bug fixing (despite the fact that includes some 'cleanup' commits and output redirection). This comment also applies to the other submitted backport #25143 which has not been merged

@fabiocos
Copy link
Contributor

+1

@cmsbuild cmsbuild merged commit 61b748c into cms-sw:CMSSW_10_3_X Nov 21, 2018
@vargasa vargasa deleted the NoROOTFileFix_103X branch November 27, 2018 14:15
vargasa added a commit to vargasa/cmssw that referenced this pull request Dec 7, 2018
vargasa added a commit to vargasa/cmssw that referenced this pull request Dec 11, 2018
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

6 participants