Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Avoid unneeded retrievel of per event provenance #13722

Merged

Conversation

wmtan
Copy link
Contributor

@wmtan wmtan commented Mar 15, 2016

This pull request replaces most calls of getAllProvenance() with calls of a new function, getAllStableProvenance(), which avoids accessing the portions of the provenance that may change each event. This avoids a potential problem with thread safety. None of the replaced calls used the per event provenance, anyway. This PR solves issue #13624 .

@cmsbuild
Copy link
Contributor

A new Pull Request was created by @wmtan for CMSSW_8_1_X.

It involves the following packages:

Calibration/HcalAlCaRecoProducers
Calibration/HcalCalibAlgos
DataFormats/Provenance
FWCore/Framework
FWCore/Modules
Fireworks/FWInterface
IOPool/Input
RecoMET/METFilters
Validation/GlobalDigis
Validation/GlobalHits
Validation/GlobalRecHits
Validation/MuonHits
Validation/TrackerHits

@smuzaffar, @diguida, @cvuosalo, @cerminar, @monttj, @cmsbuild, @alja, @franzoni, @Dr15Jones, @deguio, @slava77, @vadler, @mmusich, @vanbesien, @davidlange6 can you please review it and eventually sign? Thanks.
@TaiSakuma, @alja, @ahinzmann, @mmarionncern, @wddgit, @Martin-Grunewald, @jdolen, @nhanvtran, @tocheng, @schoef, @mariadalfonso, @threus this is something you requested to watch as well.
@slava77, @Degano, @smuzaffar you are the release manager for this.

cms-bot commands are list here #13028

@wmtan wmtan force-pushed the DoNotReadPerEventProvenanceIfNotNeeded branch from ff25955 to f9475af Compare March 15, 2016 03:45
@wmtan
Copy link
Contributor Author

wmtan commented Mar 15, 2016

@cmsbuild please test

@cmsbuild
Copy link
Contributor

@deguio
Copy link
Contributor

deguio commented Mar 15, 2016

please test

@deguio
Copy link
Contributor

deguio commented Mar 15, 2016

+1
provided it passes the tests

@cmsbuild
Copy link
Contributor

The tests are being triggered in jenkins.
https://cmssdt.cern.ch/jenkins/job/ib-any-integration/11886/console

@cmsbuild
Copy link
Contributor

Comparison not run due to Build errors (RelVals and Igprof tests were also skipped)

@cmsbuild
Copy link
Contributor

-1
Tested at: f9475af
I found an error when building:

>> Compiling  /build/cmsbuild/jenkins-workarea/workspace/ib-any-integration/CMSSW_8_1_X_2016-03-14-1100/src/Fireworks/Core/src/CmsShowEDI.cc 
In file included from /build/cmsbuild/jenkins-workarea/workspace/ib-any-integration/CMSSW_8_1_X_2016-03-14-1100/src/Fireworks/Core/src/FWEveView.cc:41:0:
/build/cmsbuild/jenkins-workarea/workspace/ib-any-integration/CMSSW_8_1_X_2016-03-14-1100/src/Fireworks/Core/interface/FWEventAnnotation.h:4:27: warning: /cvmfs/cms-ib.cern.ch/2016-12/slc6_amd64_gcc530/lcg/root/6.06.00-giojec/include/TGLAnnotation.h is shorter than expected
>> Compiling  /build/cmsbuild/jenkins-workarea/workspace/ib-any-integration/CMSSW_8_1_X_2016-03-14-1100/src/Fireworks/Core/src/FWGeometry.cc 
/build/cmsbuild/jenkins-workarea/workspace/ib-any-integration/CMSSW_8_1_X_2016-03-14-1100/src/Fireworks/Core/src/FWViewContextMenuHandlerGL.cc: In member function 'virtual void FWViewContextMenuHandlerGL::select(int, const FWModelId&, int, int)':
/build/cmsbuild/jenkins-workarea/workspace/ib-any-integration/CMSSW_8_1_X_2016-03-14-1100/src/Fireworks/Core/src/FWViewContextMenuHandlerGL.cc:67:116: error: invalid use of incomplete type 'class TGLAnnotation'
          TGLAnnotation _an = new TGLAnnotation(v, name.c_str(),  x_1.f/f->GetWidth(), 1 - y*1.f/f->GetHeight(), pnt);
                                                                                                                    ^
In file included from /build/cmsbuild/jenkins-workarea/workspace/ib-any-integration/CMSSW_8_1_X_2016-03-14-1100/src/Fireworks/Core/src/FWViewContextMenuHandlerGL.cc:12:0:
/build/cmsbuild/jenkins-workarea/workspace/ib-any-integration/CMSSW_8_1_X_2016-03-14-1100/src/Fireworks/Core/interface/FWEveView.h:30:7: note: forward declaration of 'class TGLAnnotation'
 class TGLAnnotation;


you can see the results of the tests here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-13722/11881/summary.html

@wmtan
Copy link
Contributor Author

wmtan commented Mar 15, 2016

@smuzaffar I can't imagine that the changes are not gcc53 compatible, but I will build against gcc53 just to be sure.

@cmsbuild
Copy link
Contributor

Pull request #13722 was updated. @smuzaffar, @diguida, @cvuosalo, @cerminar, @monttj, @cmsbuild, @alja, @franzoni, @Dr15Jones, @deguio, @slava77, @vadler, @mmusich, @vanbesien, @davidlange6 can you please check and sign again.

@cmsbuild
Copy link
Contributor

Comparison is ready
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-13722/11886/summary.html

The workflows 140.53 have different files in step1_dasquery.log than the ones found in the baseline. You may want to check and retrigger the tests if necessary. You can check it in the "files" directory in the results of the comparisons

@smuzaffar
Copy link
Contributor

please test

@cmsbuild
Copy link
Contributor

The tests are being triggered in jenkins.
https://cmssdt.cern.ch/jenkins/job/ib-any-integration/11913/console

@wmtan
Copy link
Contributor Author

wmtan commented Mar 15, 2016

@smuzaffar I built this PR with gcc530, and there were no build errors.

@cmsbuild
Copy link
Contributor

-1

Tested at: ab05d71
I found errors in the following unit tests:

---> test runtestTqafTopEventSelection had ERRORS

you can see the results of the tests here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-13722/11913/summary.html

@Dr15Jones
Copy link
Contributor

+1

@Dr15Jones
Copy link
Contributor

The test failures are unrelated to this pull request.

@cmsbuild
Copy link
Contributor

-1

Tested at: ab05d71
I found errors in the following unit tests:

---> test testRecoMETMETProducers had ERRORS
---> test runtestTqafTopEventSelection had ERRORS

you can see the results of the tests here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-13722/11912/summary.html

@cmsbuild
Copy link
Contributor

Comparison is ready
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-13722/11912/summary.html

The workflows 140.53 have different files in step1_dasquery.log than the ones found in the baseline. You may want to check and retrigger the tests if necessary. You can check it in the "files" directory in the results of the comparisons

@cmsbuild
Copy link
Contributor

Comparison is ready
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-13722/11913/summary.html

The workflows 140.53 have different files in step1_dasquery.log than the ones found in the baseline. You may want to check and retrigger the tests if necessary. You can check it in the "files" directory in the results of the comparisons

davidlange6 added a commit that referenced this pull request Mar 16, 2016
…Needed

Avoid unneeded retrievel of per event provenance
@davidlange6 davidlange6 merged commit 6f5a500 into cms-sw:CMSSW_8_1_X Mar 16, 2016
@wmtan wmtan deleted the DoNotReadPerEventProvenanceIfNotNeeded branch March 16, 2016 22:18
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

6 participants