Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Appy event filter before data prefetching for OutputModules #11092

Merged

Conversation

Dr15Jones
Copy link
Contributor

This is a backport of #10202. There was a request from analysis users for this to be backported to 7_4 but we need full testing in 7_5 before we can allow this large of a change.

The method isn't used and the present signature does not allow for consumes.
If it becomes necessary to return this functionality, it should be done by adding a
stand alone function which is passed an EDGetTokenT<TriggerResults>.
The legacy OutputModule uses a modified version of this to support
StreamerOutputModuleBase.
The previous API for getTriggerResults would allow one to retrieve the results without having to first declare consumes. The new interface requires an EDGetTokenT<TriggerResults>. The implementation of this function also avoids coupling with the event selector code. This allowed those interfaces to be removed from TriggerResultsBasedEventSelector.
In order to allow event selection checking to run in parallel, we needed a TriggerResultsBasedEventSelector per stream.
Changes to the implementation of the OutputModule now require a properly initialized StreamID when calling the Event method.
…e prefetching data

There is no reason to prefetch data and subsequently causing either delayed read or unscheduled execution if the TriggerResults being watched designate that the event should not be stored.
@Dr15Jones
Copy link
Contributor Author

@davidlange6 Here is the initial backport.

@cmsbuild
Copy link
Contributor

cmsbuild commented Sep 2, 2015

A new Pull Request was created by @Dr15Jones (Chris Jones) for CMSSW_7_5_X.

Appy event filter before data prefetching for OutputModules

It involves the following packages:

FWCore/Framework
IOPool/Streamer

@cmsbuild, @smuzaffar, @Dr15Jones can you please review it and eventually sign? Thanks.
@Martin-Grunewald, @wddgit, @wmtan this is something you requested to watch as well.
You can sign-off by replying to this message having '+1' in the first line of your reply.
You can reject by replying to this message having '-1' in the first line of your reply.
If you are a L2 or a release manager you can ask for tests by saying 'please test' in the first line of a comment.
@Degano you are the release manager for this.
You can merge this pull request by typing 'merge' in the first line of your comment.

@Dr15Jones
Copy link
Contributor Author

please test

@Dr15Jones
Copy link
Contributor Author

+1

@cmsbuild
Copy link
Contributor

cmsbuild commented Sep 2, 2015

The tests are being triggered in jenkins.

@cmsbuild
Copy link
Contributor

cmsbuild commented Sep 2, 2015

This pull request is fully signed and it will be integrated in one of the next CMSSW_7_5_X IBs once checked with relvals in the development release cycle of CMSSW or unless it breaks tests. This pull request requires discussion in the ORP meeting before it's merged. @davidlange6, @Degano, @smuzaffar

@cmsbuild
Copy link
Contributor

cmsbuild commented Sep 2, 2015

This pull request is fully signed and it will be integrated in one of the next CMSSW_7_5_X IBs once checked with relvals in the development release cycle of CMSSW or unless it breaks tests. This pull request requires discussion in the ORP meeting before it's merged. @davidlange6, @Degano, @smuzaffar

@cmsbuild
Copy link
Contributor

cmsbuild commented Sep 3, 2015

-1

Tested at: c38f696
I found errors in the following unit tests:

---> test HcalGeometryTest had ERRORS

you can see the results of the tests here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-11092/7841/summary.html

@cmsbuild
Copy link
Contributor

cmsbuild commented Sep 3, 2015

This pull request is fully signed and it will be integrated in one of the next CMSSW_7_5_X IBs once checked with relvals in the development release cycle of CMSSW (but tests are reportedly failing). This pull request requires discussion in the ORP meeting before it's merged. @davidlange6, @Degano, @smuzaffar

@cmsbuild
Copy link
Contributor

cmsbuild commented Sep 3, 2015

@cmsbuild
Copy link
Contributor

cmsbuild commented Sep 3, 2015

This pull request is fully signed and it will be integrated in one of the next CMSSW_7_5_X IBs once checked with relvals in the development release cycle of CMSSW (but tests are reportedly failing). This pull request requires discussion in the ORP meeting before it's merged. @davidlange6, @Degano, @smuzaffar

@Dr15Jones
Copy link
Contributor Author

@davidlange6
The unit test that is failing is also failing in the IB
https://cmssdt.cern.ch/SDT/cgi-bin/showBuildLogs.py/slc6_amd64_gcc491/www/wed/7.5-wed-11/CMSSW_7_5_X_2015-09-02-1100

I traced the problem down to a missing python file Configuration.Geometry.GeometryExtendedPostLS2_cff

davidlange6 added a commit that referenced this pull request Sep 4, 2015
Appy event filter before data prefetching for OutputModules
@davidlange6 davidlange6 merged commit 8247b6c into cms-sw:CMSSW_7_5_X Sep 4, 2015
@Dr15Jones Dr15Jones deleted the eventFilterBeforePrefetch_7_5 branch September 24, 2015 18:29
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants