New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
implement Concurrent GeneratorFilter technique #33883
Conversation
Implement Concurrent GeneratorFilter technique, which can replicate the Generator for each stream in order to run them concurrently. Add a concurrent module of pythia8 generator and a python _cfg file for test. Clean the redundance in `GeneratorInterface/Pythia8Interface/plugins/BuildFile.xml`.
+code-checks Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-33883/22920 |
A new Pull Request was created by @PhyM73 (Frank M) for master. It involves the following packages: GeneratorInterface/Core @SiewYan, @mkirsano, @cmsbuild, @GurpreetSinghChahal, @agrohsje, @alberto-sanchez can you please review it and eventually sign? Thanks. cms-bot commands are listed here |
please test |
@makortel @Dr15Jones FYI. : ) |
@PhyM73 Thanks! |
+1 Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-bb2040/15391/summary.html Comparison SummarySummary:
|
+code-checks Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-33883/22932 |
Pull request #33883 was updated. @SiewYan, @mkirsano, @cmsbuild, @GurpreetSinghChahal, @agrohsje, @alberto-sanchez can you please check and sign again. |
please test |
-code-checks Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-33883/23108
Code check has found code style and quality issues which could be resolved by applying following patch(s)
|
+code-checks Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-33883/23109 |
Pull request #33883 was updated. @SiewYan, @mkirsano, @cmsbuild, @GurpreetSinghChahal, @agrohsje, @alberto-sanchez can you please check and sign again. |
please test |
+1 Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-bb2040/15717/summary.html Comparison SummarySummary:
|
+generators |
This pull request is fully signed and it will be integrated in one of the next master IBs (tests are also fine). This pull request will now be reviewed by the release team before it's merged. @silviodonato, @dpiparo, @qliphy (and backports should be raised in the release meeting by the corresponding L2) |
+1 |
PR description:
The concurrent version of
GeneratorFilter
is implemented for GEN workflows. This global module mimics theConcurrentHadronizerFilter
and replicates the Generator for each stream in order to run them concurrently. This only works for thread-friendly hadronizers, decayers, and filters.Pythia8ConcurrentGeneratorFilter
.GeneratorInterface/Pythia8Interface/test/BuildFile.xml
and a test file asGeneratorInterface/Core/test/ConcurrentGeneratorFilter_WZ_TuneCP5_13TeV-pythia8_cfg.py
.PR validation:
Tested on BTV-RunIISummer20UL17GEN-00002 with 2, 4, and 8 threads and with 1 and 2 ConcurrentLuminosityBlocks respectively. All of them succeed.