Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

limited:: module types #20358

Merged
merged 6 commits into from Sep 6, 2017
Merged

limited:: module types #20358

merged 6 commits into from Sep 6, 2017

Conversation

Dr15Jones
Copy link
Contributor

An edm::limited module is similar to an edm::global module (they share the same interface design), however in the edm::limited module's configuration you specify how many concurrent threads are allowed to call the module at any instance in time.

Fix the case where the service seg faults when it is destroyed because an exception happens during configuration time.
Added limited module type and unit tests.
The limited module type is similar to a global module (and uses the same interface) except one specifies in its configuration how many concurrent threads are allowed to call the module.
@cmsbuild
Copy link
Contributor

cmsbuild commented Sep 2, 2017

The code-checks are being triggered in jenkins.

@cmsbuild
Copy link
Contributor

cmsbuild commented Sep 2, 2017

A new Pull Request was created by @Dr15Jones (Chris Jones) for master.

It involves the following packages:

FWCore/Concurrency
FWCore/Framework
FWCore/ParameterSet
FWCore/Services

@cmsbuild, @smuzaffar, @Dr15Jones can you please review it and eventually sign? Thanks.
@Martin-Grunewald, @wddgit this is something you requested to watch as well.
@davidlange6, @slava77 you are the release manager for this.

cms-bot commands are listed here

@Dr15Jones
Copy link
Contributor Author

please test

@cmsbuild
Copy link
Contributor

cmsbuild commented Sep 2, 2017

The tests are being triggered in jenkins.
https://cmssdt.cern.ch/jenkins/job/ib-any-integration/22672/console Started: 2017/09/02 21:22

@cmsbuild
Copy link
Contributor

cmsbuild commented Sep 2, 2017

-code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/PR-20358/470

Code check has found code style and quality issues which could be resolved by applying a patch in https://cmssdt.cern.ch/SDT/code-checks/PR-20358/470/git-diff.patch
e.g. curl https://cmssdt.cern.ch/SDT/code-checks/PR-20358/470/git-diff.patch | patch -p1

You can run scram build code-checks to apply code checks directly (this will soon be required for PRs to be considered)

@Dr15Jones
Copy link
Contributor Author

@dan131riley here is the new module type intended to be used for your new implemention of the PoolOutputModule.

@Dr15Jones
Copy link
Contributor Author

Dr15Jones commented Sep 2, 2017

Many of the 'code checks' are already in #20327. I'd rather wait for that one to be merged and then do a rebase of this pull request.

update: Only Worker.h overlaps with the earler pull request. I applied all but the Worker.h changes to this pull request.

@cmsbuild
Copy link
Contributor

cmsbuild commented Sep 2, 2017

The code-checks are being triggered in jenkins.

@cmsbuild
Copy link
Contributor

cmsbuild commented Sep 2, 2017

Pull request #20358 was updated. @cmsbuild, @smuzaffar, @Dr15Jones can you please check and sign again.

@cmsbuild
Copy link
Contributor

cmsbuild commented Sep 2, 2017

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/PR-20358/472

@Dr15Jones
Copy link
Contributor Author

please abort

@Dr15Jones
Copy link
Contributor Author

type new-feature

@Dr15Jones
Copy link
Contributor Author

please test

@cmsbuild
Copy link
Contributor

cmsbuild commented Sep 2, 2017

The tests are being triggered in jenkins.
https://cmssdt.cern.ch/jenkins/job/ib-any-integration/22673/console Started: 2017/09/02 21:53

@cmsbuild
Copy link
Contributor

cmsbuild commented Sep 2, 2017

@cmsbuild
Copy link
Contributor

cmsbuild commented Sep 2, 2017

Comparison job queued.

@cmsbuild
Copy link
Contributor

cmsbuild commented Sep 3, 2017

Comparison is ready
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-20358/22673/summary.html

Comparison Summary:

  • No significant changes to the logs found
  • Reco comparison results: 0 differences found in the comparisons
  • DQMHistoTests: Total files compared: 26
  • DQMHistoTests: Total histograms compared: 2656222
  • DQMHistoTests: Total failures: 208
  • DQMHistoTests: Total nulls: 0
  • DQMHistoTests: Total successes: 2655825
  • DQMHistoTests: Total skipped: 189
  • DQMHistoTests: Total Missing objects: 0
  • Checked 107 log files, 14 edm output root files, 26 DQM output files

@Dr15Jones
Copy link
Contributor Author

+1

@cmsbuild
Copy link
Contributor

cmsbuild commented Sep 5, 2017

This pull request is fully signed and it will be integrated in one of the next master IBs (tests are also fine). This pull request will now be reviewed by the release team before it's merged. @davidlange6, @slava77, @smuzaffar (and backports should be raised in the release meeting by the corresponding L2)

@davidlange6
Copy link
Contributor

yes, lets save this for 94X

@dan131riley
Copy link

For the ParallelPoolOutputModule I believe this will need implementations of subProcessParentageHelper() and non-placeholder preActionBeforeRunEventAsync(). These, of course, can be done later, and are trivial to copy from the one::OutputModuleBase.

@smuzaffar smuzaffar modified the milestones: CMSSW_9_4_X, CMSSW_9_3_X Sep 6, 2017
@davidlange6
Copy link
Contributor

merge

@cmsbuild cmsbuild merged commit bfa71fa into cms-sw:master Sep 6, 2017
@Dr15Jones Dr15Jones deleted the limitedModule branch September 8, 2017 18:15
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

5 participants