Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Prioritize exception from Paths #23432

Merged
merged 3 commits into from
Jun 6, 2018

Conversation

Dr15Jones
Copy link
Contributor

When multiple exceptions occur when processing an Event, prioritize the exception originating from a Path over those from EndPaths or Accumulators.

This comes from diagnosing failures coming in the gcc 8 IBs where an exception originating in a Path ultimately leads to missing data which triggers a different exception when running accumulators.

Use std::move to allow use of a lambda that only has a move
constructor and no copy constructor.
When reporting an exception from processing an event, prioritize
exceptions originating from a Path over those from EndPaths or
from calling accumulators.
@cmsbuild
Copy link
Contributor

cmsbuild commented Jun 2, 2018

The code-checks are being triggered in jenkins.

@Dr15Jones
Copy link
Contributor Author

please test

@cmsbuild
Copy link
Contributor

cmsbuild commented Jun 2, 2018

@cmsbuild
Copy link
Contributor

cmsbuild commented Jun 2, 2018

The tests are being triggered in jenkins.
https://cmssdt.cern.ch/jenkins/job/ib-any-integration/28397/console Started: 2018/06/02 20:16

@cmsbuild
Copy link
Contributor

cmsbuild commented Jun 2, 2018

A new Pull Request was created by @Dr15Jones (Chris Jones) for master.

It involves the following packages:

FWCore/Concurrency
FWCore/Framework

@cmsbuild, @smuzaffar, @Dr15Jones can you please review it and eventually sign? Thanks.
@makortel, @Martin-Grunewald, @wddgit this is something you requested to watch as well.
@davidlange6, @slava77, @fabiocos you are the release manager for this.

cms-bot commands are listed here

@Dr15Jones
Copy link
Contributor Author

@smuzaffar are the tests for this pull request stuck? The log has the last entry at 20:00 yesterday.

@Dr15Jones
Copy link
Contributor Author

please test

@cmsbuild
Copy link
Contributor

cmsbuild commented Jun 3, 2018

The tests are being triggered in jenkins.
https://cmssdt.cern.ch/jenkins/job/ib-any-integration/28400/console Started: 2018/06/03 19:02

@cmsbuild
Copy link
Contributor

cmsbuild commented Jun 3, 2018

-1

Tested at: bae6614

You can see the results of the tests here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-23432/28400/summary.html

I found follow errors while testing this PR

Failed tests: UnitTests

  • Unit Tests:

I found errors in the following unit tests:

---> test TestFWCoreFrameworkInputTagFailure had ERRORS
---> test CatchCmsExceptiontest had ERRORS

@cmsbuild
Copy link
Contributor

cmsbuild commented Jun 3, 2018

Comparison job queued.

@cmsbuild
Copy link
Contributor

cmsbuild commented Jun 4, 2018

Comparison is ready
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-23432/28400/summary.html

Comparison Summary:

  • No significant changes to the logs found
  • Reco comparison results: 0 differences found in the comparisons
  • DQMHistoTests: Total files compared: 31
  • DQMHistoTests: Total histograms compared: 2902471
  • DQMHistoTests: Total failures: 26
  • DQMHistoTests: Total nulls: 0
  • DQMHistoTests: Total successes: 2902255
  • DQMHistoTests: Total skipped: 190
  • DQMHistoTests: Total Missing objects: 0
  • DQMHistoSizes: Histogram memory added: 0.0 KiB( 30 files compared)
  • Checked 128 log files, 14 edm output root files, 31 DQM output files

@cmsbuild
Copy link
Contributor

cmsbuild commented Jun 5, 2018

-1

Tested at: afa8f9d

You can see the results of the tests here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-23432/28458/summary.html

I found follow errors while testing this PR

Failed tests: UnitTests

  • Unit Tests:

I found errors in the following unit tests:

---> test TestFWCoreFrameworkGlobalStreamOne had ERRORS

@cmsbuild
Copy link
Contributor

cmsbuild commented Jun 5, 2018

Comparison job queued.

@Dr15Jones
Copy link
Contributor Author

The unit test failure is from an assert failing while running cmsRun. Unfortunately, the output of cmsRun is not preserved so it is not possible to see what failed.

@Dr15Jones
Copy link
Contributor Author

@fabiocos this change should only effect what exception message is printed when a job fails. The pull request should have absolutely no effect on jobs that run without a problem.

@fabiocos
Copy link
Contributor

fabiocos commented Jun 5, 2018

please test

@cmsbuild
Copy link
Contributor

cmsbuild commented Jun 5, 2018

The tests are being triggered in jenkins.
https://cmssdt.cern.ch/jenkins/job/ib-any-integration/28485/console Started: 2018/06/05 15:32

@Dr15Jones
Copy link
Contributor Author

@fabiocos I reran the unit test locally 50 times and never had a failure. Therefore I feel comfortable saying it was a transient effect.

@cmsbuild
Copy link
Contributor

cmsbuild commented Jun 5, 2018

@cmsbuild
Copy link
Contributor

cmsbuild commented Jun 5, 2018

Comparison job queued.

@cmsbuild
Copy link
Contributor

cmsbuild commented Jun 5, 2018

Comparison is ready
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-23432/28485/summary.html

Comparison Summary:

  • No significant changes to the logs found
  • Reco comparison results: 8 differences found in the comparisons
  • DQMHistoTests: Total files compared: 31
  • DQMHistoTests: Total histograms compared: 2902471
  • DQMHistoTests: Total failures: 1
  • DQMHistoTests: Total nulls: 0
  • DQMHistoTests: Total successes: 2902280
  • DQMHistoTests: Total skipped: 190
  • DQMHistoTests: Total Missing objects: 0
  • DQMHistoSizes: Histogram memory added: 0.0 KiB( 30 files compared)
  • Checked 128 log files, 14 edm output root files, 31 DQM output files

@fabiocos
Copy link
Contributor

fabiocos commented Jun 6, 2018

+1

@cmsbuild cmsbuild merged commit 3f93e81 into cms-sw:master Jun 6, 2018
@Dr15Jones Dr15Jones deleted the prioritizeExceptionFromPaths branch June 18, 2018 13:50
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants