Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix SiStripCluster::size return type #36669

Closed

Conversation

mmusich
Copy link
Contributor

@mmusich mmusich commented Jan 11, 2022

resolves #36336
resolves #35489

PR description:

Follow up on #35489, based on suggestion at #36336 (comment).

  • 48fbd69: Change to SiStripCluster DF, use auto for return types;

PR validation:

cmssw compiles.

@cmsbuild
Copy link
Contributor

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-36669/27723

  • This PR adds an extra 12KB to repository

@cmsbuild
Copy link
Contributor

A new Pull Request was created by @mmusich (Marco Musich) for master.

It involves the following packages:

  • RecoTracker/TkHitPairs (reconstruction)

@jpata, @cmsbuild, @clacaputo, @slava77 can you please review it and eventually sign? Thanks.
@felicepantaleo, @GiacomoSguazzoni, @JanFSchulte, @rovere, @VinInn, @ebrondol, @gpetruc, @mmusich, @mtosi, @dgulhan this is something you requested to watch as well.
@perrotta, @dpiparo, @qliphy you are the release manager for this.

cms-bot commands are listed here

@clacaputo
Copy link
Contributor

@cmsbuild please test

@cmsbuild
Copy link
Contributor

+1

Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-968ef0/21701/summary.html
COMMIT: 004dc94
CMSSW: CMSSW_12_3_X_2022-01-13-1100/slc7_amd64_gcc10
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/36669/21701/install.sh to create a dev area with all the needed externals and cmssw changes.

Comparison Summary

Summary:

  • No significant changes to the logs found
  • Reco comparison results: 4 differences found in the comparisons
  • DQMHistoTests: Total files compared: 43
  • DQMHistoTests: Total histograms compared: 3461659
  • DQMHistoTests: Total failures: 5
  • DQMHistoTests: Total nulls: 0
  • DQMHistoTests: Total successes: 3461632
  • DQMHistoTests: Total skipped: 22
  • DQMHistoTests: Total Missing objects: 0
  • DQMHistoSizes: Histogram memory added: 0.0 KiB( 42 files compared)
  • Checked 181 log files, 42 edm output root files, 43 DQM output files
  • TriggerResults: no differences found

@makortel
Copy link
Contributor

test parameters:

  • enable_test = threading
  • workflows = 11834.21,11834.13
  • release = CMSSW_12_3_ASAN_X

Adding few more 11834.X workflows that we've seen crashes (#36336), and enabling threading to increase chances for the "lucky" 10th event.

@makortel
Copy link
Contributor

@cmsbuild, please test

@makortel
Copy link
Contributor

test parameters:

  • enable_test = threading
  • workflows = 11834.21,11834.13
  • release = CMSSW_12_3_ASAN_X

@makortel
Copy link
Contributor

@cmsbuild, please test

@cmsbuild
Copy link
Contributor

+1

Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-968ef0/21704/summary.html
COMMIT: 004dc94
CMSSW: CMSSW_12_3_X_2022-01-13-1100/slc7_amd64_gcc10
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/36669/21704/install.sh to create a dev area with all the needed externals and cmssw changes.

Comparison Summary

Summary:

  • No significant changes to the logs found
  • Reco comparison results: 8 differences found in the comparisons
  • DQMHistoTests: Total files compared: 43
  • DQMHistoTests: Total histograms compared: 3461659
  • DQMHistoTests: Total failures: 12
  • DQMHistoTests: Total nulls: 0
  • DQMHistoTests: Total successes: 3461625
  • DQMHistoTests: Total skipped: 22
  • DQMHistoTests: Total Missing objects: 0
  • DQMHistoSizes: Histogram memory added: 0.0 KiB( 42 files compared)
  • Checked 181 log files, 42 edm output root files, 43 DQM output files
  • TriggerResults: no differences found

@cmsbuild
Copy link
Contributor

+1

Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-968ef0/21705/summary.html
COMMIT: 004dc94
CMSSW: CMSSW_12_3_ASAN_X_2022-01-12-2300/slc7_amd64_gcc11
Additional Tests: THREADING
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/36669/21705/install.sh to create a dev area with all the needed externals and cmssw changes.

Comparison Summary

@slava77 comparisons for the following workflows were not done due to missing matrix map:

  • /data/cmsbld/jenkins/workspace/compare-root-files-short-matrix/data/PR-968ef0/11834.13_TTbar_14TeV+2021PU_mlpf+TTbar_14TeV_TuneCP5_GenSim+DigiPU+RecoNanoPU+HARVESTNanoPU
  • /data/cmsbld/jenkins/workspace/compare-root-files-short-matrix/data/PR-968ef0/11834.21_TTbar_14TeV+2021PU_ProdLike+TTbar_14TeV_TuneCP5_GenSim+DigiPU+RecoNanoPU+MiniAODPU+NanoPU

Summary:

  • No significant changes to the logs found
  • Reco comparison results: 0 differences found in the comparisons
  • Reco comparison had 73 failed jobs
  • DQMHistoTests: Total files compared: 43
  • DQMHistoTests: Total histograms compared: 3461659
  • DQMHistoTests: Total failures: 1063569
  • DQMHistoTests: Total nulls: 64
  • DQMHistoTests: Total successes: 2398004
  • DQMHistoTests: Total skipped: 22
  • DQMHistoTests: Total Missing objects: 0
  • DQMHistoSizes: Histogram memory added: 3.065 KiB( 42 files compared)
  • DQMHistoSizes: changed ( 10224.0 ): -0.117 KiB SiStrip/MechanicalView
  • DQMHistoSizes: changed ( 11834.0 ): 2.895 KiB SiStrip/MechanicalView
  • DQMHistoSizes: changed ( 250202.181 ): 0.533 KiB SiStrip/MechanicalView
  • DQMHistoSizes: changed ( 25202.0 ): -0.246 KiB SiStrip/MechanicalView
  • Checked 181 log files, 42 edm output root files, 43 DQM output files

@makortel
Copy link
Contributor

Ok, the additional workflows did not end up in the threading test, and the NaN didn't appear there this time.

@mmusich mmusich marked this pull request as ready for review January 17, 2022 12:48
@clacaputo
Copy link
Contributor

I'm testing a recipe for reproducing the NAN and checking the PR, proposed in #36336 (comment) by @missirol

@perrotta
Copy link
Contributor

perrotta commented Feb 1, 2022

test parameters:

  • enable_test = threading
  • workflows = 11834.21,11834.13

@perrotta
Copy link
Contributor

perrotta commented Feb 1, 2022

please test

@cmsbuild
Copy link
Contributor

cmsbuild commented Feb 1, 2022

-1

Failed Tests: UnitTests RelVals-INPUT RelVals-THREADING
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-968ef0/22117/summary.html
COMMIT: 48fbd69
CMSSW: CMSSW_12_3_X_2022-01-31-2300/slc7_amd64_gcc10
Additional Tests: THREADING
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmssw/36669/22117/install.sh to create a dev area with all the needed externals and cmssw changes.

Unit Tests

I found errors in the following unit tests:

---> test testMakeTrackValidationPlots had ERRORS

RelVals-INPUT

  • 1040.01040.0_RunZeroBias2017F+RunZeroBias2017F+TIER0RAWSIPIXELCAL+ALCASPLITSIPIXELCAL+ALCAHARVDSIPIXELCAL/step2_RunZeroBias2017F+RunZeroBias2017F+TIER0RAWSIPIXELCAL+ALCASPLITSIPIXELCAL+ALCAHARVDSIPIXELCAL.log

RelVals-THREADING

  • 250202.181250202.181_TTbar_13UP18+TTbar_13UP18INPUT+PREMIXUP18_PU25+DIGIPRMXLOCALUP18_PU25+RECOPRMXUP18_PU25+HARVESTUP18_PU25/step3_TTbar_13UP18+TTbar_13UP18INPUT+PREMIXUP18_PU25+DIGIPRMXLOCALUP18_PU25+RECOPRMXUP18_PU25+HARVESTUP18_PU25.log

Comparison Summary

@slava77 comparisons for the following workflows were not done due to missing matrix map:

  • /data/cmsbld/jenkins/workspace/compare-root-files-short-matrix/data/PR-968ef0/11834.13_TTbar_14TeV+2021PU_mlpf+TTbar_14TeV_TuneCP5_GenSim+DigiPU+RecoNanoPU+HARVESTNanoPU
  • /data/cmsbld/jenkins/workspace/compare-root-files-short-matrix/data/PR-968ef0/11834.21_TTbar_14TeV+2021PU_ProdLike+TTbar_14TeV_TuneCP5_GenSim+DigiPU+RecoNanoPU+MiniAODPU+NanoPU

Summary:

  • No significant changes to the logs found
  • Reco comparison results: 0 differences found in the comparisons
  • DQMHistoTests: Total files compared: 43
  • DQMHistoTests: Total histograms compared: 3449612
  • DQMHistoTests: Total failures: 16
  • DQMHistoTests: Total nulls: 0
  • DQMHistoTests: Total successes: 3449574
  • DQMHistoTests: Total skipped: 22
  • DQMHistoTests: Total Missing objects: 0
  • DQMHistoSizes: Histogram memory added: 0.0 KiB( 42 files compared)
  • Checked 181 log files, 42 edm output root files, 43 DQM output files
  • TriggerResults: no differences found

@mmusich
Copy link
Contributor Author

mmusich commented Feb 1, 2022

I think at least #36819 is required to pass tests in threading mode

@cmsbuild
Copy link
Contributor

cmsbuild commented Feb 1, 2022

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-36669/28078

  • This PR adds an extra 16KB to repository

@cmsbuild
Copy link
Contributor

cmsbuild commented Feb 1, 2022

Pull request #36669 was updated. @jpata, @cmsbuild, @clacaputo, @slava77 can you please check and sign again.

@mmusich mmusich closed this Feb 1, 2022
@mmusich mmusich force-pushed the bufferOverFlowRechitsSortedInPhi branch from 6eae2ee to 9c97405 Compare February 1, 2022 14:58
@mmusich
Copy link
Contributor Author

mmusich commented Feb 1, 2022

mmmh, I am not sure what happened here... gitHub decided to close the PR and I cannot re-open it...

@makortel
Copy link
Contributor

makortel commented Feb 1, 2022

I have no clue what caused GitHub to close the PR, but after a force-push to a closed PR (as the GH shows the actions here) it is not possible to re-open it. I suggest to open a new PR.

@mmusich
Copy link
Contributor Author

mmusich commented Feb 1, 2022

it is not possible to re-open it. I suggest to open a new PR.

sigh... OK here it is: #36852.
Sorry for the mess, I think that during the rebase I pushed a no-op state and gitHub interpreted this as a signal to close the PR :(

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Segfaults in workflow 11834.21 step 2 buffer overflow in RecHitsSortedInPhi on NaN
10 participants