Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Simplify VVIObjF object so it takes kappa only in the constructor #37533

Merged
merged 2 commits into from Apr 20, 2022

Conversation

tvami
Copy link
Contributor

@tvami tvami commented Apr 11, 2022

PR description:

Resolution to the issue #37529

vvidist was essentially taking 1 parameter so far as well (kappa), now there is a constructor for it that does that alone.

PR validation:

runTheMatrix.py -l 138.4

if this PR is a backport please specify the original PR and why you need to backport that PR:

N/A

Resolves #37529

@tvami
Copy link
Contributor Author

tvami commented Apr 11, 2022

type performance-improvements

@tvami
Copy link
Contributor Author

tvami commented Apr 11, 2022

test parameters:

  • enable_tests = profiling

RecoLocalTracker/SiPixelRecHits/interface/VVIObjF.h Outdated Show resolved Hide resolved
RecoLocalTracker/SiPixelRecHits/src/VVIObjF.cc Outdated Show resolved Hide resolved
RecoLocalTracker/SiPixelRecHits/src/VVIObjF.cc Outdated Show resolved Hide resolved
RecoLocalTracker/SiPixelRecHits/src/VVIObjF.cc Outdated Show resolved Hide resolved
RecoLocalTracker/SiPixelRecHits/src/VVIObjF.cc Outdated Show resolved Hide resolved
@cmsbuild
Copy link
Contributor

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-37533/29245

  • This PR adds an extra 40KB to repository

@cmsbuild
Copy link
Contributor

A new Pull Request was created by @tvami (Tamas Vami) for master.

It involves the following packages:

  • RecoLocalTracker/SiPixelRecHits (reconstruction)

@jpata, @cmsbuild, @clacaputo, @slava77 can you please review it and eventually sign? Thanks.
@mtosi, @felicepantaleo, @GiacomoSguazzoni, @JanFSchulte, @rovere, @VinInn, @OzAmram, @ferencek, @dkotlins, @gpetruc, @mmusich, @threus, @tvami this is something you requested to watch as well.
@perrotta, @dpiparo, @qliphy you are the release manager for this.

cms-bot commands are listed here

@tvami
Copy link
Contributor Author

tvami commented Apr 12, 2022

Except for #37533 (comment) , I changed the PR according to the review, and tested again. It ran fine.

@tvami
Copy link
Contributor Author

tvami commented Apr 12, 2022

@cmsbuild , please test

@cmsbuild
Copy link
Contributor

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-37533/29246

  • This PR adds an extra 40KB to repository

@cmsbuild
Copy link
Contributor

Pull request #37533 was updated. @jpata, @clacaputo, @slava77 can you please check and sign again.

@tvami
Copy link
Contributor Author

tvami commented Apr 12, 2022

@smuzaffar profiling has been running for a long time now (14hours), is that expected?

@tvami
Copy link
Contributor Author

tvami commented Apr 13, 2022

@smuzaffar profiling has been running for a long time now (14hours), is that expected?

@smuzaffar so it's been 2 days now, can you look into this please?

@smuzaffar
Copy link
Contributor

@tvami , profiling job is still running for last 16h , may be igprof is hanging somewhere. Since 5am this morning it is running

05:50:03 + igprof -pp -z -o ./igprofCPU_step3.gz -- cmsRun step3_igprof.py

@cmsbuild
Copy link
Contributor

+1

Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-980085/23921/summary.html
COMMIT: 4fb03c3
CMSSW: CMSSW_12_4_X_2022-04-14-1100/slc7_amd64_gcc10
Additional Tests: PROFILING
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmssw/37533/23921/install.sh to create a dev area with all the needed externals and cmssw changes.

Comparison Summary

Summary:

  • No significant changes to the logs found
  • Reco comparison results: 0 differences found in the comparisons
  • DQMHistoTests: Total files compared: 48
  • DQMHistoTests: Total histograms compared: 3593039
  • DQMHistoTests: Total failures: 2
  • DQMHistoTests: Total nulls: 0
  • DQMHistoTests: Total successes: 3593015
  • DQMHistoTests: Total skipped: 22
  • DQMHistoTests: Total Missing objects: 0
  • DQMHistoSizes: Histogram memory added: 0.0 KiB( 47 files compared)
  • Checked 200 log files, 45 edm output root files, 48 DQM output files
  • TriggerResults: no differences found

@mmusich
Copy link
Contributor

mmusich commented Apr 15, 2022

  • phase2 simulation: Total Cumulative(old->new): 937.32 -> 927.92 (-1%)
  • run3 simulation: Total Cumulative(old->new): 204.76 -> 205.89 (+0.3%)
  • run2 data: Total Cumulative(old->new): 853.33 -> 836.65 (-1.9%)

The reduction in the CPU usage looks sizeable if these numbers are trustable. Wondering why 2021 simulation does not get down, though.

@tvami
Copy link
Contributor Author

tvami commented Apr 15, 2022

run3 simulation: Total Cumulative(old->new): 204.76 -> 205.89 (+0.3%)

Indeed this is surprising to see. Maybe due to some other changes in the IBs? Should we test again?

@jpata
Copy link
Contributor

jpata commented Apr 15, 2022

I'm never sure if the cumulative numbers can be compared in the igprof bot test (the bot test runs on lxplus AFAIK, which can have other things running on the machine).

Comparing the relative time in VVIObjF might be slightly more informative:

in phase2 it's less clear:

So overall it looks like a small effect? In the release-to-release profiling, it might be more measurable (those are run on an unloaded benchmark machine).

@mmusich
Copy link
Contributor

mmusich commented Apr 15, 2022

So overall it looks like a small effect?

This is more in line with my naive expectations, I would have expected that the bulk of the CPU is taken from evaluating all those trigonometric functions, hence was wondering if the cumulative numbers were trustable.

@tvami
Copy link
Contributor Author

tvami commented Apr 19, 2022

Hi @cms-sw/reconstruction-l2 shall this PR be merged? Or I should just close it given that it didn't live up to its expectation? :D

@mmusich
Copy link
Contributor

mmusich commented Apr 19, 2022

Or I should just close it given that it didn't live up to its expectation? :D

why? even if small, it's better than nothing.

@jpata
Copy link
Contributor

jpata commented Apr 19, 2022

+reconstruction

@cmsbuild
Copy link
Contributor

This pull request is fully signed and it will be integrated in one of the next master IBs (tests are also fine). This pull request will now be reviewed by the release team before it's merged. @perrotta, @dpiparo, @qliphy (and backports should be raised in the release meeting by the corresponding L2)

@qliphy
Copy link
Contributor

qliphy commented Apr 20, 2022

+1

@jpata
Copy link
Contributor

jpata commented Apr 25, 2022

type tracking

@mmusich
Copy link
Contributor

mmusich commented Apr 25, 2022

type -tracking

@mmusich
Copy link
Contributor

mmusich commented Apr 25, 2022

type trk

@cmsbuild cmsbuild added trk and removed tracking labels Apr 25, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Potential simplification (and speedup) of Vavilov implementation
6 participants