Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Patatrack Shared Hit Cleaner Fix & Update #33375

Merged
merged 2 commits into from Apr 12, 2021

Conversation

VinInn
Copy link
Contributor

@VinInn VinInn commented Apr 8, 2021

port of cms-patatrack#552

  • adding flag to activate the shared hit cleaning (formerly triplet cleaner) in place of minHitsPerNtuplet cut
  • adding minimum number of hits to allow bpix1 hit sharing (default = 3)
  • changing name from tripletCleaner to sharedHitCleaner

@cmsbuild cmsbuild added this to the CMSSW_11_3_X milestone Apr 8, 2021
@VinInn VinInn changed the title Shared hit cleaner113x Patatrack Shared Hit Cleaner Fix & Update Apr 8, 2021
@VinInn
Copy link
Contributor Author

VinInn commented Apr 8, 2021

@AdrianoDee Please check

@VinInn
Copy link
Contributor Author

VinInn commented Apr 8, 2021

@cmsbuild please test

@cmsbuild
Copy link
Contributor

cmsbuild commented Apr 8, 2021

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-33375/21965

@cmsbuild
Copy link
Contributor

cmsbuild commented Apr 8, 2021

A new Pull Request was created by @VinInn (Vincenzo Innocente) for master.

It involves the following packages:

RecoPixelVertexing/PixelTriplets

@perrotta, @jpata, @slava77 can you please review it and eventually sign? Thanks.
@makortel, @felicepantaleo, @GiacomoSguazzoni, @JanFSchulte, @rovere, @ebrondol, @mtosi, @dgulhan this is something you requested to watch as well.
@silviodonato, @dpiparo, @qliphy you are the release manager for this.

cms-bot commands are listed here

@VinInn
Copy link
Contributor Author

VinInn commented Apr 8, 2021

@cmsbuild enable gpu

@AdrianoDee
Copy link
Contributor

Fine by me!

@cmsbuild
Copy link
Contributor

cmsbuild commented Apr 8, 2021

+1

Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-3ea697/14104/summary.html
COMMIT: 81fbd18
CMSSW: CMSSW_11_3_X_2021-04-08-1100/slc7_amd64_gcc900
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/33375/14104/install.sh to create a dev area with all the needed externals and cmssw changes.

Comparison Summary

Summary:

  • No significant changes to the logs found
  • Reco comparison results: 4 differences found in the comparisons
  • DQMHistoTests: Total files compared: 38
  • DQMHistoTests: Total histograms compared: 2865506
  • DQMHistoTests: Total failures: 7
  • DQMHistoTests: Total nulls: 0
  • DQMHistoTests: Total successes: 2865477
  • DQMHistoTests: Total skipped: 22
  • DQMHistoTests: Total Missing objects: 0
  • DQMHistoSizes: Histogram memory added: 0.0 KiB( 37 files compared)
  • Checked 160 log files, 37 edm output root files, 38 DQM output files
  • TriggerResults: no differences found

@fwyzard
Copy link
Contributor

fwyzard commented Apr 8, 2021

assign heterogeneous

@fwyzard
Copy link
Contributor

fwyzard commented Apr 8, 2021

I'd like to run a benchmark to compare the throughput before and after.

@cmsbuild
Copy link
Contributor

cmsbuild commented Apr 8, 2021

New categories assigned: heterogeneous

@makortel,@fwyzard you have been requested to review this Pull request/Issue and eventually sign? Thanks

@jpata
Copy link
Contributor

jpata commented Apr 9, 2021

No reco changes detected. Nothing to comment on in the code.
Let me know if there are any updates about the performance benchmark. Just to be clear, @fwyzard were you going to run it?
Thanks.

@jpata
Copy link
Contributor

jpata commented Apr 9, 2021

Let me know if there are any updates about the performance benchmark. Just to be clear, @fwyzard were you going to run it?

Nevermind, it was clarified in the reco meeting...

@slava77
Copy link
Contributor

slava77 commented Apr 9, 2021

No reco changes detected.

I don't see the GPU comparisons.
did they run?

@slava77
Copy link
Contributor

slava77 commented Apr 9, 2021

enable gpu

@slava77
Copy link
Contributor

slava77 commented Apr 9, 2021

@cmsbuild please test

@cmsbuild
Copy link
Contributor

cmsbuild commented Apr 9, 2021

+1

Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-3ea697/14144/summary.html
COMMIT: 81fbd18
CMSSW: CMSSW_11_3_X_2021-04-08-2300/slc7_amd64_gcc900
Additional Tests: GPU
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmssw/33375/14144/install.sh to create a dev area with all the needed externals and cmssw changes.

GPU Comparison Summary

Summary:

  • No significant changes to the logs found
  • Reco comparison results: 0 differences found in the comparisons
  • DQMHistoTests: Total files compared: 4
  • DQMHistoTests: Total histograms compared: 9575
  • DQMHistoTests: Total failures: 0
  • DQMHistoTests: Total nulls: 0
  • DQMHistoTests: Total successes: 9575
  • DQMHistoTests: Total skipped: 0
  • DQMHistoTests: Total Missing objects: 0
  • DQMHistoSizes: Histogram memory added: 0.0 KiB( 3 files compared)
  • Checked 12 log files, 9 edm output root files, 4 DQM output files
  • TriggerResults: no differences found

Comparison Summary

Summary:

  • No significant changes to the logs found
  • Reco comparison results: 4 differences found in the comparisons
  • DQMHistoTests: Total files compared: 38
  • DQMHistoTests: Total histograms compared: 2865506
  • DQMHistoTests: Total failures: 7
  • DQMHistoTests: Total nulls: 0
  • DQMHistoTests: Total successes: 2865477
  • DQMHistoTests: Total skipped: 22
  • DQMHistoTests: Total Missing objects: 0
  • DQMHistoSizes: Histogram memory added: 0.0 KiB( 37 files compared)
  • Checked 160 log files, 37 edm output root files, 38 DQM output files
  • TriggerResults: no differences found

@fwyzard
Copy link
Contributor

fwyzard commented Apr 10, 2021

Validation plots

/RelValTTbar_14TeV/CMSSW_11_2_0-PU_112X_mcRun3_2021_realistic_v14-v1/GEN-SIM-DIGI-RAW

  • tracking validation plots and summary for workflow 11634.501
  • tracking validation plots and summary for workflow 11634.502

/RelValZMM_14/CMSSW_11_2_0-112X_mcRun3_2021_realistic_v14-v1/GEN-SIM-DIGI-RAW

  • tracking validation plots and summary for workflow 11634.501
  • tracking validation plots and summary for workflow 11634.502

/RelValZEE_14/CMSSW_11_2_0-112X_mcRun3_2021_realistic_v13-v1/GEN-SIM-DIGI-RAW

  • tracking validation plots and summary for workflow 11634.501
  • tracking validation plots and summary for workflow 11634.502

Validation plots (CPU vs GPU)

/RelValTTbar_14TeV/CMSSW_11_2_0-PU_112X_mcRun3_2021_realistic_v14-v1/GEN-SIM-DIGI-RAW

  • tracking validation plots and summary for workflows 11634.502 and 11634.501

/RelValZMM_14/CMSSW_11_2_0-112X_mcRun3_2021_realistic_v14-v1/GEN-SIM-DIGI-RAW

  • tracking validation plots and summary for workflows 11634.502 and 11634.501

/RelValZEE_14/CMSSW_11_2_0-112X_mcRun3_2021_realistic_v13-v1/GEN-SIM-DIGI-RAW

  • tracking validation plots and summary for workflows 11634.502 and 11634.501

Throughput plots

/EphemeralHLTPhysics1/Run2018D-v1/RAW run=323775 lumi=53

scan-136.885502.png
zoom-136.885502.png
scan-136.885522.png
zoom-136.885522.png

logs and nvprof/nvvp profiles

/RelValTTbar_14TeV/CMSSW_11_2_0-PU_112X_mcRun3_2021_realistic_v14-v1/GEN-SIM-DIGI-RAW

  • reference/CMSSW_11_3_X_2021-04-08-2300 release, workflow 11634.501
  • reference/CMSSW_11_3_X_2021-04-08-2300 release, workflow 11634.502
    • ✔️ step3.py: log
    • ✔️ profile.py: log
    • ✔️ cuda-memcheck --tool initcheck (report, log) did not find any errors
    • ✔️ cuda-memcheck --tool memcheck --leak-check full --report-api-errors all (report, log) did not find any errors
    • ✔️ cuda-memcheck --tool synccheck (report, log) did not find any errors
  • reference/CMSSW_11_3_X_2021-04-08-2300 release, workflow 11634.511
  • reference/CMSSW_11_3_X_2021-04-08-2300 release, workflow 11634.512
    • step3.py: log
    • profile.py: log, profile and summary are missing, see the full log for more information
    • ⚠️ cuda-memcheck --tool initcheck did not run
    • ⚠️ cuda-memcheck --tool memcheck --leak-check full --report-api-errors all did not run
    • ⚠️ cuda-memcheck --tool synccheck did not run
  • reference/CMSSW_11_3_X_2021-04-08-2300 release, workflow 11634.521
  • reference/CMSSW_11_3_X_2021-04-08-2300 release, workflow 11634.522
    • ✔️ step3.py: log
    • ✔️ profile.py: log
    • ✔️ cuda-memcheck --tool initcheck (report, log) did not find any errors
    • ✔️ cuda-memcheck --tool memcheck --leak-check full --report-api-errors all (report, log) did not find any errors
    • ✔️ cuda-memcheck --tool synccheck (report, log) did not find any errors
  • reference/CMSSW_11_3_X_2021-04-08-2300 release, workflow 136.885502
  • reference/CMSSW_11_3_X_2021-04-08-2300 release, workflow 136.885512
  • reference/CMSSW_11_3_X_2021-04-08-2300 release, workflow 136.885522
  • testing/CMSSW_11_3_X_2021-04-08-2300 release, workflow 11634.501
  • testing/CMSSW_11_3_X_2021-04-08-2300 release, workflow 11634.502
    • ✔️ step3.py: log
    • ✔️ profile.py: log
    • ✔️ cuda-memcheck --tool initcheck (report, log) did not find any errors
    • ✔️ cuda-memcheck --tool memcheck --leak-check full --report-api-errors all (report, log) did not find any errors
    • ✔️ cuda-memcheck --tool synccheck (report, log) did not find any errors
  • testing/CMSSW_11_3_X_2021-04-08-2300 release, workflow 11634.511
  • testing/CMSSW_11_3_X_2021-04-08-2300 release, workflow 11634.512
    • step3.py: log
    • profile.py: log, profile and summary are missing, see the full log for more information
    • ⚠️ cuda-memcheck --tool initcheck did not run
    • ⚠️ cuda-memcheck --tool memcheck --leak-check full --report-api-errors all did not run
    • ⚠️ cuda-memcheck --tool synccheck did not run
  • testing/CMSSW_11_3_X_2021-04-08-2300 release, workflow 11634.521
  • testing/CMSSW_11_3_X_2021-04-08-2300 release, workflow 11634.522
    • ✔️ step3.py: log
    • ✔️ profile.py: log
    • ✔️ cuda-memcheck --tool initcheck (report, log) did not find any errors
    • ✔️ cuda-memcheck --tool memcheck --leak-check full --report-api-errors all (report, log) did not find any errors
    • ✔️ cuda-memcheck --tool synccheck (report, log) did not find any errors
  • testing/CMSSW_11_3_X_2021-04-08-2300 release, workflow 136.885502
  • testing/CMSSW_11_3_X_2021-04-08-2300 release, workflow 136.885512
  • testing/CMSSW_11_3_X_2021-04-08-2300 release, workflow 136.885522

/RelValZMM_14/CMSSW_11_2_0-112X_mcRun3_2021_realistic_v14-v1/GEN-SIM-DIGI-RAW

  • reference/CMSSW_11_3_X_2021-04-08-2300 release, workflow 11634.501
  • reference/CMSSW_11_3_X_2021-04-08-2300 release, workflow 11634.502
    • ✔️ step3.py: log
    • ✔️ profile.py: log
    • ✔️ cuda-memcheck --tool initcheck (report, log) did not find any errors
    • ✔️ cuda-memcheck --tool memcheck --leak-check full --report-api-errors all (report, log) did not find any errors
    • ✔️ cuda-memcheck --tool synccheck (report, log) did not find any errors
  • reference/CMSSW_11_3_X_2021-04-08-2300 release, workflow 11634.511
  • reference/CMSSW_11_3_X_2021-04-08-2300 release, workflow 11634.512
    • step3.py: log
    • profile.py: log, profile and summary are missing, see the full log for more information
    • ⚠️ cuda-memcheck --tool initcheck did not run
    • ⚠️ cuda-memcheck --tool memcheck --leak-check full --report-api-errors all did not run
    • ⚠️ cuda-memcheck --tool synccheck did not run
  • reference/CMSSW_11_3_X_2021-04-08-2300 release, workflow 11634.521
  • reference/CMSSW_11_3_X_2021-04-08-2300 release, workflow 11634.522
    • ✔️ step3.py: log
    • ✔️ profile.py: log
    • ✔️ cuda-memcheck --tool initcheck (report, log) did not find any errors
    • ✔️ cuda-memcheck --tool memcheck --leak-check full --report-api-errors all (report, log) did not find any errors
    • ✔️ cuda-memcheck --tool synccheck (report, log) did not find any errors
  • reference/CMSSW_11_3_X_2021-04-08-2300 release, workflow 136.885502
  • reference/CMSSW_11_3_X_2021-04-08-2300 release, workflow 136.885512
  • reference/CMSSW_11_3_X_2021-04-08-2300 release, workflow 136.885522
  • testing/CMSSW_11_3_X_2021-04-08-2300 release, workflow 11634.501
  • testing/CMSSW_11_3_X_2021-04-08-2300 release, workflow 11634.502
    • ✔️ step3.py: log
    • ✔️ profile.py: log
    • ✔️ cuda-memcheck --tool initcheck (report, log) did not find any errors
    • ✔️ cuda-memcheck --tool memcheck --leak-check full --report-api-errors all (report, log) did not find any errors
    • ✔️ cuda-memcheck --tool synccheck (report, log) did not find any errors
  • testing/CMSSW_11_3_X_2021-04-08-2300 release, workflow 11634.511
  • testing/CMSSW_11_3_X_2021-04-08-2300 release, workflow 11634.512
    • step3.py: log
    • profile.py: log, profile and summary are missing, see the full log for more information
    • ⚠️ cuda-memcheck --tool initcheck did not run
    • ⚠️ cuda-memcheck --tool memcheck --leak-check full --report-api-errors all did not run
    • ⚠️ cuda-memcheck --tool synccheck did not run
  • testing/CMSSW_11_3_X_2021-04-08-2300 release, workflow 11634.521
  • testing/CMSSW_11_3_X_2021-04-08-2300 release, workflow 11634.522
    • ✔️ step3.py: log
    • ✔️ profile.py: log
    • ✔️ cuda-memcheck --tool initcheck (report, log) did not find any errors
    • ✔️ cuda-memcheck --tool memcheck --leak-check full --report-api-errors all (report, log) did not find any errors
    • ✔️ cuda-memcheck --tool synccheck (report, log) did not find any errors
  • testing/CMSSW_11_3_X_2021-04-08-2300 release, workflow 136.885502
  • testing/CMSSW_11_3_X_2021-04-08-2300 release, workflow 136.885512
  • testing/CMSSW_11_3_X_2021-04-08-2300 release, workflow 136.885522

/RelValZEE_14/CMSSW_11_2_0-112X_mcRun3_2021_realistic_v13-v1/GEN-SIM-DIGI-RAW

  • reference/CMSSW_11_3_X_2021-04-08-2300 release, workflow 11634.501
  • reference/CMSSW_11_3_X_2021-04-08-2300 release, workflow 11634.502
    • ✔️ step3.py: log
    • ✔️ profile.py: log
    • ✔️ cuda-memcheck --tool initcheck (report, log) did not find any errors
    • ✔️ cuda-memcheck --tool memcheck --leak-check full --report-api-errors all (report, log) did not find any errors
    • ✔️ cuda-memcheck --tool synccheck (report, log) did not find any errors
  • reference/CMSSW_11_3_X_2021-04-08-2300 release, workflow 11634.511
  • reference/CMSSW_11_3_X_2021-04-08-2300 release, workflow 11634.512
    • step3.py: log
    • profile.py: log, profile and summary are missing, see the full log for more information
    • ⚠️ cuda-memcheck --tool initcheck did not run
    • ⚠️ cuda-memcheck --tool memcheck --leak-check full --report-api-errors all did not run
    • ⚠️ cuda-memcheck --tool synccheck did not run
  • reference/CMSSW_11_3_X_2021-04-08-2300 release, workflow 11634.521
  • reference/CMSSW_11_3_X_2021-04-08-2300 release, workflow 11634.522
    • ✔️ step3.py: log
    • ✔️ profile.py: log
    • ✔️ cuda-memcheck --tool initcheck (report, log) did not find any errors
    • ✔️ cuda-memcheck --tool memcheck --leak-check full --report-api-errors all (report, log) did not find any errors
    • ✔️ cuda-memcheck --tool synccheck (report, log) did not find any errors
  • reference/CMSSW_11_3_X_2021-04-08-2300 release, workflow 136.885502
  • reference/CMSSW_11_3_X_2021-04-08-2300 release, workflow 136.885512
  • reference/CMSSW_11_3_X_2021-04-08-2300 release, workflow 136.885522
  • testing/CMSSW_11_3_X_2021-04-08-2300 release, workflow 11634.501
  • testing/CMSSW_11_3_X_2021-04-08-2300 release, workflow 11634.502
    • ✔️ step3.py: log
    • ✔️ profile.py: log
    • ✔️ cuda-memcheck --tool initcheck (report, log) did not find any errors
    • ✔️ cuda-memcheck --tool memcheck --leak-check full --report-api-errors all (report, log) did not find any errors
    • ✔️ cuda-memcheck --tool synccheck (report, log) did not find any errors
  • testing/CMSSW_11_3_X_2021-04-08-2300 release, workflow 11634.511
  • testing/CMSSW_11_3_X_2021-04-08-2300 release, workflow 11634.512
    • step3.py: log
    • profile.py: log, profile and summary are missing, see the full log for more information
    • ⚠️ cuda-memcheck --tool initcheck did not run
    • ⚠️ cuda-memcheck --tool memcheck --leak-check full --report-api-errors all did not run
    • ⚠️ cuda-memcheck --tool synccheck did not run
  • testing/CMSSW_11_3_X_2021-04-08-2300 release, workflow 11634.521
  • testing/CMSSW_11_3_X_2021-04-08-2300 release, workflow 11634.522
    • ✔️ step3.py: log
    • ✔️ profile.py: log
    • ✔️ cuda-memcheck --tool initcheck (report, log) did not find any errors
    • ✔️ cuda-memcheck --tool memcheck --leak-check full --report-api-errors all (report, log) did not find any errors
    • ✔️ cuda-memcheck --tool synccheck (report, log) did not find any errors
  • testing/CMSSW_11_3_X_2021-04-08-2300 release, workflow 136.885502
  • testing/CMSSW_11_3_X_2021-04-08-2300 release, workflow 136.885512
  • testing/CMSSW_11_3_X_2021-04-08-2300 release, workflow 136.885522

/EphemeralHLTPhysics1/Run2018D-v1/RAW run=323775 lumi=53

  • reference/CMSSW_11_3_X_2021-04-08-2300 release, workflow 11634.501
  • reference/CMSSW_11_3_X_2021-04-08-2300 release, workflow 11634.502
  • reference/CMSSW_11_3_X_2021-04-08-2300 release, workflow 11634.511
  • reference/CMSSW_11_3_X_2021-04-08-2300 release, workflow 11634.512
  • reference/CMSSW_11_3_X_2021-04-08-2300 release, workflow 11634.521
  • reference/CMSSW_11_3_X_2021-04-08-2300 release, workflow 11634.522
  • reference/CMSSW_11_3_X_2021-04-08-2300 release, workflow 136.885502
  • reference/CMSSW_11_3_X_2021-04-08-2300 release, workflow 136.885512
    • step3.py: log
    • profile.py: log, profile and summary are missing, see the full log for more information
  • reference/CMSSW_11_3_X_2021-04-08-2300 release, workflow 136.885522
  • testing/CMSSW_11_3_X_2021-04-08-2300 release, workflow 11634.501
  • testing/CMSSW_11_3_X_2021-04-08-2300 release, workflow 11634.502
  • testing/CMSSW_11_3_X_2021-04-08-2300 release, workflow 11634.511
  • testing/CMSSW_11_3_X_2021-04-08-2300 release, workflow 11634.512
  • testing/CMSSW_11_3_X_2021-04-08-2300 release, workflow 11634.521
  • testing/CMSSW_11_3_X_2021-04-08-2300 release, workflow 11634.522
  • testing/CMSSW_11_3_X_2021-04-08-2300 release, workflow 136.885502
  • testing/CMSSW_11_3_X_2021-04-08-2300 release, workflow 136.885512
    • step3.py: log
    • profile.py: log, profile and summary are missing, see the full log for more information
  • testing/CMSSW_11_3_X_2021-04-08-2300 release, workflow 136.885522

Logs

The full log is available at https://patatrack.web.cern.ch/patatrack/validation/pulls/e3c9984e24f59f067454e9daea5bbf5bcd5d3407/log .

@jpata
Copy link
Contributor

jpata commented Apr 12, 2021

Thanks for the retest and performance benchmark. From what I can tell, there is no significant difference in the throughput. There are also no reco differences with the GPU test enabled.

@fwyzard
Copy link
Contributor

fwyzard commented Apr 12, 2021

Correct. We could run more tests after #31854 is merged, but I don't think that's necessary - I think we can just go ahead with this one.

@fwyzard
Copy link
Contributor

fwyzard commented Apr 12, 2021

+heterogeneous

@jpata
Copy link
Contributor

jpata commented Apr 12, 2021

+reconstruction

  • follow-up for Patatrack vertexing
  • technical, no observed reco changes in the GPU workflows
  • Patatrack benchmarks show no throughput regressions

@cmsbuild
Copy link
Contributor

This pull request is fully signed and it will be integrated in one of the next master IBs (tests are also fine). This pull request will now be reviewed by the release team before it's merged. @silviodonato, @dpiparo, @qliphy (and backports should be raised in the release meeting by the corresponding L2)

@silviodonato
Copy link
Contributor

+1

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

7 participants