Update all GPU workflows #37411

fwyzard · 2022-03-30T12:38:42Z

PR description:

Add Pixel-only and HCAL-only validation workflows:

Pixel only, on CPU and GPU, with GPU-vs-CPU validation: #.503 (quadruplets), #.507 (triplets)
HCAL only, on CPU and GPU, with GPU-vs-CPU validation: #.523

Enable the existing Pixel-only and HCAL-only profiling workflows:

Pixel only, on GPU (optionally): #.504 (quadruplets), #.508 (triplets)
HCAL only, on GPU (optionally): #.524

Add a single workflow running all GPU-enabled reconstruction (Pixel, ECAL, HCAL):

all, on CPU: #.581 (quadruplets) and #.585 (triplets)
all, on GPU (optionally): #.582 (pixel quadruplets) and #.586 (triplets)
all, on CPU and GPU, with GPU-vs-CPU validation: #.583 (quadruplets) and #.587 (triplets)

Do not customise the HLT, as it already makes full use of GPU reconstruction when the "gpu" modifier is enabled.
Add a short description before each workflow.

PR validation:

All new or updated GPU workflows ran successfully:

Pixel-only

$ runTheMatrix.py -w gpu -j 4 -t 4 -l 11634.501,11634.502,11634.503,11634.504,11634.505,11634.506,11634.507,11634.508
11634.501_TTbar_14TeV+2021_Patatrack_PixelOnlyCPU+TTbar_14TeV_TuneCP5_GenSim+Digi+RecoNano+HARVESTNano Step0-PASSED Step1-PASSED Step2-PASSED Step3-PASSED  - time date Thu Mar 31 09:38:32 2022-date Thu Mar 31 09:35:53 2022; exit: 0 0 0 0
11634.502_TTbar_14TeV+2021_Patatrack_PixelOnlyGPU+TTbar_14TeV_TuneCP5_GenSim+Digi+RecoNano+HARVESTNano Step0-PASSED Step1-PASSED Step2-PASSED Step3-PASSED  - time date Thu Mar 31 09:38:34 2022-date Thu Mar 31 09:35:53 2022; exit: 0 0 0 0
11634.503_TTbar_14TeV+2021_Patatrack_PixelOnlyGPU_Validation+TTbar_14TeV_TuneCP5_GenSim+Digi+RecoNano+HARVESTNano Step0-PASSED Step1-PASSED Step2-PASSED Step3-PASSED  - time date Thu Mar 31 09:38:34 2022-date Thu Mar 31 09:35:54 2022; exit: 0 0 0 0
11634.504_TTbar_14TeV+2021_Patatrack_PixelOnlyGPU_Profiling+TTbar_14TeV_TuneCP5_GenSim+Digi+RecoNano Step0-PASSED Step1-PASSED Step2-PASSED  - time date Thu Mar 31 09:38:08 2022-date Thu Mar 31 09:35:54 2022; exit: 0 0 0
11634.505_TTbar_14TeV+2021_Patatrack_PixelOnlyTripletsCPU+TTbar_14TeV_TuneCP5_GenSim+Digi+RecoNano+HARVESTNano Step0-PASSED Step1-PASSED Step2-PASSED Step3-PASSED  - time date Thu Mar 31 09:40:50 2022-date Thu Mar 31 09:38:08 2022; exit: 0 0 0 0
11634.506_TTbar_14TeV+2021_Patatrack_PixelOnlyTripletsGPU+TTbar_14TeV_TuneCP5_GenSim+Digi+RecoNano+HARVESTNano Step0-PASSED Step1-PASSED Step2-PASSED Step3-PASSED  - time date Thu Mar 31 09:41:11 2022-date Thu Mar 31 09:38:32 2022; exit: 0 0 0 0
11634.507_TTbar_14TeV+2021_Patatrack_PixelOnlyTripletsGPU_Validation+TTbar_14TeV_TuneCP5_GenSim+Digi+RecoNano+HARVESTNano Step0-PASSED Step1-PASSED Step2-PASSED Step3-PASSED  - time date Thu Mar 31 09:41:11 2022-date Thu Mar 31 09:38:34 2022; exit: 0 0 0 0
11634.508_TTbar_14TeV+2021_Patatrack_PixelOnlyTripletsGPU_Profiling+TTbar_14TeV_TuneCP5_GenSim+Digi+RecoNano Step0-PASSED Step1-PASSED Step2-PASSED  - time date Thu Mar 31 09:40:46 2022-date Thu Mar 31 09:38:34 2022; exit: 0 0 0
8 8 8 8 tests passed, 0 0 0 0 failed

ECAL-only

$ runTheMatrix.py -w gpu -j 4 -t 4 -l 11634.511,11634.512,11634.513,11634.514
11634.511_TTbar_14TeV+2021_Patatrack_ECALOnlyCPU+TTbar_14TeV_TuneCP5_GenSim+Digi+RecoNano+HARVESTNano Step0-PASSED Step1-PASSED Step2-PASSED Step3-PASSED  - time date Thu Mar 31 09:43:11 2022-date Thu Mar 31 09:40:46 2022; exit: 0 0 0 0
11634.512_TTbar_14TeV+2021_Patatrack_ECALOnlyGPU+TTbar_14TeV_TuneCP5_GenSim+Digi+RecoNano+HARVESTNano Step0-PASSED Step1-PASSED Step2-PASSED Step3-PASSED  - time date Thu Mar 31 09:43:20 2022-date Thu Mar 31 09:40:51 2022; exit: 0 0 0 0
11634.513_TTbar_14TeV+2021_Patatrack_ECALOnlyGPU_Validation+TTbar_14TeV_TuneCP5_GenSim+Digi+RecoNano+HARVESTNano Step0-PASSED Step1-PASSED Step2-PASSED Step3-PASSED  - time date Thu Mar 31 09:43:41 2022-date Thu Mar 31 09:41:12 2022; exit: 0 0 0 0
11634.514_TTbar_14TeV+2021_Patatrack_ECALOnlyGPU_Profiling+TTbar_14TeV_TuneCP5_GenSim+Digi+RecoNano Step0-PASSED Step1-PASSED Step2-PASSED  - time date Thu Mar 31 09:43:18 2022-date Thu Mar 31 09:41:13 2022; exit: 0 0 0
4 4 4 4 tests passed, 0 0 0 0 failed

HCAL-only

$ runTheMatrix.py -w gpu -j 4 -t 4 -l 11634.521,11634.522,11634.523,11634.524
11634.521_TTbar_14TeV+2021_Patatrack_HCALOnlyCPU+TTbar_14TeV_TuneCP5_GenSim+Digi+RecoNano+HARVESTNano Step0-PASSED Step1-PASSED Step2-PASSED Step3-PASSED  - time date Thu Mar 31 09:45:34 2022-date Thu Mar 31 09:43:11 2022; exit: 0 0 0 0
11634.522_TTbar_14TeV+2021_Patatrack_HCALOnlyGPU+TTbar_14TeV_TuneCP5_GenSim+Digi+RecoNano+HARVESTNano Step0-PASSED Step1-PASSED Step2-PASSED Step3-PASSED  - time date Thu Mar 31 09:45:45 2022-date Thu Mar 31 09:43:18 2022; exit: 0 0 0 0
11634.523_TTbar_14TeV+2021_Patatrack_HCALOnlyGPU_Validation+TTbar_14TeV_TuneCP5_GenSim+Digi+RecoNano+HARVESTNano Step0-PASSED Step1-PASSED Step2-PASSED Step3-PASSED  - time date Thu Mar 31 09:45:48 2022-date Thu Mar 31 09:43:21 2022; exit: 0 0 0 0
11634.524_TTbar_14TeV+2021_Patatrack_HCALOnlyGPU_Profiling+TTbar_14TeV_TuneCP5_GenSim+Digi+RecoNano Step0-PASSED Step1-PASSED Step2-PASSED  - time date Thu Mar 31 09:45:44 2022-date Thu Mar 31 09:43:42 2022; exit: 0 0 0
4 4 4 4 tests passed, 0 0 0 0 failed

All GPU sequences

$ runTheMatrix.py -w gpu -j 4 -t 4 -l 11634.581,11634.582,11634.583,11634.585,11634.586,11634.587
11634.581_TTbar_14TeV+2021_Patatrack_AllCPU+TTbar_14TeV_TuneCP5_GenSim+Digi+RecoNano+HARVESTNano Step0-PASSED Step1-PASSED Step2-PASSED Step3-PASSED  - time date Thu Mar 31 10:30:52 2022-date Thu Mar 31 10:28:11 2022; exit: 0 0 0 0
11634.582_TTbar_14TeV+2021_Patatrack_AllGPU+TTbar_14TeV_TuneCP5_GenSim+Digi+RecoNano+HARVESTNano Step0-PASSED Step1-PASSED Step2-PASSED Step3-PASSED  - time date Thu Mar 31 10:30:52 2022-date Thu Mar 31 10:28:12 2022; exit: 0 0 0 0
11634.583_TTbar_14TeV+2021_Patatrack_AllGPU_Validation+TTbar_14TeV_TuneCP5_GenSim+Digi+RecoNano+HARVESTNano Step0-PASSED Step1-PASSED Step2-PASSED Step3-PASSED  - time date Thu Mar 31 10:30:54 2022-date Thu Mar 31 10:28:12 2022; exit: 0 0 0 0
11634.585_TTbar_14TeV+2021_Patatrack_AllTripletsCPU+TTbar_14TeV_TuneCP5_GenSim+Digi+RecoNano+HARVESTNano Step0-PASSED Step1-PASSED Step2-PASSED Step3-PASSED  - time date Thu Mar 31 10:30:52 2022-date Thu Mar 31 10:28:13 2022; exit: 0 0 0 0
11634.586_TTbar_14TeV+2021_Patatrack_AllTripletsGPU+TTbar_14TeV_TuneCP5_GenSim+Digi+RecoNano+HARVESTNano Step0-PASSED Step1-PASSED Step2-PASSED Step3-PASSED  - time date Thu Mar 31 10:33:26 2022-date Thu Mar 31 10:30:53 2022; exit: 0 0 0 0
11634.587_TTbar_14TeV+2021_Patatrack_AllTripletsGPU_Validation+TTbar_14TeV_TuneCP5_GenSim+Digi+RecoNano+HARVESTNano Step0-PASSED Step1-PASSED Step2-PASSED Step3-PASSED  - time date Thu Mar 31 10:33:26 2022-date Thu Mar 31 10:30:53 2022; exit: 0 0 0 0
6 6 6 6 tests passed, 0 0 0 0 failed

Full offline reconstruction with all GPU sequences

$ runTheMatrix.py -w gpu -j 4 -t 4 -l 11634.591,11634.592,11634.593,11634.595,11634.596,11634.597
11634.591_TTbar_14TeV+2021_Patatrack_FullRecoCPU+TTbar_14TeV_TuneCP5_GenSim+Digi+RecoNano+HARVESTNano Step0-PASSED Step1-PASSED Step2-PASSED Step3-PASSED  - time date Thu Mar 31 09:53:14 2022-date Thu Mar 31 09:48:31 2022; exit: 0 0 0 0
11634.592_TTbar_14TeV+2021_Patatrack_FullRecoGPU+TTbar_14TeV_TuneCP5_GenSim+Digi+RecoNano+HARVESTNano Step0-PASSED Step1-PASSED Step2-PASSED Step3-PASSED  - time date Thu Mar 31 09:53:13 2022-date Thu Mar 31 09:48:32 2022; exit: 0 0 0 0
11634.593_TTbar_14TeV+2021_Patatrack_FullRecoGPU_Validation+TTbar_14TeV_TuneCP5_GenSim+Digi+RecoNano+HARVESTNano Step0-PASSED Step1-PASSED Step2-PASSED Step3-PASSED  - time date Thu Mar 31 09:55:43 2022-date Thu Mar 31 09:51:49 2022; exit: 0 0 0 0
11634.595_TTbar_14TeV+2021_Patatrack_FullRecoTripletsCPU+TTbar_14TeV_TuneCP5_GenSim+Digi+RecoNano+HARVESTNano Step0-PASSED Step1-PASSED Step2-PASSED Step3-PASSED  - time date Thu Mar 31 09:55:42 2022-date Thu Mar 31 09:51:49 2022; exit: 0 0 0 0
11634.596_TTbar_14TeV+2021_Patatrack_FullRecoTripletsGPU+TTbar_14TeV_TuneCP5_GenSim+Digi+RecoNano+HARVESTNano Step0-PASSED Step1-PASSED Step2-PASSED Step3-PASSED  - time date Thu Mar 31 09:57:05 2022-date Thu Mar 31 09:53:13 2022; exit: 0 0 0 0
11634.597_TTbar_14TeV+2021_Patatrack_FullRecoTripletsGPU_Validation+TTbar_14TeV_TuneCP5_GenSim+Digi+RecoNano+HARVESTNano Step0-PASSED Step1-PASSED Step2-PASSED Step3-PASSED  - time date Thu Mar 31 09:57:05 2022-date Thu Mar 31 09:53:14 2022; exit: 0 0 0 0
6 6 6 6 tests passed, 0 0 0 0 failed

fwyzard · 2022-03-30T12:42:34Z

enable gpu

fwyzard · 2022-03-30T12:42:39Z

please test

cmsbuild · 2022-03-30T12:45:45Z

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-37411/29084

This PR adds an extra 24KB to repository
There are other open Pull requests which might conflict with changes you have proposed:
- File Configuration/PyReleaseValidation/python/upgradeWorkflowComponents.py modified in PR(s): DeepSC algorithm for ECAL SuperClusters #37115, Dynamic Reduction Network for photon energy regression in miniAOD using the SonicTriton service #37134, Add HLT75e33 step to Phase-2 workflows #37324, Add run3 tracking low pu era #33532, Run-3 FastSim modifier and workflows in runTheMatrix #37347

cmsbuild · 2022-03-30T12:46:09Z

A new Pull Request was created by @fwyzard (Andrea Bocci) for master.

It involves the following packages:

Configuration/PyReleaseValidation (pdmv, upgrade)

@jordan-martins, @bbilin, @wajidalikhan, @AdrianoDee, @srimanob, @kskovpen can you please review it and eventually sign? Thanks.
@makortel, @kpedro88, @Martin-Grunewald, @missirol, @fabiocos, @slomeo this is something you requested to watch as well.
@perrotta, @dpiparo, @qliphy you are the release manager for this.

cms-bot commands are listed here

fwyzard · 2022-03-30T16:00:23Z

please wait before merging this PR, I will push some more developments

cmsbuild · 2022-03-30T16:26:45Z

+1

Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-0acc53/23527/summary.html
COMMIT: 2ea647d
CMSSW: CMSSW_12_4_X_2022-03-30-1100/slc7_amd64_gcc10
Additional Tests: GPU
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmssw/37411/23527/install.sh to create a dev area with all the needed externals and cmssw changes.

GPU Comparison Summary

Summary:

No significant changes to the logs found
Reco comparison results: 4 differences found in the comparisons
DQMHistoTests: Total files compared: 4
DQMHistoTests: Total histograms compared: 19874
DQMHistoTests: Total failures: 1036
DQMHistoTests: Total nulls: 0
DQMHistoTests: Total successes: 18838
DQMHistoTests: Total skipped: 0
DQMHistoTests: Total Missing objects: 0
DQMHistoSizes: Histogram memory added: 0.0 KiB( 3 files compared)
Checked 12 log files, 9 edm output root files, 4 DQM output files
TriggerResults: no differences found

Comparison Summary

Summary:

No significant changes to the logs found
Reco comparison results: 4 differences found in the comparisons
DQMHistoTests: Total files compared: 48
DQMHistoTests: Total histograms compared: 3585896
DQMHistoTests: Total failures: 8
DQMHistoTests: Total nulls: 0
DQMHistoTests: Total successes: 3585866
DQMHistoTests: Total skipped: 22
DQMHistoTests: Total Missing objects: 0
DQMHistoSizes: Histogram memory added: 0.0 KiB( 47 files compared)
Checked 200 log files, 45 edm output root files, 48 DQM output files
TriggerResults: no differences found

fwyzard · 2022-03-31T07:36:12Z

please test

cmsbuild · 2022-03-31T07:38:25Z

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-37411/29105

This PR adds an extra 24KB to repository
There are other open Pull requests which might conflict with changes you have proposed:
- File Configuration/PyReleaseValidation/python/upgradeWorkflowComponents.py modified in PR(s): DeepSC algorithm for ECAL SuperClusters #37115, Dynamic Reduction Network for photon energy regression in miniAOD using the SonicTriton service #37134, Add HLT75e33 step to Phase-2 workflows #37324, Add run3 tracking low pu era #33532, Run-3 FastSim modifier and workflows in runTheMatrix #37347

cmsbuild · 2022-03-31T08:32:07Z

Pull request #37411 was updated. @jordan-martins, @bbilin, @wajidalikhan, @cmsbuild, @AdrianoDee, @srimanob, @kskovpen can you please check and sign again.

fwyzard · 2022-03-31T08:32:26Z

please test

fwyzard · 2022-03-31T08:47:06Z

test parameters:

workflows_gpu = 11634.587
enable_tests = gpu

fwyzard · 2022-03-31T09:48:21Z

@smuzaffar , after this PR is merged, we could replace the GPU tests (11634.506, 11634.512, 11634.522) with just 11634.587

smuzaffar · 2022-03-31T09:53:04Z

please test
there was bug in bot which is fixed now, so let restart the tests

cmsbuild · 2022-03-31T13:31:34Z

+1

Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-0acc53/23562/summary.html
COMMIT: f1df4f8
CMSSW: CMSSW_12_4_X_2022-03-30-2300/slc7_amd64_gcc10
Additional Tests: GPU
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmssw/37411/23562/install.sh to create a dev area with all the needed externals and cmssw changes.

GPU Comparison Summary

@slava77 comparisons for the following workflows were not done due to missing matrix map:

/data/cmsbld/jenkins/workspace/compare-root-files-short-matrix/data/PR-0acc53/11634.587_TTbar_14TeV+2021_Patatrack_AllTripletsGPU_Validation+TTbar_14TeV_TuneCP5_GenSim+Digi+RecoNano+HARVESTNano

Summary:

No significant changes to the logs found
Reco comparison results: 24 differences found in the comparisons
DQMHistoTests: Total files compared: 4
DQMHistoTests: Total histograms compared: 19874
DQMHistoTests: Total failures: 2246
DQMHistoTests: Total nulls: 0
DQMHistoTests: Total successes: 17628
DQMHistoTests: Total skipped: 0
DQMHistoTests: Total Missing objects: 0
DQMHistoSizes: Histogram memory added: 0.0 KiB( 3 files compared)
Checked 12 log files, 9 edm output root files, 4 DQM output files
TriggerResults: no differences found

Comparison Summary

Summary:

No significant changes to the logs found
Reco comparison results: 4 differences found in the comparisons
DQMHistoTests: Total files compared: 48
DQMHistoTests: Total histograms compared: 3591311
DQMHistoTests: Total failures: 8
DQMHistoTests: Total nulls: 0
DQMHistoTests: Total successes: 3591281
DQMHistoTests: Total skipped: 22
DQMHistoTests: Total Missing objects: 0
DQMHistoSizes: Histogram memory added: 0.0 KiB( 47 files compared)
Checked 200 log files, 45 edm output root files, 48 DQM output files
TriggerResults: no differences found

srimanob · 2022-04-03T01:55:37Z

+Upgrade

This PR updates GPU workflows.

fwyzard · 2022-04-04T19:13:21Z

@cms-sw/pdmv-l2, could you check this PR and let me know if you have any comments ?

kskovpen · 2022-04-04T19:14:51Z

+pdmv

cmsbuild · 2022-04-04T19:15:11Z

This pull request is fully signed and it will be integrated in one of the next master IBs (tests are also fine). This pull request will now be reviewed by the release team before it's merged. @perrotta, @dpiparo, @qliphy (and backports should be raised in the release meeting by the corresponding L2)

fwyzard · 2022-04-05T06:58:11Z

urgent

the backport should be in 12.3.0

perrotta · 2022-04-05T07:15:54Z

Configuration/PyReleaseValidation/python/relval_gpu.py

+           10824.506, 10824.507, 10824.508,
+           10824.512, 10824.513, 10824.514,
+           10824.522, 10824.523, 10824.524,
+           10824.582, 10824.583, # 10824.524,


Out of curiosity: 10824.524 and 10824.528 here (and the same below at Ls 55-56) are just placeholders, isn't it?
To have the release numbers sequential in the tabs here, they should be 10824.584 and 10824.588 instead.
Note: I am NOT asking to modify anything here, just trying to understand the logic.

you are right, the placeholder comments have the wrong numbers :-/

perrotta · 2022-04-05T07:42:01Z

+1

cmsbuild added this to the CMSSW_12_4_X milestone Mar 30, 2022

cmsbuild added code-checks-pending orp-pending pdmv-pending pending-signatures tests-pending upgrade-pending labels Mar 30, 2022

fwyzard force-pushed the add_Pixel_HCAL_validation_workflows branch from 2675a26 to 2ea647d Compare March 30, 2022 12:40

cmsbuild added tests-started and removed tests-pending labels Mar 30, 2022

cmsbuild added code-checks-approved and removed code-checks-pending labels Mar 30, 2022

fwyzard mentioned this pull request Mar 30, 2022

Update all GPU workflows [12.3.x] #37413

Merged

cmsbuild added tests-approved and removed tests-started labels Mar 30, 2022

fwyzard force-pushed the add_Pixel_HCAL_validation_workflows branch from 2ea647d to 0ab5855 Compare March 31, 2022 07:31

cmsbuild added code-checks-pending tests-pending and removed tests-approved code-checks-approved labels Mar 31, 2022

cmsbuild added tests-started and removed tests-pending labels Mar 31, 2022

fwyzard changed the title ~~Add Pixel-only and HCAL-only validation workflows~~ Update all GPU workflows Mar 31, 2022

cmsbuild added tests-approved and removed tests-started labels Mar 31, 2022

cmsbuild added upgrade-approved and removed upgrade-pending labels Apr 3, 2022

cmsbuild mentioned this pull request Apr 4, 2022

Dynamic Reduction Network for photon energy regression in miniAOD using the SonicTriton service #37134

Merged

cmsbuild added fully-signed pdmv-approved and removed pending-signatures pdmv-pending labels Apr 4, 2022

cmsbuild added the urgent label Apr 5, 2022

perrotta reviewed Apr 5, 2022

View reviewed changes

cmsbuild added orp-approved and removed orp-pending labels Apr 5, 2022

cmsbuild merged commit 70954a6 into cms-sw:master Apr 5, 2022

fwyzard deleted the add_Pixel_HCAL_validation_workflows branch July 31, 2022 13:43

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Update all GPU workflows #37411

Update all GPU workflows #37411

fwyzard commented Mar 30, 2022 •

edited

fwyzard commented Mar 30, 2022

fwyzard commented Mar 30, 2022

cmsbuild commented Mar 30, 2022

cmsbuild commented Mar 30, 2022

fwyzard commented Mar 30, 2022

cmsbuild commented Mar 30, 2022

fwyzard commented Mar 31, 2022

cmsbuild commented Mar 31, 2022

cmsbuild commented Mar 31, 2022

fwyzard commented Mar 31, 2022

fwyzard commented Mar 31, 2022

fwyzard commented Mar 31, 2022

smuzaffar commented Mar 31, 2022

cmsbuild commented Mar 31, 2022

srimanob commented Apr 3, 2022

fwyzard commented Apr 4, 2022

kskovpen commented Apr 4, 2022

cmsbuild commented Apr 4, 2022

fwyzard commented Apr 5, 2022

perrotta Apr 5, 2022

fwyzard Apr 5, 2022

perrotta commented Apr 5, 2022

Update all GPU workflows #37411

Update all GPU workflows #37411

Conversation

fwyzard commented Mar 30, 2022 • edited

PR description:

PR validation:

Pixel-only

ECAL-only

HCAL-only

All GPU sequences

Full offline reconstruction with all GPU sequences

fwyzard commented Mar 30, 2022

fwyzard commented Mar 30, 2022

cmsbuild commented Mar 30, 2022

cmsbuild commented Mar 30, 2022

fwyzard commented Mar 30, 2022

cmsbuild commented Mar 30, 2022

GPU Comparison Summary

Comparison Summary

fwyzard commented Mar 31, 2022

cmsbuild commented Mar 31, 2022

cmsbuild commented Mar 31, 2022

fwyzard commented Mar 31, 2022

fwyzard commented Mar 31, 2022

fwyzard commented Mar 31, 2022

smuzaffar commented Mar 31, 2022

cmsbuild commented Mar 31, 2022

GPU Comparison Summary

Comparison Summary

srimanob commented Apr 3, 2022

fwyzard commented Apr 4, 2022

kskovpen commented Apr 4, 2022

cmsbuild commented Apr 4, 2022

fwyzard commented Apr 5, 2022

perrotta Apr 5, 2022

Choose a reason for hiding this comment

fwyzard Apr 5, 2022

Choose a reason for hiding this comment

perrotta commented Apr 5, 2022

fwyzard commented Mar 30, 2022 •

edited