Test vecgeom 1.1.20 in master branch #7775

iarspider · 2022-04-11T07:28:40Z

iarspider · 2022-04-11T07:28:49Z

please test

cmsbuild · 2022-04-11T07:29:03Z

A new Pull Request was created by @iarspider for branch IB/CMSSW_12_4_X/master.

@smuzaffar, @aandvalenzuela, @iarspider can you please review it and eventually sign? Thanks.
@perrotta, @dpiparo, @qliphy you are the release manager for this.
cms-bot commands are listed here

cmsbuild · 2022-04-11T12:52:55Z

+1

Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-05e6e7/23811/summary.html
COMMIT: 10c5d92
CMSSW: CMSSW_12_4_X_2022-04-10-2300/slc7_amd64_gcc10
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmsdist/7775/23811/install.sh to create a dev area with all the needed externals and cmssw changes.

Comparison Summary

Summary:

No significant changes to the logs found
Reco comparison results: 39 differences found in the comparisons
DQMHistoTests: Total files compared: 48
DQMHistoTests: Total histograms compared: 3593039
DQMHistoTests: Total failures: 56
DQMHistoTests: Total nulls: 1
DQMHistoTests: Total successes: 3592960
DQMHistoTests: Total skipped: 22
DQMHistoTests: Total Missing objects: 0
DQMHistoSizes: Histogram memory added: 0.004 KiB( 47 files compared)
DQMHistoSizes: changed ( 312.0 ): 0.004 KiB MessageLogger/Warnings
Checked 200 log files, 45 edm output root files, 48 DQM output files
TriggerResults: no differences found

cmsbuild · 2022-04-11T13:06:32Z

Pull request #7775 was updated.

iarspider · 2022-04-11T13:06:57Z

please test

cmsbuild · 2022-04-11T19:20:52Z

-1

Failed Tests: UnitTests RelVals AddOn
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-05e6e7/23820/summary.html
COMMIT: b589eff
CMSSW: CMSSW_12_4_X_2022-04-11-1100/slc7_amd64_gcc10
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmsdist/7775/23820/install.sh to create a dev area with all the needed externals and cmssw changes.

The following merge commits were also included on top of IB + this PR after doing git cms-merge-topic:

@aandvalenzuela [Spack] Update py-packages to the latest version #7767

You can see more details here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-05e6e7/23820/git-recent-commits.json
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-05e6e7/23820/git-merge-result

Unit Tests

I found errors in the following unit tests:

---> test trackerMaterialAnalysisPlots had ERRORS

RelVals

9.09.0_Higgs200ChargedTaus+Higgs200ChargedTaus+DIGI+RECO+HARVEST/step1_Higgs200ChargedTaus+Higgs200ChargedTaus+DIGI+RECO+HARVEST.log
25.025.0_TTbar+TTbar+DIGI+RECOAlCaCalo+HARVEST+ALCATT/step1_TTbar+TTbar+DIGI+RECOAlCaCalo+HARVEST+ALCATT.log
1306.01306.0_SingleMuPt1_UP15+SingleMuPt1_UP15+DIGIUP15+RECOUP15+HARVESTUP15/step1_SingleMuPt1_UP15+SingleMuPt1_UP15+DIGIUP15+RECOUP15+HARVESTUP15.log

Expand to see more relval errors ...

AddOn Tests

hlt_mc_FakecmsDriver.py TTbar_8TeV_TuneCUETP8M1_cfi -s GEN,SIM,DIGI,L1,DIGI2RAW --mc --scenario=pp -n 10 --conditions auto:run1_mc_Fake --relval 9000,50 --datatier "GEN-SIM-RAW" --eventcontent RAWSIM --customise=HLTrigger/Configuration/CustomConfigs.L1T --fileout file:RelVal_Raw_Fake_MC.root : FAILED - time: date Mon Apr 11 20:47:15 2022-date Mon Apr 11 20:43:17 2022 s - exit: 35584
hlt_mc_Fake

----- Begin Fatal Exception 11-Apr-2022 20:46:31 CEST-----------------------
An exception of category 'FileOpenError' occurred while
   [0] Constructing the EventProcessor
   [1] Constructing input source of type PoolSource
   [2] Calling RootInputFileSequence::initTheFile()
   Additional Info:
      [a] Input file file:RelVal_Raw_Fake_MC.root could not be opened.
      [b] Fatal Root Error: @SUB=TStorageFactoryFile::ReadBuffer
read from Storage::xread returned 256. Asked to read n bytes: 300 from offset: 0 with file size: 256

----- End Fatal Exception -------------------------------------------------

hlt_mc_Fake

----- Begin Fatal Exception 11-Apr-2022 20:47:15 CEST-----------------------
An exception of category 'FileOpenError' occurred while
   [0] Constructing the EventProcessor
   [1] Constructing input source of type PoolSource
   [2] Calling RootInputFileSequence::initTheFile()
   Additional Info:
      [a] Input file file:RelVal_Raw_Fake_MC.root could not be opened.
      [b] Fatal Root Error: @SUB=TStorageFactoryFile::ReadBuffer
read from Storage::xread returned 256. Asked to read n bytes: 300 from offset: 0 with file size: 256

----- End Fatal Exception -------------------------------------------------

Expand to see more addon errors ...

civanch · 2022-04-12T18:01:41Z

@iarspider , @smuzaffar , test is rejected in the same way as in G4VECGEOM. There is a new PR #37542 , whihc may help.

iarspider · 2022-04-12T20:59:56Z

please test with cms-sw/cmssw#37542

smuzaffar · 2022-04-12T21:41:42Z

please test

cmsbuild · 2022-04-13T01:35:37Z

-1

Failed Tests: UnitTests RelVals AddOn
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-05e6e7/23855/summary.html
COMMIT: b589eff
CMSSW: CMSSW_12_4_X_2022-04-12-1100/slc7_amd64_gcc10
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week0/cms-sw/cmsdist/7775/23855/install.sh to create a dev area with all the needed externals and cmssw changes.

The following merge commits were also included on top of IB + this PR after doing git cms-merge-topic:

You can see more details here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-05e6e7/23855/git-recent-commits.json
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-05e6e7/23855/git-merge-result

Unit Tests

I found errors in the following unit tests:

---> test trackerMaterialAnalysisPlots had ERRORS
---> test testTauEmbeddingProducers had ERRORS

RelVals

9.09.0_Higgs200ChargedTaus+Higgs200ChargedTaus+DIGI+RECO+HARVEST/step1_Higgs200ChargedTaus+Higgs200ChargedTaus+DIGI+RECO+HARVEST.log
25.025.0_TTbar+TTbar+DIGI+RECOAlCaCalo+HARVEST+ALCATT/step1_TTbar+TTbar+DIGI+RECOAlCaCalo+HARVEST+ALCATT.log
1306.01306.0_SingleMuPt1_UP15+SingleMuPt1_UP15+DIGIUP15+RECOUP15+HARVESTUP15/step1_SingleMuPt1_UP15+SingleMuPt1_UP15+DIGIUP15+RECOUP15+HARVESTUP15.log

Expand to see more relval errors ...

AddOn Tests

hlt_mc_FakecmsDriver.py TTbar_8TeV_TuneCUETP8M1_cfi -s GEN,SIM,DIGI,L1,DIGI2RAW --mc --scenario=pp -n 10 --conditions auto:run1_mc_Fake --relval 9000,50 --datatier "GEN-SIM-RAW" --eventcontent RAWSIM --customise=HLTrigger/Configuration/CustomConfigs.L1T --fileout file:RelVal_Raw_Fake_MC.root : FAILED - time: date Wed Apr 13 00:54:26 2022-date Wed Apr 13 00:52:38 2022 s - exit: 35584
hlt_mc_Fake

----- Begin Fatal Exception 13-Apr-2022 00:54:01 UTC-----------------------
An exception of category 'FileOpenError' occurred while
   [0] Constructing the EventProcessor
   [1] Constructing input source of type PoolSource
   [2] Calling RootInputFileSequence::initTheFile()
   Additional Info:
      [a] Input file file:RelVal_Raw_Fake_MC.root could not be opened.
      [b] Fatal Root Error: @SUB=TStorageFactoryFile::ReadBuffer
read from Storage::xread returned 256. Asked to read n bytes: 300 from offset: 0 with file size: 256

----- End Fatal Exception -------------------------------------------------

hlt_mc_Fake

----- Begin Fatal Exception 13-Apr-2022 00:54:26 UTC-----------------------
An exception of category 'FileOpenError' occurred while
   [0] Constructing the EventProcessor
   [1] Constructing input source of type PoolSource
   [2] Calling RootInputFileSequence::initTheFile()
   Additional Info:
      [a] Input file file:RelVal_Raw_Fake_MC.root could not be opened.
      [b] Fatal Root Error: @SUB=TStorageFactoryFile::ReadBuffer
read from Storage::xread returned 256. Asked to read n bytes: 300 from offset: 0 with file size: 256

----- End Fatal Exception -------------------------------------------------

Expand to see more addon errors ...

cmsbuild · 2022-05-31T09:28:12Z

Pull request #7775 was updated.

cmsbuild · 2022-05-31T09:31:54Z

Pull request #7775 was updated.

cmsbuild · 2022-05-31T09:33:35Z

Pull request #7775 was updated.

smuzaffar · 2022-05-31T09:34:14Z

please test

cmsbuild · 2022-05-31T10:16:45Z

-1

Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-05e6e7/25098/summary.html
COMMIT: c48dabb
CMSSW: CMSSW_12_5_X_2022-05-30-2300/el8_amd64_gcc10
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmsdist/7775/25098/install.sh to create a dev area with all the needed externals and cmssw changes.

External Build

I found compilation error when building:

+ mkdir -p /data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/tmp/BUILDROOT/7cc450158ad0c0004681be826f28aef3/opt/cmssw/el8_amd64_gcc10/external/geant4/10.7.2-7cc450158ad0c0004681be826f28aef3/lib64/archive
+ cd /data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/tmp/BUILDROOT/7cc450158ad0c0004681be826f28aef3/opt/cmssw/el8_amd64_gcc10/external/geant4/10.7.2-7cc450158ad0c0004681be826f28aef3/lib64/archive
+ find /data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/tmp/BUILDROOT/7cc450158ad0c0004681be826f28aef3/opt/cmssw/el8_amd64_gcc10/external/geant4/10.7.2-7cc450158ad0c0004681be826f28aef3/lib64 -name '*.a' -exec gcc-ar x '{}' ';'
+ gcc-ar rcs libgeant4-static.a '*.o'
/data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/el8_amd64_gcc10/external/gcc/10.3.0-84898dea653199466402e67d73657f10/bin/../lib/gcc/x86_64-redhat-linux-gnu/10.3.0/../../../../x86_64-redhat-linux-gnu/bin/ar: *.o: No such file or directory
error: Bad exit status from /data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/tmp/rpm-tmp.aKSUju (%install)


RPM build errors:
line 37: It's not recommended to have unversioned Obsoletes: Obsoletes: external+geant4+10.7.2-7cc450158ad0c0004681be826f28aef3
Bad exit status from /data/cmsbld/jenkins/workspace/ib-run-pr-tests/testBuildDir/tmp/rpm-tmp.aKSUju (%install)

smuzaffar · 2022-05-31T12:22:36Z

please test

cmsbuild · 2022-05-31T12:22:40Z

Pull request #7775 was updated.

cmsbuild · 2022-05-31T16:59:23Z

-1

Failed Tests: UnitTests RelVals AddOn
Summary: https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-05e6e7/25105/summary.html
COMMIT: 26ae2d7
CMSSW: CMSSW_12_5_X_2022-05-31-1100/el8_amd64_gcc10
User test area: For local testing, you can use /cvmfs/cms-ci.cern.ch/week1/cms-sw/cmsdist/7775/25105/install.sh to create a dev area with all the needed externals and cmssw changes.

The following merge commits were also included on top of IB + this PR after doing git cms-merge-topic:

You can see more details here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-05e6e7/25105/git-recent-commits.json
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-05e6e7/25105/git-merge-result

Unit Tests

I found errors in the following unit tests:

---> test SiStripDAQ_O2O_test had ERRORS
---> test trackerMaterialAnalysisPlots had ERRORS
---> test testTauEmbeddingProducers had ERRORS

RelVals

25.025.0_TTbar+TTbar+DIGI+RECOAlCaCalo+HARVEST+ALCATT/step1_TTbar+TTbar+DIGI+RECOAlCaCalo+HARVEST+ALCATT.log
9.09.0_Higgs200ChargedTaus+Higgs200ChargedTaus+DIGI+RECO+HARVEST/step1_Higgs200ChargedTaus+Higgs200ChargedTaus+DIGI+RECO+HARVEST.log
1306.01306.0_SingleMuPt1_UP15+SingleMuPt1_UP15+DIGIUP15+RECOUP15+HARVESTUP15/step1_SingleMuPt1_UP15+SingleMuPt1_UP15+DIGIUP15+RECOUP15+HARVESTUP15.log

Expand to see more relval errors ...

AddOn Tests

hlt_mc_FakecmsDriver.py TTbar_8TeV_TuneCUETP8M1_cfi -s GEN,SIM,DIGI,L1,DIGI2RAW --mc --scenario=pp -n 10 --conditions auto:run1_mc_Fake --relval 9000,50 --datatier "GEN-SIM-RAW" --eventcontent RAWSIM --customise=HLTrigger/Configuration/CustomConfigs.L1T --fileout file:RelVal_Raw_Fake_MC.root : FAILED - time: date Tue May 31 18:11:40 2022-date Tue May 31 18:08:18 2022 s - exit: 35584
hlt_mc_Fake

----- Begin Fatal Exception 31-May-2022 18:11:10 CEST-----------------------
An exception of category 'FileOpenError' occurred while
   [0] Constructing the EventProcessor
   [1] Constructing input source of type PoolSource
   [2] Calling RootInputFileSequence::initTheFile()
   Additional Info:
      [a] Input file file:RelVal_Raw_Fake_MC.root could not be opened.
      [b] Fatal Root Error: @SUB=TStorageFactoryFile::ReadBuffer
read from Storage::xread returned 256. Asked to read n bytes: 300 from offset: 0 with file size: 256

----- End Fatal Exception -------------------------------------------------

hlt_mc_Fake

----- Begin Fatal Exception 31-May-2022 18:11:39 CEST-----------------------
An exception of category 'FileOpenError' occurred while
   [0] Constructing the EventProcessor
   [1] Constructing input source of type PoolSource
   [2] Calling RootInputFileSequence::initTheFile()
   Additional Info:
      [a] Input file file:RelVal_Raw_Fake_MC.root could not be opened.
      [b] Fatal Root Error: @SUB=TStorageFactoryFile::ReadBuffer
read from Storage::xread returned 256. Asked to read n bytes: 300 from offset: 0 with file size: 256

----- End Fatal Exception -------------------------------------------------

Expand to see more addon errors ...

civanch · 2022-07-06T16:12:02Z

@iarspider , @smuzaffar , likely this PR may be closed.

Recent IBs GEANT4 and G4VECGEOM are working fine. There is only one problem: Geant4 and VecGeom are built in the debug mode. In the next IBs we would like to use optimal compile options in order to be able to check CPU performance.

smuzaffar · 2022-07-07T05:29:36Z

thanks @civanch , #7981 should build geant4 in Release mode for g4vecgeom IBs.

smuzaffar · 2022-07-08T09:10:10Z

@civanch , I think building vecgeom and geant4 in debug mode fixed the runtime issues we were seeing before. I see that G4 and G4+Vecgeom Ibs now again have same failure as we are not building g4 and vecgeom in debug mode.

civanch · 2022-07-08T10:19:13Z

@smuzaffar , yes, we realized this. Probably for summer it is better to return back debug mode for the G4VECGEOM branch. Is it possible simultaneously build the GEANT4 branch with optimal mode?

Test vecgeom 1.1.20 in master branch

10c5d92

Requested here: #7735 (comment)

cmsbuild added externals-pending orp-pending pending-signatures tests-started labels Apr 11, 2022

cmsbuild added tests-approved and removed tests-started labels Apr 11, 2022

Actually update vecgeom

b589eff

cmsbuild added tests-pending and removed tests-approved labels Apr 11, 2022

cmsbuild added tests-started and removed tests-pending labels Apr 11, 2022

cmsbuild added tests-rejected and removed tests-started labels Apr 11, 2022

iarspider mentioned this pull request Apr 12, 2022

Update vecgeom to 1.1.20 #7735

Merged

cmsbuild added requires-external tests-started and removed tests-rejected labels Apr 12, 2022

cmsbuild removed the requires-external label Apr 12, 2022

cmsbuild removed the tests-started label Apr 13, 2022

cmsbuild added the tests-rejected label Apr 14, 2022

smuzaffar changed the base branch from IB/CMSSW_12_4_X/master to IB/CMSSW_12_5_X/master May 16, 2022 08:28

Update vecgeom.spec

acd0fac

cmsbuild added tests-pending and removed tests-rejected labels May 31, 2022

Merge branch 'IB/CMSSW_12_5_X/master' into test-vecgeom_1.1.20-master

e4b82ae

Update vecgeom.spec

c48dabb

cmsbuild added tests-started and removed tests-pending labels May 31, 2022

cmsbuild added tests-rejected and removed tests-started labels May 31, 2022

fix geant4 lib dir

26ae2d7

cmsbuild added tests-started and removed tests-rejected labels May 31, 2022

cmsbuild added tests-rejected and removed tests-started labels May 31, 2022

iarspider closed this Jul 6, 2022

iarspider deleted the test-vecgeom_1.1.20-master branch July 6, 2022 16:16

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Test vecgeom 1.1.20 in master branch #7775

Test vecgeom 1.1.20 in master branch #7775

iarspider commented Apr 11, 2022

iarspider commented Apr 11, 2022

cmsbuild commented Apr 11, 2022

cmsbuild commented Apr 11, 2022

cmsbuild commented Apr 11, 2022

iarspider commented Apr 11, 2022

cmsbuild commented Apr 11, 2022

civanch commented Apr 12, 2022

iarspider commented Apr 12, 2022

smuzaffar commented Apr 12, 2022

cmsbuild commented Apr 13, 2022

cmsbuild commented May 31, 2022

cmsbuild commented May 31, 2022

cmsbuild commented May 31, 2022

smuzaffar commented May 31, 2022

cmsbuild commented May 31, 2022

smuzaffar commented May 31, 2022

cmsbuild commented May 31, 2022

cmsbuild commented May 31, 2022

civanch commented Jul 6, 2022

smuzaffar commented Jul 7, 2022

smuzaffar commented Jul 8, 2022

civanch commented Jul 8, 2022

Test vecgeom 1.1.20 in master branch #7775

Test vecgeom 1.1.20 in master branch #7775

Conversation

iarspider commented Apr 11, 2022

iarspider commented Apr 11, 2022

cmsbuild commented Apr 11, 2022

cmsbuild commented Apr 11, 2022

Comparison Summary

cmsbuild commented Apr 11, 2022

iarspider commented Apr 11, 2022

cmsbuild commented Apr 11, 2022

Unit Tests

RelVals

AddOn Tests

civanch commented Apr 12, 2022

iarspider commented Apr 12, 2022

smuzaffar commented Apr 12, 2022

cmsbuild commented Apr 13, 2022

Unit Tests

RelVals

AddOn Tests

cmsbuild commented May 31, 2022

cmsbuild commented May 31, 2022

cmsbuild commented May 31, 2022

smuzaffar commented May 31, 2022

cmsbuild commented May 31, 2022

External Build

smuzaffar commented May 31, 2022

cmsbuild commented May 31, 2022

cmsbuild commented May 31, 2022

Unit Tests

RelVals

AddOn Tests

civanch commented Jul 6, 2022

smuzaffar commented Jul 7, 2022

smuzaffar commented Jul 8, 2022

civanch commented Jul 8, 2022