Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Phase2-gex27 First step to use dd4hep for a phase2 scenario #31902

Merged
merged 1 commit into from Oct 25, 2020

Conversation

bsunanda
Copy link
Contributor

PR description:

First step to use dd4hep for a phase2 scenario

PR validation:

To be checked by debugging dd4hep interface

if this PR is a backport please specify the original PR and why you need to backport that PR:

Used for debugging materials file used for Phase2 scenarios

@cmsbuild
Copy link
Contributor

The code-checks are being triggered in jenkins.

@bsunanda
Copy link
Contributor Author

@ianna @cvuosalo @civanch using the dd4hep_ttbar_2026D49_Step1_cfg.py G4converter for material in dd4hep fails and this is to be looked into

@cmsbuild
Copy link
Contributor

+code-checks

Logs: https://cmssdt.cern.ch/SDT/code-checks/cms-sw-PR-31902/19319

  • This PR adds an extra 20KB to repository

@cmsbuild
Copy link
Contributor

A new Pull Request was created by @bsunanda (Sunanda Banerjee) for master.

It involves the following packages:

Configuration/Geometry
Geometry/MuonNumbering
SimG4Core/Configuration

@civanch, @Dr15Jones, @makortel, @cvuosalo, @ianna, @mdhildreth, @cmsbuild, @kpedro88 can you please review it and eventually sign? Thanks.
@vargasa, @makortel, @rovere, @Martin-Grunewald, @ptcox, @fabiocos, @slomeo this is something you requested to watch as well.
@silviodonato, @dpiparo, @qliphy you are the release manager for this.

cms-bot commands are listed here

Comment on lines +6 to +21
# Ideal geometry, needed for simulation
DDDetectorESProducer = cms.ESSource("DDDetectorESProducer",
confGeomXMLFiles = cms.FileInPath('Geometry/CMSCommonData/data/dd4hep/cmsExtendedGeometry2026D49.xml'),
appendToDataLabel = cms.string('')
)

DDSpecParRegistryESProducer = cms.ESProducer("DDSpecParRegistryESProducer",
appendToDataLabel = cms.string('')
)

DDVectorRegistryESProducer = cms.ESProducer("DDVectorRegistryESProducer",
appendToDataLabel = cms.string(''))

DDCompactViewESProducer = cms.ESProducer("DDCompactViewESProducer",
appendToDataLabel = cms.string('')
)
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This seems to be the main difference vs. the DDD setup, replacing the line:

from Geometry.CMSCommonData.cmsExtendedGeometry2026D49XML_cfi import *

Should we standardize to put all of this in a corresponding file like Geometry.CMSCommonData.cmsExtendedGeometry2026D49XMLDD4hep_cfi?

It would be even better if there were some way to do this with Eras... then the same XML_cfi file could be used for both (with the DD4hep special workflow already defined in the upgrade matrix).

@ianna @makortel any thoughts?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think we should wait a while before things stabilizer. We are in the process of getting the Phase2 workflow to start working - it is not there yet. We are still struggling for the Run3 scenario.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It would be even better if there were some way to do this with Eras...

The way to customize the set of ESProducers with Modifiers is to put the ESProducers into a Task and customize the Task with the Modifier.

Admittedly that would imply a larger change in how geometry ESProducers are loaded in configurations (the geometry Task would have to be added to the Schedule/Path/EndPath via the usual means).

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I was looking at the possibility to have Phase2 test workflows, and geometry configurations automatically built bu the generator script, and I had a similar idea as @kpedro88 , at least for the 3 latest items in this comment it would make sense to have a single _cff fragment to include, as they are common everywhere.

@kpedro88
Copy link
Contributor

please test
(outcome of discussion in the Simulation meeting this morning: the temporary config files introduced in this PR will be used for now, while a more parsimonious approach will be considered and implemented in the future.)

@cmsbuild
Copy link
Contributor

cmsbuild commented Oct 23, 2020

The tests are being triggered in jenkins.

@cmsbuild
Copy link
Contributor

-1

Tested at: 85bdad7

CMSSW: CMSSW_11_2_X_2020-10-23-1100
SCRAM_ARCH: slc7_amd64_gcc820
You can see the results of the tests here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-0fa728/10261/summary.html

I found follow errors while testing this PR

Failed tests: UnitTests

  • Unit Tests:

I found errors in the following unit tests:

---> test test2021Geometry had ERRORS

@cmsbuild
Copy link
Contributor

Comparison job queued.

@cmsbuild
Copy link
Contributor

Comparison is ready
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-0fa728/10261/summary.html

Comparison Summary:

  • No significant changes to the logs found
  • Reco comparison results: 8 differences found in the comparisons
  • DQMHistoTests: Total files compared: 35
  • DQMHistoTests: Total histograms compared: 2544110
  • DQMHistoTests: Total failures: 13
  • DQMHistoTests: Total nulls: 0
  • DQMHistoTests: Total successes: 2544075
  • DQMHistoTests: Total skipped: 22
  • DQMHistoTests: Total Missing objects: 0
  • DQMHistoSizes: Histogram memory added: 0.0 KiB( 34 files compared)
  • Checked 149 log files, 22 edm output root files, 35 DQM output files

@bsunanda
Copy link
Contributor Author

@cmsbuild Please test

@cmsbuild
Copy link
Contributor

cmsbuild commented Oct 24, 2020

The tests are being triggered in jenkins.

@cmsbuild
Copy link
Contributor

+1
Tested at: 85bdad7
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-0fa728/10269/summary.html
CMSSW: CMSSW_11_2_X_2020-10-24-1100
SCRAM_ARCH: slc7_amd64_gcc820

@cmsbuild
Copy link
Contributor

Comparison job queued.

@cmsbuild
Copy link
Contributor

Comparison is ready
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-0fa728/10269/summary.html

Comparison Summary:

  • No significant changes to the logs found
  • Reco comparison results: 0 differences found in the comparisons
  • DQMHistoTests: Total files compared: 35
  • DQMHistoTests: Total histograms compared: 2544110
  • DQMHistoTests: Total failures: 1
  • DQMHistoTests: Total nulls: 0
  • DQMHistoTests: Total successes: 2544087
  • DQMHistoTests: Total skipped: 22
  • DQMHistoTests: Total Missing objects: 0
  • DQMHistoSizes: Histogram memory added: 0.0 KiB( 34 files compared)
  • Checked 149 log files, 22 edm output root files, 35 DQM output files

@bsunanda
Copy link
Contributor Author

@cvuosalo @civanch @kpedro88 Without this we cannot test Phase2 scenarios for dd4hep

@kpedro88
Copy link
Contributor

+upgrade

@civanch
Copy link
Contributor

civanch commented Oct 24, 2020

+1

@cmsbuild
Copy link
Contributor

This pull request is fully signed and it will be integrated in one of the next master IBs (tests are also fine). This pull request will now be reviewed by the release team before it's merged. @silviodonato, @dpiparo, @qliphy (and backports should be raised in the release meeting by the corresponding L2)

@qliphy
Copy link
Contributor

qliphy commented Oct 25, 2020

+1

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

7 participants