Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Additions for the GEM SliceTest #16900

Closed
wants to merge 1,000 commits into from
Closed

Conversation

calabria
Copy link
Contributor

@calabria calabria commented Dec 7, 2016

This PR introduces the needed changes to have a 2017 scenario with the GEM chambers foreseen for the next year slice test. We define a specific scenario, Extended2017Muon, where the simulation/reconstruction stops at local reco. We would like to have this in 900_pre2, because it is enough for the moment to be able to validate the new scenario with the relVal production foreseen for that pre-release, even though we don't enter the default 2017 scenario.

@jshlee @pietverwilligen

schermata 2016-12-06 alle 18 55 42

@cmsbuild
Copy link
Contributor

cmsbuild commented Dec 7, 2016

A new Pull Request was created by @calabria (Cesare) for CMSSW_9_0_X.

It involves the following packages:

Configuration/Eras
Configuration/Geometry
Configuration/PyReleaseValidation
Configuration/StandardSequences
Geometry/CMSCommonData
Geometry/GEMGeometryBuilder
IOMC/RandomEngine
L1Trigger/CSCTriggerPrimitives
RecoLocalMuon/Configuration
SimGeneral/MixingModule
SimGeneral/TrackingAnalysis
SimMuon/Configuration
Validation/Configuration
Validation/MuonGEMDigis
Validation/MuonGEMHits

@smuzaffar, @civanch, @Dr15Jones, @dmitrijus, @cvuosalo, @ianna, @mdhildreth, @fabozzi, @cmsbuild, @rekovic, @srimanob, @franzoni, @slava77, @vanbesien, @hengne, @mulhearn, @davidlange6 can you please review it and eventually sign? Thanks.
@ghellwig, @Martin-Grunewald, @abbiendi, @kreczko, @battibass, @makortel, @felicepantaleo, @wmtan, @GiacomoSguazzoni, @rovere, @VinInn, @valuev, @bellan, @HuguesBrun, @wddgit, @jhgoh, @calderona, @ptcox, @trocino, @dgulhan this is something you requested to watch as well.
@slava77, @smuzaffar you are the release manager for this.

cms-bot commands are listed here #13028

from Configuration.Eras.Modifier_run2_HCAL_2017_cff import run2_HCAL_2017
from Configuration.Eras.Modifier_run2_GEMSliceTest_cff import run2_GEMSliceTest

Run2_2017Muon = cms.ModifierChain(run2_2017_core, trackingPhase1, run2_GEMSliceTest)
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

You could save some characters with

Run2_2017Muon = cms.ModifierChain(Run2_2017, run2_GEMSliceTest)

and be safe in case we change the default tracking era from trackingPhase1 to something else (ok, we won't).

@@ -20,6 +20,7 @@ def __init__(self):
'Run2_2016_trackingLowPU',
'Run2_2016_pA',
'Run2_2017',
'Run2_2017Muon',
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I believe you should add run2_GEMSliceTest to internalUseMods below (but I can't place this comment there).

@slava77
Copy link
Contributor

slava77 commented Dec 7, 2016

@cmsbuild please test

@cmsbuild
Copy link
Contributor

cmsbuild commented Dec 7, 2016

The tests are being triggered in jenkins.
https://cmssdt.cern.ch/jenkins/job/ib-any-integration/16846/console Started: 2016/12/07 21:49

@cmsbuild
Copy link
Contributor

cmsbuild commented Dec 7, 2016

@cmsbuild
Copy link
Contributor

cmsbuild commented Dec 7, 2016

Comparison job queued.

from Configuration.Eras.Era_Run2_2017_cff import Run2_2017
from Configuration.Eras.Modifier_run2_GEMSliceTest_cff import run2_GEMSliceTest

Run2_2017Muon = cms.ModifierChain(Run2_2017, run2_GEMSliceTest)
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Why not just call this uniformly Run2_2017GEM and the internal scenario run2_GEM?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

for me it makes no difference, I had to give a name and I did it :D if you think it is worth to change I will

@cmsbuild
Copy link
Contributor

cmsbuild commented Dec 8, 2016

Comparison is ready
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-16900/16846/summary.html

The workflows 1003.0, 1001.0, 1000.0, 140.53, 136.731, 4.22 have different files in step1_dasquery.log than the ones found in the baseline. You may want to check and retrigger the tests if necessary. You can check it in the "files" directory in the results of the comparisons

@ianna
Copy link
Contributor

ianna commented Dec 8, 2016

+1

@cmsbuild
Copy link
Contributor

cmsbuild commented Feb 8, 2017

Pull request #16900 was updated. @ghellwig, @cvuosalo, @arunhep, @cerminar, @monttj, @cmsbuild, @rekovic, @franzoni, @slava77, @ggovi, @mmusich, @mulhearn, @davidlange6 can you please check and sign again.

@ianna
Copy link
Contributor

ianna commented Feb 8, 2017

please test

@cmsbuild
Copy link
Contributor

cmsbuild commented Feb 8, 2017

The tests are being triggered in jenkins.
https://cmssdt.cern.ch/jenkins/job/ib-any-integration/17702/console Started: 2017/02/08 19:28

@cmsbuild
Copy link
Contributor

cmsbuild commented Feb 8, 2017

-1

Tested at: 50527a4

The following merge commits were also included on top of IB + this PR after doing git cms-merge-topic:
1b80350
You can see more details here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-16900/17702/git-log-recent-commits
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-16900/17702/git-merge-result

You can see the results of the tests here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-16900/17702/summary.html

I found follow errors while testing this PR

Failed tests: Build

  • Build:

I found an error when building:

gmake[1]: Target 'PostBuild' not remade because of errors.
gmake[1]: Leaving directory '/build/cmsbuild/jenkins-workarea/workspace/ib-any-integration/CMSSW_9_0_X_2017-02-08-1100'
config/SCRAM/GMake/Makefile.rules:2017: recipe for target 'src' failed
gmake: *** [src] Error 2
gmake: Target 'all' not remade because of errors.
gmake: *** [There are compilation/build errors. Please see the detail log above.] Error 2


The following merge commits were also included on top of IB + this PR after doing git cms-merge-topic:
1b80350
You can see more details here:
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-16900/17702/git-log-recent-commits
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-16900/17702/git-merge-result

@cmsbuild
Copy link
Contributor

cmsbuild commented Feb 8, 2017

Comparison not run due to Build errors (RelVals and Igprof tests were also skipped)

@calabria
Copy link
Contributor Author

calabria commented Feb 8, 2017

no please wait, I have not been able to solve the problems with git.

@slava77
Copy link
Contributor

slava77 commented Feb 10, 2017

@calabria
maybe if you are stuck with git it's easier just to start with a new branch and commits
(and then either open a new PR or push --force into this PR topic branch to overwrite)

@slava77
Copy link
Contributor

slava77 commented Feb 13, 2017

the error in the last build was

  File "src/SimMuon/Configuration/python/SimMuon_cff.py", line 45
    from from Configuration.Eras.Modifier_run2_GEM_2017_cff import run2_GEM_2017
            ^
SyntaxError: invalid syntax

seems like something easy to fix

@calabria
Copy link
Contributor Author

@slava77 thanks. yes I noticed it and fixed it... But I am preparing a new branch, I don't think I can continue with this one... Unfortunately the validation packages are now crashing for some reason and I am trying to understand why...

@franzoni
Copy link

hello @calabria
I gather this instance of this PR is no longer relevant
might you want to close ?

@calabria calabria closed this Feb 20, 2017
@slava77
Copy link
Contributor

slava77 commented Feb 22, 2017

@calabria
Should we still expect a PR with GEM slice test?

If I understand correctly, current default 2017 SIM has the slice test chambers
@ianna please confirm

If that's the case, addition of GEM local reco should be possible in 91X.

@calabria
Copy link
Contributor Author

Hi @slava77 yes sure, but unfortunately we have another issue to solve: we are having problems with the GEMGeometry taken from the Database, when asking the regions of the Geometry we get a crash. Maybe the geometry constructed from the database is not as complete as the geometry we can take from DDD. We realized the part where chambers, rings, stations and regions are created is missing in the geometryFromCondDB. We have to work on an increased description of the CondDB geometry first. We already contacted @ianna to get some help on how to proceed because it is not perfectly clear: we need to know how we can test, if we need to update the payload...

@ianna
Copy link
Contributor

ianna commented Feb 22, 2017

@slava77 - yes, GEM slice test chambers are in 2017 SIM

@calabria - how can I reproduce the crash? Thanks

@calabria
Copy link
Contributor Author

calabria commented Feb 23, 2017

@ianna the problem shows up in the validation, if I run the simulation up to the reconstruction stepeverything "seems" to work fine. So in order to reproduce the crash it is enough if you run the reco step + validation, so if you run 10411 you should see the problem. But you need the modifications of this PR, but I don't think you can merge use this branch. I have a clean one: calabria:New2017Muon6

@ianna
Copy link
Contributor

ianna commented Feb 24, 2017

@calabria - thanks, I can reproduce the crash:

#5  0x00007f3051ab317a in GEMBaseValidation::initGeometry(edm::EventSetup const&) () from /build/yana/GEM/CMSSW_9_0_X_2017-02-22-2300/lib/slc6_amd64_gcc530/libValidationMuonGEMHits.so
#6  0x00007f3051aac43a in GEMHitsValidation::bookHistograms(DQMStore::IBooker&, edm::Run const&, edm::EventSetup const&) () from /build/yana/GEM/CMSSW_9_0_X_2017-02-22-2300/lib/slc6_amd64_gcc530/libValidationMuonGEMHits.so
#7  0x00007f3095c0281a in DQMEDAnalyzer::beginRun(edm::Run const&, edm::EventSetup const&) () from /cvmfs/cms-ib.cern.ch/nweek-02460/slc6_amd64_gcc530/cms/cmssw/CMSSW_9_0_X_2017-02-22-1100/lib/slc6_amd64_gcc530/libDQMServicesCore.so

The vector of GEMRegions is empty, so the code accessing its constituents is not safe.

GEM geometry builder from DB constructs only Eta partitions (80 of them in this particular case): http://cmslxr.fnal.gov/source/Geometry/GEMGeometryBuilder/src/GEMGeometryBuilderFromCondDB.cc#0033

Usually, RECO geometry contains only sensitive volumes, however, if GEM reco geometry needs to provide more (regions, superChambers and chambers) GEMGeometryBuilderFromCondDB is the place to add these.

Please, let me know if you need my help in implementing the code.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet