Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

GED EGM RECO as default + customizeOldEGReco #1834

Merged
merged 12 commits into from Dec 20, 2013

Conversation

lgray
Copy link
Contributor

@lgray lgray commented Dec 16, 2013

This is built on top of CMSSW_7_0_X_2013-12-18-1400.

You will need to manually download the new MVA weight file, for the classifiers, in the following packages:
RecoParticleFlow/PFTracking
RecoEgamma/ElectronIdentification

with the usual cat download.url | xargs wget

For comparison purposes the default running mode of this PR should be a no-op to "GED mode" for #1801.
Likewise "OldEG" mode should be a no-op to the default running mode from before #1801, except for tracker-driven only GSF electrons where we cannot use the old soft-electron MVA or or converted brem finder. This leads to a slightly increased fake rate.

I've updated FastSim and Skims where necessary.

OldEG mode is activated by doing:
runTheMatrix.py -s --useInput all --command="--customise RecoEgamma/Configuration/customizeOldEGReco.customizeOldEGReco"

@slava77 The default mode only runs one version of the of conversion tracking. Please confirm timing improvements. The OldEG mode runs both sets of conversion tracking now.
@nancymarinelli In default mode, standard reco::Photons no longer have conversion information.
@franzoni All validation sequences (that I could find) have been updated to point at the new ged products. If there's anything deeper you need please let us know.

Matrix tests on my side:

  • default mode is fine
  • customizeOldEGReco works fine

@cmsbuild
Copy link
Contributor

A new Pull Request was created by @lgray (Lindsey Gray) for CMSSW_7_0_X.

GED EGM RECO as default + customizeOldEGReco

It involves the following packages:

Calibration/EcalAlCaRecoProducers
Configuration/Skimming
DPGAnalysis/Skims
DQMOffline/EGamma
DataFormats/EgammaCandidates
FastSimulation/Configuration
FastSimulation/ParticleFlow
HLTriggerOffline/Higgs
HLTriggerOffline/SUSYBSM
HLTriggerOffline/Top
RecoEcal/EgammaClusterProducers
RecoEgamma/Configuration
RecoEgamma/EgammaElectronAlgos
RecoEgamma/EgammaElectronProducers
RecoEgamma/EgammaIsolationAlgos
RecoEgamma/EgammaPhotonAlgos
RecoEgamma/EgammaPhotonProducers
RecoEgamma/EgammaTools
RecoEgamma/ElectronIdentification
RecoEgamma/PhotonIdentification
RecoJets/JetPlusTracks
RecoMET/METProducers
RecoParticleFlow/Configuration
RecoParticleFlow/PFClusterProducer
RecoParticleFlow/PFProducer
RecoParticleFlow/PFTracking
RecoTauTag/RecoTau
Validation/RecoEgamma
Validation/RecoTau

@thspeer, @giamman, @lveldere, @vlimant, @demattia, @danduggan, @franzoni, @rovere, @cmsbuild, @anton-a, @nclopezo, @rcastello, @deguio, @slava77, @eliasron, @fabiocos can you please review it and eventually sign? Thanks.
@ghellwig, @TaiSakuma this is something you requested to watch as well.
You can sign-off by replying to this message having '+1' in the first line of your reply.
You can reject by replying to this message having '-1' in the first line of your reply.
@ktf you are the release manager for this.

@cmsbuild
Copy link
Contributor

Pull request #1834 was updated. @thspeer, @giamman, @lveldere, @vlimant, @demattia, @danduggan, @franzoni, @rovere, @cmsbuild, @anton-a, @nclopezo, @rcastello, @deguio, @slava77, @eliasron, @fabiocos can you please check and sign again.

@lveldere
Copy link
Contributor

+1

@cmsbuild
Copy link
Contributor

This pull request is not mergeable. @lgray (Lindsey Gray) could you please rebase it?

Please have a look at:

http://cms-sw.github.io/cmssw/tutorial-forward-port.html

if you do not know how.

@cmsbuild
Copy link
Contributor

Pull request #1834 was updated. @thspeer, @giamman, @lveldere, @vlimant, @demattia, @danduggan, @franzoni, @rovere, @cmsbuild, @anton-a, @nclopezo, @rcastello, @deguio, @slava77, @eliasron, @fabiocos can you please check and sign again.

@lgray
Copy link
Contributor Author

lgray commented Dec 16, 2013

@nclopezo Can I get the logs for the merge failure to see what's going wrong? In principle this is exactly the same as #1801 and should be fine...

@ktf
Copy link
Contributor

ktf commented Dec 16, 2013

The conflict is the following:

diff --cc RecoMET/METProducers/python/TCMET_cfi.py
index a58e21f,ebb8b04..0000000
--- a/RecoMET/METProducers/python/TCMET_cfi.py
+++ b/RecoMET/METProducers/python/TCMET_cfi.py
@@@ -1,66 -1,76 +1,142 @@@
  import FWCore.ParameterSet.Config as cms

++<<<<<<< HEAD
 +##____________________________________________________________________________||
 +tcMet = cms.EDProducer(
 +    "TCMETProducer",
 +    alias = cms.string('TCMET'),
 +    electronVetoCone = cms.bool(True),
 +    electronInputTag  = cms.InputTag("gsfElectrons"),
 +    muonInputTag      = cms.InputTag("muons"),
 +    trackInputTag     = cms.InputTag("generalTracks"),
 +    metInputTag       = cms.InputTag("met"),
 +    beamSpotInputTag  = cms.InputTag("offlineBeamSpot"),
 +    vertexInputTag    = cms.InputTag("offlinePrimaryVertices"),
 +    muonDepValueMap   = cms.InputTag("muonMETValueMapProducer"  , "muCorrData"),
 +    tcmetDepValueMap  = cms.InputTag("muonTCMETValueMapProducer", "muCorrData"),
 +    pt_min  = cms.double(1.0),
 +    pt_max  = cms.double(100.),
 +    eta_max = cms.double(2.65),
 +    chi2_max = cms.double(5),
 +    nhits_min = cms.double(6),
 +    ptErr_max = cms.double(0.2),
 +    track_quality = cms.vint32(2),
 +    track_algos = cms.vint32(),
 +    isCosmics = cms.bool(False),
 +    rf_type = cms.int32(1),
 +    correctShowerTracks = cms.bool(False),
 +    usePvtxd0 = cms.bool(False),
 +    nMinOuterHits = cms.int32(2),
 +    usedeltaRRejection = cms.bool(False),
 +    deltaRShower = cms.double(0.01),
 +    checkTrackPropagation = cms.bool(False),
 +    radius  = cms.double(130.),
 +    zdist  = cms.double(314.),
 +    corner = cms.double(1.479),
 +    d0cuta = cms.double(0.015),
 +    d0cutb = cms.double(0.5),
 +    maxd0cut = cms.double(0.3),
 +    chi2_tight_max = cms.double(5.0),
 +    nhits_tight_min = cms.double(9),
 +    ptErr_tight_max = cms.double(0.2),
 +    eVetoDeltaR = cms.double(0.015),
 +    eVetoDeltaPhi = cms.double(100.0),
 +    eVetoDeltaCotTheta = cms.double(100.0),
 +    eVetoMinElectronPt = cms.double(10.0),
 +    hOverECut = cms.double(0.1),
 +    maxTrackAlgo = cms.int32(8),
 +    nLayers = cms.int32(0),
 +    nLayersTight = cms.int32(0),
 +    vertexNdof = cms.int32(4),
 +    vertexZ = cms.double(15.),
 +    vertexRho = cms.double(2.),
 +    vertexMaxDZ = cms.double(0.2),
 +    maxpt_eta25 = cms.double(0.),
 +    maxpt_eta20 = cms.double(100.),
 +    vetoDuplicates = cms.bool(False),
 +    dupMinPt = cms.double(0.),
 +    dupDPhi = cms.double(0.03),
 +    dupDCotTh = cms.double(0.0006),
 +    PFClustersECAL = cms.InputTag("particleFlowClusterECAL"),
 +    PFClustersHCAL = cms.InputTag("particleFlowClusterHCAL"),
 +    PFClustersHFEM = cms.InputTag("particleFlowClusterHFEM"),
 +    PFClustersHFHAD = cms.InputTag("particleFlowClusterHFHAD"),
 +    usePFClusters = cms.bool(False)
 +    )
++=======
+ # File: TCMET.cff
+ # Author: R. Remington & F. Golf 
+ # Date: 11.14.2008
+ #
+ # Form Track Corrected MET
+ 
+ tcMet = cms.EDProducer("METProducer",
+                        src = cms.InputTag("towerMaker"), #This parameter does not get used for TCMET
+                        METType = cms.string('TCMET'),
+                        alias = cms.string('TCMET'),
+                        noHF = cms.bool(False),
+                        electronVetoCone = cms.bool(True),
+                        globalThreshold = cms.double(0.0),
+                        InputType = cms.string('CaloMET:Electron:Muon:Track'),  #This parameter does not get used for TCMET
+                        electronInputTag  = cms.InputTag("gedGsfElectrons"),
+                        muonInputTag      = cms.InputTag("muons"),
+                        trackInputTag     = cms.InputTag("generalTracks"),
+                        metInputTag       = cms.InputTag("met"),
+                        beamSpotInputTag  = cms.InputTag("offlineBeamSpot"),
+                        vertexInputTag    = cms.InputTag("offlinePrimaryVertices"),
+                        muonDepValueMap   = cms.InputTag("muonMETValueMapProducer"  , "muCorrData"),     
+                        tcmetDepValueMap  = cms.InputTag("muonTCMETValueMapProducer", "muCorrData"), 
+                        pt_min  = cms.double(1.0),
+                        pt_max  = cms.double(100.),
+                        eta_max = cms.double(2.65), 
+                        chi2_max = cms.double(5),
+                        nhits_min = cms.double(6),
+                        ptErr_max = cms.double(0.2),
+                        track_quality = cms.vint32(2),
+                        track_algos = cms.vint32(), 
+                        isCosmics = cms.bool(False),
+                        rf_type = cms.int32(1),
+                        correctShowerTracks = cms.bool(False),
+                        usePvtxd0 = cms.bool(False),
+                        nMinOuterHits = cms.int32(2),
+                        usedeltaRRejection = cms.bool(False),
+                        deltaRShower = cms.double(0.01),
+                        checkTrackPropagation = cms.bool(False),
+                        radius  = cms.double(130.),
+                        zdist  = cms.double(314.),
+                        corner = cms.double(1.479),
+                        d0cuta = cms.double(0.015),
+                        d0cutb = cms.double(0.5),
+                        maxd0cut = cms.double(0.3),
+                        chi2_tight_max = cms.double(5.0),
+                        nhits_tight_min = cms.double(9),
+                        ptErr_tight_max = cms.double(0.2),
+                        eVetoDeltaR = cms.double(0.015),
+                        eVetoDeltaPhi = cms.double(100.0),
+                        eVetoDeltaCotTheta = cms.double(100.0),
+                        eVetoMinElectronPt = cms.double(10.0),
+                        hOverECut = cms.double(0.1),
+                        maxTrackAlgo = cms.int32(8),
+                        nLayers = cms.int32(0),
+                        nLayersTight = cms.int32(0),
+                        vertexNdof = cms.int32(4),
+                        vertexZ = cms.double(15.),
+                        vertexRho = cms.double(2.),
+                        vertexMaxDZ = cms.double(0.2),
+                        maxpt_eta25 = cms.double(0.),
+                        maxpt_eta20 = cms.double(100.),
+                        vetoDuplicates = cms.bool(False),
+                        dupMinPt = cms.double(0.),
+                        dupDPhi = cms.double(0.03),
+                        dupDCotTh = cms.double(0.0006),
+                        PFClustersECAL = cms.InputTag("particleFlowClusterECAL"),
+                        PFClustersHCAL = cms.InputTag("particleFlowClusterHCAL"),
+                        PFClustersHFEM = cms.InputTag("particleFlowClusterHFEM"),
+                        PFClustersHFHAD = cms.InputTag("particleFlowClusterHFHAD"),
+                        usePFClusters = cms.bool(False)
+                        )
+ 
+ 
++>>>>>>> cms-sw/refs/pull/1834/head

 +##____________________________________________________________________________||

@lgray
Copy link
Contributor Author

lgray commented Dec 16, 2013

@ktf Fixed now.

@cmsbuild
Copy link
Contributor

Pull request #1834 was updated. @thspeer, @giamman, @lveldere, @vlimant, @demattia, @danduggan, @franzoni, @rovere, @cmsbuild, @anton-a, @nclopezo, @rcastello, @deguio, @slava77, @eliasron, @fabiocos can you please check and sign again.

@lgray
Copy link
Contributor Author

lgray commented Dec 16, 2013

Doing some commit book-keeping.
In CMSSW_7_0_X_2013-12-16-0200, going to merge #1801 and then rebase the conflict-fixed #1834 ontop of the merge.
Hopefully this makes things less messy later?

@cmsbuild
Copy link
Contributor

Pull request #1834 was updated. @thspeer, @giamman, @lveldere, @vlimant, @demattia, @danduggan, @franzoni, @rovere, @cmsbuild, @anton-a, @nclopezo, @rcastello, @deguio, @slava77, @eliasron, @fabiocos can you please check and sign again.

1 similar comment
@cmsbuild
Copy link
Contributor

Pull request #1834 was updated. @thspeer, @giamman, @lveldere, @vlimant, @demattia, @danduggan, @franzoni, @rovere, @cmsbuild, @anton-a, @nclopezo, @rcastello, @deguio, @slava77, @eliasron, @fabiocos can you please check and sign again.

@lgray
Copy link
Contributor Author

lgray commented Dec 17, 2013

@slava77 rebased ontop of the latest #1801.

@cmsbuild
Copy link
Contributor

Pull request #1834 was updated. @thspeer, @giamman, @lveldere, @vlimant, @demattia, @danduggan, @franzoni, @rovere, @cmsbuild, @anton-a, @nclopezo, @rcastello, @deguio, @slava77, @eliasron, @fabiocos can you please check and sign again.

@lveldere
Copy link
Contributor

+1

@nclopezo
Copy link
Contributor

-1
I ran manually the RelVals and I got the following error in workflow 101.0 step1:

----- Begin Fatal Exception 17-Dec-2013 16:03:23 CET-----------------------
An exception of category 'ProductNotFound' occurred while
   [0] Processing run: 1 lumi: 1 event: 1
   [1] Running path 'local_digireco'
   [2] Calling event method for module InterestingDetIdFromSuperClusterProducer/'interestingEcalDetIdPFEB'
Exception Message:
Principal::getByToken: Found zero products matching all criteria
Looking for type: std::vector
Looking for module label: particleFlowSuperClusterECAL
Looking for productInstanceName: particleFlowSuperClusterECALBarrel
   Additional Info:
      [a] If you wish to continue processing events after a ProductNotFound exception,
add "SkipEvent = cms.untracked.vstring('ProductNotFound')" to the "options" PSet in the configuration.
----- End Fatal Exception -------------------------------------------------

@lgray
Copy link
Contributor Author

lgray commented Dec 17, 2013

Working on it... This one is weird.

@cmsbuild
Copy link
Contributor

Pull request #1834 was updated. @civanch, @thspeer, @giamman, @lveldere, @vlimant, @demattia, @eliasron, @franzoni, @mdhildreth, @cmsbuild, @anton-a, @nclopezo, @rcastello, @deguio, @slava77, @rovere, @fabiocos, @danduggan can you please check and sign again.

@lgray
Copy link
Contributor Author

lgray commented Dec 17, 2013

This is some problem with the validation being configured in a weird way. The rest of the RECO chain works.

@slava77
Copy link
Contributor

slava77 commented Dec 17, 2013

This PR reverts a couple of fixes present in the latest #1801:

  • the trackMomentumError fix
  • the event content fix to contain the PF clusters

It looks like this one can be closed and replaced by #1854

@slava77
Copy link
Contributor

slava77 commented Dec 17, 2013

@bendavid
Copy link
Contributor

@slava77, let me know if the error in #1834 (comment) is still a problem. I didn't manage to exactly reproduce it on top of this pull at least, but can try again on top of yours.

@slava77
Copy link
Contributor

slava77 commented Dec 17, 2013

Thanks for reminding of this , added 101.0 to my tests

@slava77
Copy link
Contributor

slava77 commented Dec 17, 2013

Interestingly enough it crashed in a different place

[1] Running path 'local_digireco'
[2] Calling event method for module PFECALSuperClusterProducer/'particleFlowSuperClusterECAL'
Exception Message:
Principal::getByToken: Found zero products matching all criteria
Looking for type: std::vector<std::pair<unsigned long,edm::Ptrreco::PFCluster > >
Looking for module label: particleFlowClusterECAL

@bendavid
Copy link
Contributor

Ok, "good", this is also what I see. Will take a look...

@slava77
Copy link
Contributor

slava77 commented Dec 17, 2013

additional replace will be necessary to get back
the correct inputs in Validation/Configuration/python/ECALHCAL.py

@bendavid
Copy link
Contributor

Ok,
Fixed both problems, just testing now...

@bendavid
Copy link
Contributor

This should be fixed by bendavid@b4d26fb, based on top of this commit.

@lgray
Copy link
Contributor Author

lgray commented Dec 19, 2013

@slava77 working on it

@lgray
Copy link
Contributor Author

lgray commented Dec 19, 2013

@dbenedet @bendavid @slava77 The cause of the difference was found to be changes to both the pre-selection of photons imported into the PFBlock as well as changes to the PFPhoton selection in particleFlowTmp. Waiting to see what diff to pre-1801 looks like.

@yiiyama This PR now includes #1869 please close it.

@cmsbuild
Copy link
Contributor

Pull request #1834 was updated. @civanch, @thspeer, @giamman, @lveldere, @vlimant, @demattia, @eliasron, @franzoni, @mdhildreth, @cmsbuild, @anton-a, @nclopezo, @rcastello, @deguio, @slava77, @rovere, @fabiocos, @danduggan can you please check and sign again.

@rcastello
Copy link

+1

@slava77
Copy link
Contributor

slava77 commented Dec 19, 2013

(continuing on diffs in the oldEG, with a previous version of this PR)
compared to pre-1801,
all_sign288-nogedvsorig_ttbarpuwf202p0c_log10recopfcandidates_particleflowegamma__reco_obj_pt

pfPhoton plots are also in agreement (no diffs, in fact)

gedPhotons are also in a much better agreement
all_sign288-nogedvsorig_ttbarpuwf202p0c_recophotons_gedphotons__reco_obj_energycorrections_regression1energy

gsfElectrons are pretty different (were about the same wrt 1801)
all_sign288-nogedvsorig_ttbarpuwf202p0c_recogsfelectrons_gsfelectrons__reco_obj_pt

I'm guessing the new regression explains the changes

@dbenedet
Copy link
Contributor

Hi Slava,

only the pt changed on the ttbar?
How the fake rate look likes?

thanks,
Daniele

On 19/12/13 14:39, slava77 wrote:

(continuing on diffs in the oldEG, with a previous version of this PR)
compared to pre-1801,
all_sign288-nogedvsorig_ttbarpuwf202p0c_log10recopfcandidates_particleflowegamma__reco_obj_pt
https://f.cloud.github.com/assets/4676718/1782612/14ae2dc4-68b2-11e3-9c0f-a4c6b8b2c86f.png

pfPhoton plots are also in agreement (no diffs, in fact)

gedPhotons are also in a much better agreement
all_sign288-nogedvsorig_ttbarpuwf202p0c_recophotons_gedphotons__reco_obj_energycorrections_regression1energy
https://f.cloud.github.com/assets/4676718/1782632/979efca4-68b2-11e3-8357-30972f4c5539.png

gsfElectrons are pretty different (were about the same wrt 1801)
all_sign288-nogedvsorig_ttbarpuwf202p0c_recogsfelectrons_gsfelectrons__reco_obj_pt
https://f.cloud.github.com/assets/4676718/1782638/c569cca4-68b2-11e3-9b1a-a6b7efbe1afc.png

I'm guessing the new regression explains the changes


Reply to this email directly or view it on GitHub
#1834 (comment).

@lgray
Copy link
Contributor Author

lgray commented Dec 19, 2013

@dbenedet Ah, good point. We cannot switch back to the converted brem find, so the fake rate will be higher for non-isolated guys. Sorry, I thought we could perfectly make a No-op, this is not true.

We've also identified another change which makes the customizeForOldEGReco not completely a no-op:
https://github.com/lgray/cmssw/blob/egm_december_integration/RecoEgamma/EgammaElectronAlgos/src/GsfElectronAlgo.cc#L1007
Where the new tracker-driven MVA preselection is applied. This can't really be reverted in python and needs to be retuned to get the original lower fake-rate.

@slava77
Copy link
Contributor

slava77 commented Dec 19, 2013

(in case this didn't get through .. i sent from my mail client and this message didn't show up .. I wonder why and how many more I missed in other places :-/ )

Hi Daniele,

You can see all plots in
https://slava77sk.web.cern.ch/slava77sk/reco/relvaldiffs/all_sign288-noGEDVSorig_TTbarPUwf202p0.tar.gz
this is a comparison with the reference ="without changes in 1801"

https://slava77sk.web.cern.ch/slava77sk/reco/relvaldiffs/all_sign288-noGEDVSsign284_TTbarPUwf202p0.tar.gz
this is with reference="after 1801"

@cmsbuild
Copy link
Contributor

Pull request #1834 was updated. @diguida, @civanch, @thspeer, @giamman, @lveldere, @vlimant, @demattia, @eliasron, @franzoni, @mdhildreth, @cmsbuild, @anton-a, @nclopezo, @rcastello, @deguio, @slava77, @rovere, @fabiocos, @danduggan can you please check and sign again.

working towards total no-op with respect to old RECO.
May not be possible due to new converted brem finder.
@cmsbuild
Copy link
Contributor

Pull request #1834 was updated. @diguida, @civanch, @thspeer, @giamman, @lveldere, @vlimant, @demattia, @eliasron, @franzoni, @mdhildreth, @cmsbuild, @anton-a, @nclopezo, @rcastello, @deguio, @slava77, @rovere, @fabiocos, @danduggan can you please check and sign again.

@slava77
Copy link
Contributor

slava77 commented Dec 19, 2013

In the meantime, on the event content in RECO:

from 16-0200 IB to that+#1834 in oldEG mode
RECO

  • gone: booledmValueMap_PhotonIDProd_PhotonCutBasedIDLooseEM_RECO. 17.78
  • gone: booledmValueMap_PhotonIDProd_PhotonCutBasedIDLoose_RECO. 17.585
  • gone: booledmValueMap_PhotonIDProd_PhotonCutBasedIDTight_RECO. 17.54
  • new: recoConversions_allConversionsOldEG__RECO. 2660.54
  • new: recoTrackExtras_ckfInOutTracksFromOldEGConversions__RECO. 580.59
  • new: recoTracks_ckfInOutTracksFromOldEGConversions__RECO. 349.44
  • new: recoTrackExtras_ckfOutInTracksFromOldEGConversions__RECO. 173.39
  • new: TrackingRecHitsOwned_ckfInOutTracksFromOldEGConversions__RECO. 120.445
  • new: recoTracks_ckfOutInTracksFromOldEGConversions__RECO. 108.39
  • new: TrackingRecHitsOwned_ckfOutInTracksFromOldEGConversions__RECO. 89.5
  • new: recoPFCandidatesrecoPFCandidaterecoPFCandidatesrecoPFCandidateedmrefhelperFindUsingAdvanceedmRefsedmValueMap_particleBasedIsolation_gedGsfElectrons_RECO. 48.35
  • new: recoPFCandidatesrecoPFCandidaterecoPFCandidatesrecoPFCandidateedmrefhelperFindUsingAdvanceedmRefsedmValueMap_particleBasedIsolation_gedPhotons_RECO. 36.915
  • new: recoPhotonsrecoPhotonrecoPhotonsrecoPhotonedmrefhelperFindUsingAdvanceedmRefedmValueMap_gedPhotons_valMapPFEgammaCandToPhoton_RECO. 22.98

The same in AOD:

  • gone: booledmValueMap_PhotonIDProd_PhotonCutBasedIDLooseEM_RECO. 17.78
  • gone: booledmValueMap_PhotonIDProd_PhotonCutBasedIDTight_RECO. 17.54
  • gone: booledmValueMap_PhotonIDProd_PhotonCutBasedIDLoose_RECO. 17.585
  • new: recoPFClusters_particleFlowClusterPS__RECO. 54122.9
  • new: recoPFClusters_particleFlowClusterECAL__RECO. 46984.1
  • new: recoConversions_allConversionsOldEG__RECO. 2660.54
  • new: recoConversions_gedPhotonCore__RECO. 69.04
  • new: recoTracks_ckfInOutTracksFromOldEGConversions__RECO. 349.44
  • new: recoTracks_ckfOutInTracksFromOldEGConversions__RECO. 108.39
  • new: recoPFCandidatesrecoPFCandidaterecoPFCandidatesrecoPFCandidateedmrefhelperFindUsingAdvanceedmRefsedmValueMap_particleBasedIsolation_gedGsfElectrons_RECO. 48.35
  • new: recoPFCandidatesrecoPFCandidaterecoPFCandidatesrecoPFCandidateedmrefhelperFindUsingAdvanceedmRefsedmValueMap_particleBasedIsolation_gedPhotons_RECO. 36.915

16-0200 IB -> that+#1834 (new default)
RECO

  • gone: recoPFCandidates_particleFlowTmp_electrons_RECO. 1066.99
  • gone: recoGsfElectrons_gsfElectrons__RECO. 630.815
  • gone: recoSuperClusters_pfElectronTranslator_pf_RECO. 262.35
  • gone: recoCaloClusters_pfElectronTranslator_pf_RECO. 259.56
  • gone: recoPreshowerClusters_pfElectronTranslator_pf_RECO. 129.53
  • gone: recoGsfElectrons_pfElectronTranslator_pf_RECO. 126.865
  • gone: floatedmValueMap_pfElectronTranslator_pf_RECO. 41.19
  • gone: recoPreshowerClusters_pfPhotonTranslator_pfphot_RECO. 38.885
  • gone: recoCaloClusters_pfPhotonTranslator_pfphot_RECO. 38.71
  • gone: recoSuperClusters_pfPhotonTranslator_pfphot_RECO. 37.395
  • gone: recoGsfElectronCores_gsfElectronCores__RECO. 32.7
  • gone: recoSuperClustersrecoSuperClusterrecoSuperClustersrecoSuperClusteredmrefhelperFindUsingAdvanceedmRefedmValueMap_pfElectronTranslator_pf_RECO. 32.59
  • gone: recoPhotons_pfPhotonTranslator_pfphot_RECO. 26.385
  • gone: recoGsfElectronCores_pfElectronTranslator_pf_RECO. 23.195
  • gone: recoConversions_pfPhotonTranslator_pfphot_RECO. 18.795
  • gone: booledmValueMap_PhotonIDProd_PhotonCutBasedIDLooseEM_RECO. 17.78
  • gone: booledmValueMap_PhotonIDProd_PhotonCutBasedIDLoose_RECO. 17.585
  • gone: booledmValueMap_PhotonIDProd_PhotonCutBasedIDTight_RECO. 17.54
  • gone: recoPhotonCores_pfPhotonTranslator_pfphot_RECO. 16.25
  • new: recoPhotons_mustachePhotons__RECO. 487.93
  • new: recoPFCandidatesrecoPFCandidaterecoPFCandidatesrecoPFCandidateedmrefhelperFindUsingAdvanceedmRefsedmValueMap_particleBasedIsolation_gedPhotons_RECO. 45.42
  • new: recoPhotonCores_mustachePhotonCore__RECO. 43.03
  • new: recoPFCandidatesrecoPFCandidaterecoPFCandidatesrecoPFCandidateedmrefhelperFindUsingAdvanceedmRefsedmValueMap_particleBasedIsolation_gedGsfElectrons_RECO. 42.415
  • new: recoPhotonsrecoPhotonrecoPhotonsrecoPhotonedmrefhelperFindUsingAdvanceedmRefedmValueMap_gedPhotons_valMapPFEgammaCandToPhoton_RECO. 22.98

The same in AOD

  • gone: recoGsfElectrons_gsfElectrons__RECO. 630.815
  • gone: recoPhotons_pfPhotonTranslator_pfphot_RECO. 26.385
  • gone: recoPFCandidates_particleFlowTmp_electrons_RECO. 1066.99
  • gone: recoConversions_pfPhotonTranslator_pfphot_RECO. 18.795
  • gone: recoSuperClusters_pfElectronTranslator_pf_RECO. 262.35
  • gone: recoSuperClusters_pfPhotonTranslator_pfphot_RECO. 37.395
  • gone: recoCaloClusters_pfElectronTranslator_pf_RECO. 259.56
  • gone: recoPhotonCores_pfPhotonTranslator_pfphot_RECO. 16.25
  • gone: recoCaloClusters_pfPhotonTranslator_pfphot_RECO. 38.71
  • gone: recoGsfElectronCores_gsfElectronCores__RECO. 32.7
  • gone: recoPreshowerClusters_pfElectronTranslator_pf_RECO. 129.53
  • gone: booledmValueMap_PhotonIDProd_PhotonCutBasedIDLooseEM_RECO. 17.78
  • gone: booledmValueMap_PhotonIDProd_PhotonCutBasedIDTight_RECO. 17.54
  • gone: booledmValueMap_PhotonIDProd_PhotonCutBasedIDLoose_RECO. 17.585
  • gone: recoPreshowerClusters_pfPhotonTranslator_pfphot_RECO. 38.885
  • new: recoPFClusters_particleFlowClusterPS__RECO. 54122.2
  • new: recoPFClusters_particleFlowClusterECAL__RECO. 46984.8
  • new: recoPhotons_mustachePhotons__RECO. 487.93
  • new: recoConversions_gedPhotonCore__RECO. 73.775
  • new: recoPFCandidatesrecoPFCandidaterecoPFCandidatesrecoPFCandidateedmrefhelperFindUsingAdvanceedmRefsedmValueMap_particleBasedIsolation_gedGsfElectrons_RECO. 42.415
  • new: recoPFCandidatesrecoPFCandidaterecoPFCandidatesrecoPFCandidateedmrefhelperFindUsingAdvanceedmRefsedmValueMap_particleBasedIsolation_gedPhotons_RECO. 45.42
  • new: recoPhotonCores_mustachePhotonCore__RECO. 43.03

Does this match your needs?

@lgray
Copy link
Contributor Author

lgray commented Dec 19, 2013

Not sure why PhotonIDProd got dropped... Checking with latest commits.

Trying to make it work on gedPhotons is wrought with peril and variously tentacled demons.
^^^^^ We should eventually fix this part, especially the demons.
@cmsbuild
Copy link
Contributor

Pull request #1834 was updated. @diguida, @civanch, @thspeer, @giamman, @lveldere, @vlimant, @demattia, @eliasron, @franzoni, @mdhildreth, @cmsbuild, @anton-a, @nclopezo, @rcastello, @deguio, @slava77, @rovere, @fabiocos, @danduggan can you please check and sign again.

@lgray
Copy link
Contributor Author

lgray commented Dec 19, 2013

@slava77 : @sdevissc's addition here should allow us to have a fairly close no-op to the pre-1801 state.

In particular, gsfElectrons should be a no-op to pre-1801 (now uses old MVA preID), gedGsfElectrons will be a no-op to 1801 in non-GED mode (updated MVA preID).

@cmsbuild
Copy link
Contributor

Pull request #1834 was updated. @diguida, @civanch, @thspeer, @giamman, @lveldere, @vlimant, @demattia, @eliasron, @franzoni, @mdhildreth, @cmsbuild, @anton-a, @nclopezo, @rcastello, @deguio, @slava77, @rovere, @fabiocos, @danduggan can you please check and sign again.

@slava77
Copy link
Contributor

slava77 commented Dec 19, 2013

I'm running the tests now.
So far the status is

  • new code looks OK
  • it compiles
  • short workflows have already completed in both new and old mode without crashes

@slava77
Copy link
Contributor

slava77 commented Dec 20, 2013

+1

Final tests done in CMSSW_7_0_X_2013-12-18-1400 (as sign289) in the new default and the oldEG mode.

Decision is based on the results above, code diffs in the last iteration, and the summary below.

@lgray Lindsey (below) there are quite a few empty plots for conversions in the oldEG mode. I understand that they are either not used for the default photons or can be validated appropriately in the other (oldpf and pf photon validators)

Note: I'm comparing to the IB itself shows expected differences introduced by 1801 (and 1862). Comparisons to pre-1801 is not done (can't just diff with my old tests in IB 16-0200, because the Run2 tracking was added in between, which reshuffles everything).

New default mode compared to IB (1801 is here) withGED mode

  • increased size of reduced ecal hit collections (new in 1834)
  • conversions changed (bug fix of withGED mode in 1801)
  • downstream objects changed too (convs are inputs to PFBlock .. so, quite a few, but small changes)
    DQM (looking only at very large diffs):
  • PhotonAnalyzer///Conversions plots are empty (we gave up on these, IIRC)
  • HLT EgOffline plots comparing SC in HLT and reco changed a lot (~expected, but the analyzers will likely need a fix to match to correct SCs to do apples-to-apples)
  • HLT TauOffline/PFTaus is now filled (missed that it was broken in 1801?)

noGED mode: comparing 1834 in oldEG mode vs IB
[similar changes as earlier tests in 16-0200 comparing after1801 wrt after1834]

  • gedGsfElectrons and gedPhotons going back to pre-regression state (maybe not a good choice)
  • particleFlowBlock changes due to diff in cuts (to go away in pre-1801 comparisons)
  • gsfElectrons ~unchanged in ele guns, larger diff in pho/bgd (as for pfBlock);
  • particleFlowEGamma changes (presel as in pfblock, expect no diff when comp wrt pre-1801)
  • pfElectron and pfPhoton changes due to preselection change (to go away wrt pre-1801)
  • other changes are downstream (reduced hits, pfcands ...)

DQM:

  • EB cluster changes significantly, this correctly switches back to the old clusters
    1834-noGED: BasicClusterCollection = cms.InputTag("hybridSuperClusters","hybridBarrelBasicClusters"),
    orig (has 1862!): BasicClusterCollection = cms.InputTag("particleFlowClusterECAL"),
  • PhotonAnalyzer///Conversions plots are empty [need a fix?]
  • PhotonValidator/Background conv plots are empty [need a fix?]
  • PhotonValidator/ConversionInfo and PhotonValidator/Efficiencies empty [need a fix?]
  • oldpfPhotonValidator/Photons (some) plots were empty now filled

@deguio
Copy link
Contributor

deguio commented Dec 20, 2013

+1
I didn't check the content of all the plots but everything looks fine.
[all the histos are there at least]

@fabiocos
Copy link
Contributor

+1

@ktf
Copy link
Contributor

ktf commented Dec 20, 2013

@civanch @mdhildreth @lveldere @rcastello @demattia @diguida, I'll wait a bit more for your approval, but then I'll bypass it since this is the last showstopper for 700pre11 and I want this in the 1400 build.

@lgray
Copy link
Contributor Author

lgray commented Dec 20, 2013

@slava77 Is the fake rate for electrons (look at low-pT gsf Electrons in TTbar) lower in OldEG mode now?

@slava77
Copy link
Contributor

slava77 commented Dec 20, 2013

Lindsey,
yes, the rate looks lower.

all_sign289-nogedvsorig-x1887_ttbarpuwf202p0c_recogsfelectrons_gsfelectrons__reco_obj_pt

screen shot 2013-12-20 at 11 39 37 am

ktf added a commit that referenced this pull request Dec 20, 2013
GED EGM RECO as default + customizeOldEGReco
@ktf ktf merged commit 53ca909 into cms-sw:CMSSW_7_0_X Dec 20, 2013
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet