Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

setup to run miniAOD on legacy 80X AOD inputs #19304

Merged

Conversation

slava77
Copy link
Contributor

@slava77 slava77 commented Jun 16, 2017

  • run2_miniAOD_80XLegacy modifier (to be added to the list of eras with Run2_2016 or related)
  • updates from MiniAOD customization for legacy re-miniAOD #18828 for deep flavor
  • disable chargedHadronIsolation reading in packedPFCandidates (it is not available in 80X)

Tested in CMSSW_9_2_3_patch1 with the following:

for MC:

cmsDriver.py step3  --conditions auto:run2_mc --mc --scenario pp --process PAT --era Run2_2016,run2_miniAOD_80XLegacy --eventcontent MINIAODSIM,DQM --runUnscheduled  -s PAT,VALIDATION:@miniAODValidation,DQM:@miniAODDQM --datatier MINIAODSIM,DQMIO  -n 3000 --filein /store/mc/RunIISummer16DR80Premix/TT_TuneCUETP8M2T4_13TeV-powheg-pythia8/AODSIM/PUMoriond17_backup_80X_mcRun2_asymptotic_2016_TrancheIV_v6-v1/00000/004973E8-26BA-E611-93E0-A0000420FE80.root  --fileout file:step3.root > step3.log  2>&1 

cmsDriver.py step4  --filetype DQM --conditions auto:run2_mc --mc  --scenario pp -s HARVESTING:@miniAODValidation+@miniAODDQM --era Run2_2016,run2_miniAOD_80XLegacy -n -1 --filein file:step3_inDQM.root --fileout file:step4.root  > step4.log  2>&1 

for data:

cmsDriver.py step3  --conditions auto:run2_data --data --scenario pp --process PAT --era Run2_2016,run2_miniAOD_80XLegacy --eventcontent MINIAOD,DQM --runUnscheduled  -s PAT,DQM:@miniAODDQM --datatier MINIAOD,DQMIO  -n 3000 --filein /store/data/Run2016E/MET/AOD/18Apr2017-v1/120001/A21C3008-A548-E711-A90D-FA163E26AC84.root  --fileout file:step3.root > step3.log  2>&1 

cmsDriver.py step4  --filetype DQM --conditions auto:run2_data --data --scenario pp  -s HARVESTING:@miniAODDQM --era Run2_2016,run2_miniAOD_80XLegacy -n -1 --filein file:step3_inDQM.root --fileout file:step4.root  > step4.log  2>&1 

Here are a couple of plots from the MET PD (instructions above):

  • some things are essentially the same (with recognizeable changes [simple , e.g. p4 kinematics pf packedCandidates is the same)]:
    all_8_0_28_patch1-orig-patvs9_2_3_patch1-sign917-pat_met18apr2017c_patpackedcandidates_packedpfcandidates__pat_obj_packeddxy_

  • Some things differ more (and I don't obviously recognize the difference
    E.g. in slimmedJets (maybe cleaning is not the same? it's the same ak4PFJetsCHS on input from AOD directly)
    all_8_0_28_patch1-orig-patvs9_2_3_patch1-sign917-pat_met18apr2017c_log10patjets_slimmedjets__pat_obj_et
    )
    all_8_0_28_patch1-orig-patvs9_2_3_patch1-sign917-pat_met18apr2017c_log10patjets_slimmedjets__pat_obj_energy
    Note that ak4PFJets

@mverzett @kmcdermo @arizzi @gpetruc

@fabozzi please take a look to possibly set up a matrix workflow to have this regularly tested.

@cmsbuild
Copy link
Contributor

A new Pull Request was created by @slava77 (Slava Krutelyov) for master.

It involves the following packages:

Configuration/Eras
Configuration/StandardSequences
PhysicsTools/PatAlgos

@perrotta, @monttj, @cmsbuild, @franzoni, @slava77, @davidlange6 can you please review it and eventually sign? Thanks.
@ghellwig, @TaiSakuma, @gouskos, @felicepantaleo, @rappoccio, @Martin-Grunewald, @ahinzmann, @seemasharmafnal, @mmarionncern, @imarches, @makortel, @acaudron, @jdolen, @ferencek, @GiacomoSguazzoni, @rovere, @VinInn, @nhanvtran, @gkasieczka, @schoef, @ebrondol, @dgulhan, @JyothsnaKomaragiri, @mverzett, @gpetruc, @mariadalfonso, @pvmulder this is something you requested to watch as well.
@davidlange6 you are the release manager for this.

cms-bot commands are listed here

@slava77
Copy link
Contributor Author

slava77 commented Jun 16, 2017

@cmsbuild please test

@cmsbuild
Copy link
Contributor

cmsbuild commented Jun 16, 2017

The tests are being triggered in jenkins.
https://cmssdt.cern.ch/jenkins/job/ib-any-integration/20656/console Started: 2017/06/16 22:41

@slava77
Copy link
Contributor Author

slava77 commented Jun 17, 2017

@cmsbuild please test
the last attempt failed, but was not recognized by the bot

@smuzaffar please take a look at what happened in connection to
https://cmssdt.cern.ch/jenkins/job/ib-any-integration/20656/console
Thank you

@cmsbuild
Copy link
Contributor

cmsbuild commented Jun 17, 2017

The tests are being triggered in jenkins.
https://cmssdt.cern.ch/jenkins/job/ib-any-integration/20665/console Started: 2017/06/17 14:29

@cmsbuild
Copy link
Contributor

@cmsbuild
Copy link
Contributor

Comparison job queued.

@cmsbuild
Copy link
Contributor

Comparison is ready
https://cmssdt.cern.ch/SDT/jenkins-artifacts/pull-request-integration/PR-19304/20665/summary.html

Comparison Summary:

  • No significant changes to the logs found
  • Reco comparison results: 0 differences found in the comparisons
  • DQMHistoTests: Total files compared: 22
  • DQMHistoTests: Total histograms compared: 1803136
  • DQMHistoTests: Total failures: 15059
  • DQMHistoTests: Total nulls: 0
  • DQMHistoTests: Total successes: 1787911
  • DQMHistoTests: Total skipped: 166
  • DQMHistoTests: Total Missing objects: 0
  • Checked 90 log files, 14 edm output root files, 22 DQM output files

@slava77
Copy link
Contributor Author

slava77 commented Jun 17, 2017

+1

for #19304 bb794a7

  • setup for special workflows using run2_miniAOD_80XLegacy modifier ; current standard workflows are not affected
  • jenkins tests pass and comparisons show no differences

@davidlange6
Copy link
Contributor

hi @slava77 - could we not just use the 2016 era instead of defining a new era? This is presumably now the desired miniaod code for 2016 data, right?

@gpetruc
Copy link
Contributor

gpetruc commented Jun 20, 2017 via email

@slava77
Copy link
Contributor Author

slava77 commented Jun 20, 2017 via email

@davidlange6
Copy link
Contributor

davidlange6 commented Jun 20, 2017 via email

@davidlange6
Copy link
Contributor

so lets move forward - however, we lack a mechanism parallel to what we have in other workflow components (eg, -s RECO:trackingOnly) as the configs are unscheduled.

Should we not control via a config variable longer term?

Eg, one could do -s PAT:redoJets

which sets process.miniAODControl.redoJets=1 that propagates down - (I guess this is not so different from eras, but keeps the distinct concepts as distinct.

@davidlange6
Copy link
Contributor

merge

@cmsbuild cmsbuild merged commit dc15221 into cms-sw:master Jun 20, 2017
@slava77
Copy link
Contributor Author

slava77 commented Jun 20, 2017 via email

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

5 participants