CMS: 2015 data release checklist

[katilp]

Checklist for the 2015 release, to be discussed and approved. This is to start the preparations.
(from cernopendata/opendata.cern.ch#1310)

• collision dataset list (see CMS: 2015 collision datasets - which datasets from RunC #66, change to Run2015D, see CMS: 2015 collision datasets - which datasets from RunD #70) 117.1 TB (AOD) + 15 TB (MiniAOD)
  • see the final comment and the list approved in Feb 2020
    • part (or all )of AOD: dataset=/*/Run2015D-16Dec2015-*/AOD
    • part (or all) of MINIAOD: dataset=/*/Run2015D-16Dec2015-*/MINIAOD
      • https://twiki.cern.ch/twiki/bin/view/CMS/PdmV2015Analysis
    • but DoubleEG, SingleElectron from dataset=/*/*2015D*Jun2016/AOD and dataset=/*/*2015D*Jun2016*/MINIAOD
    • https://twiki.cern.ch/twiki/bin/viewauth/CMS/PdmVDataReprocessing765p1EcalCorrFix
  • Records, see #CMS: build the 2015 collision dataset records opendata.cern.ch#3153
• MC data
  • Run2 Fall15 MiniAOD v2 campaign (76X version 2): dataset=/*/*RunIIFall15MiniAODv2-PU25nsData2015v1*/* Size: 227.4TB, 7114 datasets
• dataset for pileup, see CMS: dataset for 2015 MC pileup  #101
• pileup profile description in /docs/cms-guide-pileup-simulation (http://opendata.cern.ch/docs/cms-guide-pileup-simulation), see CMS: update docs for the 2015 pileup information opendata.cern.ch#3162
• categorize MC, check the categories, and decide the datasets to transfer (SM, B-phys, Higgs?), see CMS: run the categorization script for 2015 MC #69
  • transfer all as MINIAODSIM
• check resources for the total of 360TB
• setup the transfer with rucio (incl. proper book-keeping for MC), see CMS: transfers with rucio #98 for test
• transfer see CMS: transfers with rucio #98
• Global tags see CMS: 2015 global tags #103
  • are they needed for MiniAOD? Not necessarily but for DP and MC generation
  • data: 76X_dataRun2_16Dec2015_v0
  • MC: 76X_mcRun2_asymptotic_RunIIFall15DR76_v1
• build records for the condition data, see CMS: build records for the 2015 condition data GTs  opendata.cern.ch#3173
• json files, see CMS: 2015 json for validated runs #104
• build a trigger menu as in http://opendata.cern.ch/record/1700 , see CMS: a script to extract configurations for data taking #67
  • https://fwyzard.web.cern.ch/fwyzard/hlt/2015/summary
  • https://fwyzard.web.cern.ch/fwyzard/hlt/2015/summary.html
• dataset short description for the records see Update CMSDatasetDescription_Run2015D.csv #120
• trigger listing, see CMS: trigger listing for Run2 data taking #71
• MC provenance and configurations file see CMS: provenance metadata for 2015 MC #68 and CMS generator cards for 2015 files #97
• data-taking configurations see CMS: a script to extract configurations for data taking #67 (comment) and cms-run2-hlt-triggers: initial release #79
• usage examples & documentation
  • new /docs/cms-virtual-machine-2015 see CMS: create a new 2015 VM page opendata.cern.ch#3164
  • new /docs/cms-getting-started-2015 see CMS: create a new 2015 getting started page opendata.cern.ch#3165
  • updates in /docs/cms-guide-docker see CMS: update docker docs for the 2015 data and CMSSW_7_6_7 container opendata.cern.ch#3163
  • updates in docs/about-cms see CMS: update about CMS page opendata.cern.ch#3176
  • updates in docs/cms-guide-for-condition-database see CMS: update condition database guide for 2015 GTs opendata.cern.ch#3172