Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

CMS: 2015 datasets - initial considerations #1310

Closed
katilp opened this issue Aug 8, 2017 · 1 comment
Closed

CMS: 2015 datasets - initial considerations #1310

katilp opened this issue Aug 8, 2017 · 1 comment

Comments

@katilp
Copy link
Member

katilp commented Aug 8, 2017

For Run 2, i.e. from 2015 onwards, CMS is using the MiniAOD format.
Data will be released in MiniAOD (and AOD, to be discussed in CMS)

From PPD conveners (03.12.2019):

'16Dec2015' is the proper version for 2015 data analysis as mentioned in
https://twiki.cern.ch/twiki/bin/view/CMS/PdmV2015Analysis

'08Jun2016' (3.8T) & '09Jun2016' (0T) are for Egamma datasets
https://twiki.cern.ch/twiki/bin/view/CMS/PdmVDataReprocessing765p1EcalCorrFix
(This is not mentioned in the above Analysis Recipe)

Regarding the release, we can consider last version of CMSSW_7_6, i.e. CMSSW_7_6_6_patch1.

Data reprocessings for 2015:

  • 16Dec2015: Reprocessing of 13 TeV data, 3.8 T
  • 20Jan2016: Reprocessing of Cosmics data, 3.8T
  • 27Jan2016: Reprocessing of 13 TeV data, 0 T
  • 01Mar2016: Reprocessing of Cosmics data, 0T
  • 08Jun2016 (3.8 T data) and 09Jun2016 (0T data): Reprocessing with Ecal
    correction fix (only for specific PDs affected by this)

See information in
https://twiki.cern.ch/twiki/bin/view/CMS/PdmVDataReprocessing
https://twiki.cern.ch/twiki/bin/view/CMS/PdmVDataReprocessing76EndOf2015

The legacy processings (confirmed for MiniAOD by Giovanni Petrucciani) are:

MiniAOD:

Collision data

https://twiki.cern.ch/twiki/bin/view/CMSPublic/WorkBookMiniAOD#Run2015_Data_76X
dataset=/*/*16Dec2015*/MINIAOD
Size: 24.4TB
237 datasets, no Run2015A (B=0T)

MC

https://twiki.cern.ch/twiki/bin/view/CMSPublic/WorkBookMiniAOD#2015_MC
Run2 Fall15 MiniAOD v2 campaign (76X version 2)
dataset=/*/*RunIIFall15MiniAODv2-PU25nsData2015v1*/*
(but some SUSY studies remained in 764)
Size: 227.4TB
7114 datasets

Corresponding AOD:

Collision data

Total size of PromptReco just for cross-check and comparison (including all versions v1, v2, v3..., all technical and 0T datasets), not to be included to legacy or release

Datasets: https://cmsweb.cern.ch/das/request?view=list&limit=50&instance=prod%2Fglobal&input=dataset%3D%2F*%2FRun2015*PromptReco*%2FAOD+
Size: https://cmsweb.cern.ch/das/request?view=list&limit=50&instance=prod%2Fglobal&input=block+dataset%3D%2F*%2FRun2015*PromptReco*%2FAOD+%7C+sum%28block.size%29
Size 303.7TB
441 datasets

Single reprocessings

##### 16Oct2015:
https://cmsweb.cern.ch/das/request?view=list&limit=50&instance=prod%2Fglobal&input=dataset%3D%2F*%2F*16Oct2015*%2FAOD
Size: 9.4TB
51 datasets, RunB only

16Dec2015:

dataset=/*/*16Dec2015*/AOD
Size: 189.6TB
237 datasets, no Run2015A
Release: CMSSW_7_6_3

27Jan2016:

dataset=/*/*27Jan2016*/AOD
Size: 51.7TB
168 datasets
Release: CMSSW_7_6_3_patch2

MC

dataset=/*/*RunIIFall15*/AODSIM
(to be confirmed!!)
Size: 2.1PB
7370 datasets

If restricting to parent data of MiniAOD above
dataset=/*/RunIIFall15DR76-PU25nsData2015v1_76X_mcRun2*/AODSIM
Size: 1.7PB
6750 datasets (i.e. less than MiniAOD)

Total volume:

  • min 250TB (MiniAOD for data + MC)
  • or 240 TB + 250 TB = 0.5PB (MiniAOD and AOD for data, MiniAOD for MC)
  • max 2.5PB (MiniAOD and AOD for data + MC)

Luminosity considerations

See https://twiki.cern.ch/twiki/bin/view/CMSPublic/LumiPublicResults#2015_Proton_Proton_13_TeV_Collis
Release RunC (beginning Sept - beginning Oct)?

RAW

The total sum is just for the record, not for a release on CODP apart from small samples:
dataset=/*/Run2015*/RAW
488 datasets
Size: 1.5PB

@katilp
Copy link
Member Author

katilp commented Mar 3, 2018

Updating the values and links above

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant