CMS: 2015 collision datasets - which datasets from RunC

[katilp]

(From #65 ) The release is to be discussed and approved, this is to start the preparations.

• which datasets
  • AOD: dataset=/*/Run2015C_25ns-16Dec2015-*/AOD
  • MINIAOD: dataset=/*/Run2015C_25ns-16Dec2015-*/MINIAOD
    • https://twiki.cern.ch/twiki/bin/view/CMS/PdmV2015Analysis
  • but DoubleEG, SingleElectron from dataset=/*/*2015C_25ns*Jun2016/AOD and dataset=/*/*2015C_25ns*Jun2016*/MINIAOD
    • https://twiki.cern.ch/twiki/bin/viewauth/CMS/PdmVDataReprocessing765p1EcalCorrFix
  • if only 3.8T runs (see below) then DoubleEG, SingleElectron from dataset=/*/*2015C_25ns*08Jun2016/AOD and dataset=/*/*2015C_25ns*08Jun2016*/MINIAOD
• 0 T runs?
  • somewhat unique data...
  • some 0 T runs are together with 3.8 T runs, others in a separate dataset e.g. DoubleEG_0T and SingleElectron_0T see https://twiki.cern.ch/twiki/bin/viewauth/CMS/PdmVDataReprocessing765p1EcalCorrFix#Run2015C_25ns
  • should the other _0T datasets reprocessed from dataset=/*_0T/Run2015C*/RAW be considered?
    • not included in dataset=/*/Run2015C_25ns-16Dec2015-*/AOD processing but available in other processings
  • NB that the 0 T runs which are not in the separate _0T datasets are not included in the "physics-looking" datasets of 16Dec2015 processings, they include the same 11 runs indicated in https://twiki.cern.ch/twiki/bin/viewauth/CMS/PdmVDataReprocessing765p1EcalCorrFix#Run2015C_25ns for SingleElectron and some less "physics-looking" datasets include the 19 runs for DoubleEG
• data volume
  • Run2015C_25ns-16Dec2015 AOD: 13.58 TB but exclude DoubleEG (0.33TB) and SingleElectron (0.13TB) from there and take from 08Jun2016 reprocessing (the same size)
  • Run2015C_25ns-16Dec2015 MINIAOD: 2.2 TB

[katilp]

https://cmsweb.cern.ch/das/request?view=list&limit=70&instance=prod%2Fglobal&input=dataset%3D%2F*%2FRun2015C_25ns-16Dec2015-*%2FAOD :

Dataset	Runs
/Tau/Run2015C_25ns-16Dec2015-v1/AOD	physics
/SinglePhoton/Run2015C_25ns-16Dec2015-v1/AOD	physics
/SingleMuon/Run2015C_25ns-16Dec2015-v1/AOD	physics
/SingleElectron/Run2015C_25ns-16Dec2015-v1/AOD	physics
/MuonEG/Run2015C_25ns-16Dec2015-v1/AOD	physics
/MuOnia/Run2015C_25ns-16Dec2015-v1/AOD	physics
/MET/Run2015C_25ns-16Dec2015-v1/AOD	physics
/JetHT/Run2015C_25ns-16Dec2015-v1/AOD	physics
/HTMHT/Run2015C_25ns-16Dec2015-v1/AOD	physics
/DoubleMuonLowMass/Run2015C_25ns-16Dec2015-v1/AOD	physics
/DoubleMuon/Run2015C_25ns-16Dec2015-v1/AOD	physics
/DisplacedJet/Run2015C_25ns-16Dec2015-v1/AOD	physics
/Charmonium/Run2015C_25ns-16Dec2015-v1/AOD	physics
/BTagMu/Run2015C_25ns-16Dec2015-v1/AOD	physics
/BTagCSV/Run2015C_25ns-16Dec2015-v1/AOD	physics
/DoubleEG/Run2015C_25ns-16Dec2015-v1/AOD	physics + lowpu
/Commissioning/Run2015C_25ns-16Dec2015-v1/AOD	physics + lowpu
/FullTrack/Run2015C_25ns-16Dec2015-v1/AOD	physics + lowpu
/HLTPhysics/Run2015C_25ns-16Dec2015-v1/AOD	physics + lowpu
/HighMultiplicity85/Run2015C_25ns-16Dec2015-v1/AOD	physics + lowpu
/HighMultiplicity/Run2015C_25ns-16Dec2015-v1/AOD	physics + lowpu
/HcalNZS/Run2015C_25ns-16Dec2015-v1/AOD	physics + lowpu
/HcalHPDNoise/Run2015C_25ns-16Dec2015-v1/AOD	physics + lowpu
/NoBPTX/Run2015C_25ns-16Dec2015-v1/AOD	physics + lowpu
/ZeroBias/Run2015C_25ns-16Dec2015-v1/AOD	physics + lowpu
/HLTPhysicspart7/Run2015C_25ns-16Dec2015-v1/AOD	8 of 11 physics runs
/HLTPhysicspart6/Run2015C_25ns-16Dec2015-v1/AOD	8 of 11 physics runs
/HLTPhysicspart5/Run2015C_25ns-16Dec2015-v1/AOD	8 of 11 physics runs
/HLTPhysicspart4/Run2015C_25ns-16Dec2015-v1/AOD	8 of 11 physics runs
/HLTPhysicspart3/Run2015C_25ns-16Dec2015-v1/AOD	8 of 11 physics runs
/HLTPhysicspart2/Run2015C_25ns-16Dec2015-v1/AOD	8 of 11 physics runs
/HLTPhysicspart1/Run2015C_25ns-16Dec2015-v1/AOD	8 of 11 physics runs
/HLTPhysicspart0/Run2015C_25ns-16Dec2015-v1/AOD	8 of 11 physics runs
/ZeroBias8/Run2015C_25ns-16Dec2015-v1/AOD	7 of 11 phys, all lowpu, 3 others
/ZeroBias7/Run2015C_25ns-16Dec2015-v1/AOD	7 of 11 phys, all lowpu, 3 others
/ZeroBias6/Run2015C_25ns-16Dec2015-v1/AOD	7 of 11 phys, all lowpu, 3 others
/ZeroBias5/Run2015C_25ns-16Dec2015-v1/AOD	7 of 11 phys, all lowpu, 3 others
/ZeroBias4/Run2015C_25ns-16Dec2015-v1/AOD	7 of 11 phys, all lowpu, 3 others
/ZeroBias3/Run2015C_25ns-16Dec2015-v1/AOD	7 of 11 phys, all lowpu, 3 others
/ZeroBias2/Run2015C_25ns-16Dec2015-v1/AOD	7 of 11 phys, all lowpu, 3 others
/ZeroBias1/Run2015C_25ns-16Dec2015-v1/AOD	7 of 11 phys, all lowpu, 3 others
/ToTOTEM/Run2015C_25ns-16Dec2015-v1/AOD	lowpu
/TOTEM_romanPots3/Run2015C_25ns-16Dec2015-v1/AOD	five lowpu runs
/TOTEM_romanPots2/Run2015C_25ns-16Dec2015-v1/AOD	lowpu
/TOTEM_romanPots1/Run2015C_25ns-16Dec2015-v1/AOD	lowpu
/TOTEM_romanPots/Run2015C_25ns-16Dec2015-v1/AOD	lowpu
/TOTEM_minBias2/Run2015C_25ns-16Dec2015-v1/AOD	lowpu
/TOTEM_minBias1/Run2015C_25ns-16Dec2015-v1/AOD	lowpu
/L1MinimumBiasHF8/Run2015C_25ns-16Dec2015-v1/AOD	lowpu
/L1MinimumBiasHF7/Run2015C_25ns-16Dec2015-v1/AOD	lowpu
/L1MinimumBiasHF6/Run2015C_25ns-16Dec2015-v1/AOD	lowpu
/L1MinimumBiasHF5/Run2015C_25ns-16Dec2015-v1/AOD	lowpu
/L1MinimumBiasHF4/Run2015C_25ns-16Dec2015-v1/AOD	lowpu
/L1MinimumBiasHF3/Run2015C_25ns-16Dec2015-v1/AOD	lowpu
/L1MinimumBiasHF2/Run2015C_25ns-16Dec2015-v1/AOD	lowpu
/L1MinimumBiasHF1/Run2015C_25ns-16Dec2015-v1/AOD	lowpu
/L1MinimumBias/Run2015C_25ns-16Dec2015-v1/AOD	lowpu
/HINPhoton/Run2015C_25ns-16Dec2015-v1/AOD	lowpu
/HINPFJetsOther/Run2015C_25ns-16Dec2015-v1/AOD	lowpu
/HINMuon/Run2015C_25ns-16Dec2015-v1/AOD	lowpu
/HINCaloJetsOther/Run2015C_25ns-16Dec2015-v1/AOD	lowpu
/HINCaloJet40/Run2015C_25ns-16Dec2015-v1/AOD	lowpu
/FSQJets3/Run2015C_25ns-16Dec2015-v1/AOD	lowpu
/FSQJets2/Run2015C_25ns-16Dec2015-v1/AOD	lowpu
/FSQJets1/Run2015C_25ns-16Dec2015-v1/AOD	lowpu
/EmptyBX/Run2015C_25ns-16Dec2015-v1/AOD	lowpu
/EGMLowPU/Run2015C_25ns-16Dec2015-v1/AOD	lowpu

Runs in different datasets, in the table above
Main physics runs ("physics"):
254914
254907
254906
254905
254879
254852
254790
254232
254231
254229
254227
or "physics + lowpu?" * : runs also in "physics" above, - : also in lowpu
255031 -
255029 -
255019 -
255003 -
254993 -
254989 -
254987 -
254986 -
254914 *
254907 *
254906 *
254905 *
254879 *
254852 *
254790 *
254232 *
254231 *
254229 *
254227 *
or "7 of 11 phys, all low pu, 3 others" (7 of 11 physics runs, all low pu, 3 other runs)
254987 -
254986 -
254980
254914 *
254907 *
254906 *
254905 *
254879 *
254852 *
254790 *
255003 -
255019 -
255031 -
255029 -
254993 -
254992
254989 -
254991
or "low pu"
255031
255029
255019
255003
254993
254989
254987
254986
or "5 of 8 lowpu runs"
255031
255029
255019
255003
254993
or "8 of 11 physics runs"
254914 *
254907 *
254906 *
254905 *
254879 *
254852 *
254790 *

[katilp]

The good runs, see https://twiki.cern.ch/twiki/bin/view/CMS/TWikiLUM#SummaryTable
in there: Recorded lumi, golden JSON:
2015:
brilcalc lumi -u /fb --normtag /cvmfs/cms-bril.cern.ch/cms-lumi-pog/Normtags/normtag_PHYSICS.json -i /afs/cern.ch/cms/CAF/CMSCOMM/COMM_DQM/certification/Collisions15/13TeV/Reprocessing/Cert_13TeV_16Dec2015ReReco_Collisions15_25ns_JSON_v2.txt

https://cms-service-dqm.web.cern.ch/cms-service-dqm/CAF/certification/Collisions15/13TeV/Reprocessing/Cert_13TeV_16Dec2015ReReco_Collisions15_25ns_JSON.txt

in certified, out of the runs above

"254231": [[1, 24]], "254232": [[1, 81]], "254790": [[90, 90], [93, 630], [633, 697], [701, 715], [719, 784]], "254852": [[47, 94]], "254879": [[52, 52], [54, 140]], "254906": [[1, 75]], "254907": [[1, 52]], "254914": [[32, 32], [34, 78]],

NB. RunC contains only:

brilcalc lumi -c web -u /fb --normtag /cvmfs/cms-bril.cern.ch/cms-lumi-pog/Normtags/normtag_PHYSICS.json -i 2015RunCjson.txt 
#Data tag : 19v3 , Norm tag: composite
+-------------+-------------------+-----+------+----------------+---------------+
| run:fill    | time              | nls | ncms | delivered(/fb) | recorded(/fb) |
+-------------+-------------------+-----+------+----------------+---------------+
| 254231:4201 | 08/13/15 05:14:40 | 24  | 24   | 0.000032277    | 0.000031778   |
| 254232:4201 | 08/13/15 05:43:48 | 81  | 81   | 0.000107319    | 0.000105717   |
| 254790:4243 | 08/21/15 05:24:04 | 685 | 685  | 0.011304163    | 0.011038615   |
| 254852:4249 | 08/22/15 13:46:23 | 48  | 48   | 0.000935000    | 0.000875588   |
| 254879:4254 | 08/23/15 03:34:41 | 88  | 88   | 0.001846669    | 0.001751712   |
| 254906:4256 | 08/23/15 16:23:48 | 75  | 75   | 0.001556050    | 0.001524510   |
| 254907:4256 | 08/23/15 16:55:45 | 52  | 52   | 0.001063106    | 0.001043145   |
| 254914:4257 | 08/23/15 21:02:20 | 46  | 46   | 0.000967988    | 0.000899316   |
+-------------+-------------------+-----+------+----------------+---------------+
#Summary: 
+-------+------+------+------+-------------------+------------------+
| nfill | nrun | nls  | ncms | totdelivered(/fb) | totrecorded(/fb) |
+-------+------+------+------+-------------------+------------------+
| 6     | 8    | 1099 | 1099 | 0.017812572       | 0.017270380      |
+-------+------+------+------+-------------------+------------------+

out of total: 2.258 /fb recorded...

RunB is not in certified lumi, all the rest is in RunD
(runs 256630-269627 e.g. for MET Run2015D )

RunD is

#Summary: 
+-------+------+-------+-------+-------------------+------------------+
| nfill | nrun | nls   | ncms  | totdelivered(/fb) | totrecorded(/fb) |
+-------+------+-------+-------+-------------------+------------------+
| 41    | 108  | 32113 | 32113 | 2.318214120       | 2.240795445      |
+-------+------+-------+-------+-------------------+------------------+

[katilp]

superseded by #70