Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

CMS: 2015 collision datasets - which datasets from RunD #70

Closed
2 tasks done
katilp opened this issue Jan 7, 2020 · 3 comments · Fixed by #122
Closed
2 tasks done

CMS: 2015 collision datasets - which datasets from RunD #70

katilp opened this issue Jan 7, 2020 · 3 comments · Fixed by #122
Assignees
@katilp
Labels
Type: discussion Further information is requested
Projects
CMS-2015-Open-Data-Release

Comments

@katilp
Copy link
Member

katilp commented Jan 7, 2020 •
edited
Loading

(from #65)
Which datasets and which part from RunD:
@katilp katilp added the Type: discussion Further information is requested label Jan 7, 2020
@katilp katilp self-assigned this Jan 7, 2020
This was referenced Jan 7, 2020
Closed
Closed
@katilp
Copy link
Member Author

katilp commented Jan 7, 2020 •
edited
Loading

https://cmsweb.cern.ch/das/request?view=plain&limit=50&instance=prod%2Fglobal&input=dataset%3D%2F*%2FRun2015D-16Dec2015-*%2FAOD

Dataset Runs
/Tau/Run2015D-16Dec2015-v1/AOD physics
/SinglePhoton/Run2015D-16Dec2015-v1/AOD physics
/SingleMuon/Run2015D-16Dec2015-v1/AOD physics
/SingleElectron/Run2015D-08Jun2016-v1/AOD physics
/MuonEG/Run2015D-16Dec2015-v1/AOD physics
/MuOnia/Run2015D-16Dec2015-v1/AOD physics
/MET/Run2015D-16Dec2015-v1/AOD physics
/JetHT/Run2015D-16Dec2015-v1/AOD physics
/HTMHT/Run2015D-16Dec2015-v1/AOD physics
/DoubleMuonLowMass/Run2015D-16Dec2015-v1/AOD physics
/DoubleMuon/Run2015D-16Dec2015-v1/AOD physics
/DisplacedJet/Run2015D-16Dec2015-v1/AOD physics
/Charmonium/Run2015D-16Dec2015-v1/AOD physics
/BTagMu/Run2015D-16Dec2015-v1/AOD physics
/BTagCSV/Run2015D-16Dec2015-v1/AOD physics
/DoubleEG/Run2015D-08Jun2016-v1/AOD 167 runs
/Commissioning/Run2015D-16Dec2015-v1/AOD 167 runs
/ZeroBias/Run2015D-16Dec2015-v1/AOD 167 runs
/NoBPTX/Run2015D-16Dec2015-v1/AOD 167 runs
/HcalNZS/Run2015D-16Dec2015-v1/AOD 167 runs
/HcalHPDNoise/Run2015D-16Dec2015-v1/AOD 167 runs
/HLTPhysics/Run2015D-16Dec2015-v1/AOD 167 runs
/HighMultiplicity/Run2015D-16Dec2015-v1/AOD 27 runs
/ToTOTEM/Run2015D-16Dec2015-v1/AOD 27 runs
/ToTOTEM_DoubleJet32_3/Run2015D-16Dec2015-v1/AOD 27 runs
/ToTOTEM_DoubleJet32_2/Run2015D-16Dec2015-v1/AOD 27 runs
/ToTOTEM_DoubleJet32_1/Run2015D-16Dec2015-v1/AOD 27 runs
/ToTOTEM_DoubleJet32_0/Run2015D-16Dec2015-v1/AOD 27 runs
/TOTEM_romanPotsTTBB_7/Run2015D-16Dec2015-v1/AOD 27 runs
/TOTEM_romanPotsTTBB_6/Run2015D-16Dec2015-v1/AOD 27 runs
/TOTEM_romanPotsTTBB_5/Run2015D-16Dec2015-v1/AOD 27 runs
/TOTEM_romanPotsTTBB_4/Run2015D-16Dec2015-v1/AOD 27 runs
/TOTEM_romanPotsTTBB_3/Run2015D-16Dec2015-v1/AOD 27 runs
/TOTEM_romanPotsTTBB_2/Run2015D-16Dec2015-v1/AOD 27 runs
/TOTEM_romanPotsTTBB_1/Run2015D-16Dec2015-v1/AOD 27 runs
/TOTEM_romanPotsTTBB_0/Run2015D-16Dec2015-v1/AOD 27 runs
/TOTEM_romanPots2_7/Run2015D-16Dec2015-v1/AOD 27 runs
/TOTEM_romanPots2_6/Run2015D-16Dec2015-v2/AOD 27 runs
/TOTEM_romanPots2_5/Run2015D-16Dec2015-v1/AOD 27 runs
/TOTEM_romanPots2_4/Run2015D-16Dec2015-v1/AOD 27 runs
/TOTEM_romanPots2_3/Run2015D-16Dec2015-v1/AOD 27 runs
/TOTEM_romanPots2_2/Run2015D-16Dec2015-v1/AOD 27 runs
/TOTEM_romanPots2_1/Run2015D-16Dec2015-v1/AOD 27 runs
/TOTEM_romanPots2_0/Run2015D-16Dec2015-v1/AOD 27 runs
/TOTEM_romanPots1/Run2015D-16Dec2015-v1/AOD 27 runs
/TOTEM_minBias/Run2015D-16Dec2015-v1/AOD 27 runs
/L1MinimumBiasHF8/Run2015D-16Dec2015-v1/AOD 27 runs
/L1MinimumBiasHF7/Run2015D-16Dec2015-v1/AOD 27 runs
/L1MinimumBiasHF6/Run2015D-16Dec2015-v1/AOD 27 runs
/L1MinimumBiasHF5/Run2015D-16Dec2015-v1/AOD 27 runs
/L1MinimumBiasHF4/Run2015D-16Dec2015-v1/AOD 27 runs
/L1MinimumBiasHF3/Run2015D-16Dec2015-v1/AOD 27 runs
/L1MinimumBiasHF2/Run2015D-16Dec2015-v1/AOD 27 runs
/L1MinimumBiasHF1/Run2015D-16Dec2015-v1/AOD 27 runs
/L1MinimumBias/Run2015D-16Dec2015-v1/AOD 27 runs
/HINPhoton/Run2015D-16Dec2015-v1/AOD 27 runs
/HINPFJetsOther/Run2015D-16Dec2015-v1/AOD 27 runs
/HINMuon_HFveto/Run2015D-16Dec2015-v1/AOD 27 runs
/HINMuon/Run2015D-16Dec2015-v1/AOD 27 runs
/HINCaloJetsOther/Run2015D-16Dec2015-v1/AOD 27 runs
/HINCaloJet40/Run2015D-16Dec2015-v1/AOD 27 runs
/FullTrack/Run2015D-16Dec2015-v1/AOD 27 runs
/FSQJets3/Run2015D-16Dec2015-v1/AOD 27 runs
/FSQJets2/Run2015D-16Dec2015-v1/AOD 27 runs
/FSQJets1/Run2015D-16Dec2015-v1/AOD 27 runs
/EmptyBX/Run2015D-16Dec2015-v1/AOD 27 runs
/EGMLowPU/Run2015D-16Dec2015-v1/AOD 27 runs
/ZeroBias8/Run2015D-16Dec2015-v1/AOD 3 runs
/ZeroBias7/Run2015D-16Dec2015-v1/AOD 3 runs
/ZeroBias6/Run2015D-16Dec2015-v1/AOD 3 runs
/ZeroBias5/Run2015D-16Dec2015-v1/AOD 3 runs
/ZeroBias4/Run2015D-16Dec2015-v1/AOD 11 runs
/ZeroBias3/Run2015D-16Dec2015-v1/AOD 11 runs
/ZeroBias2/Run2015D-16Dec2015-v1/AOD 11 runs
/ZeroBias1/Run2015D-16Dec2015-v1/AOD 11 runs
/ParkingMonitor/Run2015D-16Dec2015-v1/AOD 47 runs
/HLTPhysics4/Run2015D-16Dec2015-v1/AOD 8 runs
/HLTPhysics3/Run2015D-16Dec2015-v1/AOD 8 runs
/HLTPhysics2/Run2015D-16Dec2015-v1/AOD 8 runs
/HLTPhysics1/Run2015D-16Dec2015-v1/AOD 8 runs

physics:
140 runs
Minimum: 256630
Maximum: 260627

27 runs (not included in 140 physics)
Minimum: 259152
Maximum: 259431

167 runs (including physics + 27 above)
Minimum: 256630
Maximum: 260627

ZB: 11 runs (included in physics)
Minimum: 256801
Maximum: 260627
or 3 runs (not included in physics):
Minimum: 257725
Maximum: 257734

ParkingMonitor 47 runs
Minimum: 256630
Maximum: 257823

8 runs (included in physics):
Minimum: 256801
Maximum: 260627

@katilp
Copy link
Member Author

katilp commented Jan 7, 2020

The good runs, see https://twiki.cern.ch/twiki/bin/view/CMS/TWikiLUM#SummaryTable
in there: Recorded lumi, golden JSON:
2015:
brilcalc lumi -u /fb --normtag /cvmfs/cms-bril.cern.ch/cms-lumi-pog/Normtags/normtag_PHYSICS.json -i /afs/cern.ch/cms/CAF/CMSCOMM/COMM_DQM/certification/Collisions15/13TeV/Reprocessing/Cert_13TeV_16Dec2015ReReco_Collisions15_25ns_JSON_v2.txt

https://cms-service-dqm.web.cern.ch/cms-service-dqm/CAF/certification/Collisions15/13TeV/Reprocessing/Cert_13TeV_16Dec2015ReReco_Collisions15_25ns_JSON.txt

in certified, out of the runs above

"256630": [[5, 26]], "256673": [[55, 56]], "256674": [[1, 2]], "256675": [[1, 106], [111, 164]], "256676": [[1, 160], [162, 208]], "256677": [[1, 291], [293, 390], [392, 397], [400, 455], [457, 482]], "256801": [[73, 263]], "256842": [[131, 132]], "256843": [[1, 204], [207, 284], [286, 378], [380, 461], [463, 587], [598, 627], [630, 661], [1001, 1034], [1036, 1081], [1083, 1191], [1193, 1193], [1195, 1329], [1331, 1332]], "256866": [[34, 47]], "256867": [[1, 16], [19, 94]], "256868": [[5, 33], [35, 200], [202, 492]], "256869": [[1, 34]], "256926": [[35, 50], [53, 62], [64, 65]], "256941": [[1, 17], [19, 29], [103, 105], [107, 126], [129, 129], [131, 168], [170, 170], [175, 290], [293, 294]], "257461": [[44, 95]], "257531": [[5, 45], [50, 143]], "257599": [[42, 118]], "257613": [[14, 1307]], "257614": [[1, 16]], "257645": [[37, 73], [75, 1096]], "257682": [[66, 366]], "257722": [[1, 19]], "257723": [[1, 1], [3, 108], [114, 148]], "257735": [[1, 15]], "257751": [[1, 463]], "257804": [[1, 17]], "257805": [[1, 249]], "257816": [[1, 385]], "257819": [[1, 248]], "257968": [[69, 326]], "257969": [[1, 634]], "258129": [[30, 124]], "258136": [[1, 60]], "258157": [[1, 56]], "258158": [[1, 1088], [1091, 1786]], "258159": [[1, 501]], "258177": [[1, 342], [347, 724], [755, 1939]], "258211": [[43, 129]], "258213": [[1, 165]], "258214": [[1, 217]], "258215": [[1, 6]], "258287": [[45, 144], [148, 227]], "258403": [[1, 251]], "258425": [[3, 136]], "258426": [[1, 10]], "258427": [[1, 107]], "258428": [[1, 159]], "258432": [[1, 4]], "258434": [[1, 453]], "258440": [[1, 442], [444, 732]], "258444": [[1, 37]], "258445": [[1, 302]], "258446": [[1, 142]], "258448": [[2, 100], [102, 731]], "258655": [[60, 68]], "258656": [[1, 334]], "258694": [[23, 199]], "258702": [[52, 402]], "258703": [[1, 389]], "258705": [[1, 100]], "258706": [[1, 733]], "258712": [[1, 524]], "258713": [[1, 161]], "258714": [[1, 67]], "258741": [[22, 72]], "258742": [[2, 693]], "258745": [[1, 260]], "258749": [[1, 204], [220, 604]], "258750": [[1, 197]], "259626": [[83, 111], [113, 167], [169, 437]], "259637": [[1, 72], [75, 221]], "259681": [[64, 98]], "259683": [[5, 19], [21, 23], [25, 94]], "259685": [[1, 209], [212, 240], [242, 290], [292, 445], [447, 538], [540, 544], [546, 630]], "259686": [[1, 43], [45, 47], [49, 100], [102, 245], [248, 341]], "259721": [[73, 99], [102, 408]], "259809": [[53, 222]], "259810": [[1, 113], [116, 116]], "259811": [[1, 47], [50, 91]], "259813": [[1, 10]], "259817": [[1, 5]], "259818": [[1, 160]], "259820": [[1, 32], [36, 161]], "259821": [[1, 75], [78, 212]], "259822": [[1, 14], [17, 464]], "259861": [[1, 34], [36, 38], [40, 66], [69, 156]], "259862": [[1, 13], [16, 532]], "259884": [[73, 143], [147, 155]], "259890": [[1, 34], [37, 109]], "259891": [[1, 108]], "260373": [[47, 370], [373, 408]], "260424": [[3, 12], [15, 266], [269, 672]], "260425": [[1, 18], [21, 55], [58, 256]], "260426": [[1, 52], [55, 296], [298, 307], [310, 504]], "260427": [[1, 285]], "260431": [[1, 447]], "260532": [[3, 8], [10, 456], [458, 746]], "260533": [[1, 14]], "260534": [[1, 375]], "260536": [[9, 37], [45, 60], [62, 193]], "260538": [[1, 284]], "260541": [[1, 24]], "260575": [[2, 21]], "260576": [[2, 88], [90, 465]], "260577": [[1, 76]], "260593": [[65, 401]], "260627": [[97, 611], [613, 757], [760, 788], [791, 1051], [1054, 1530], [1533, 1845]]

NB. RunC contains only:

#Summary: 
+-------+------+------+------+-------------------+------------------+
| nfill | nrun | nls  | ncms | totdelivered(/fb) | totrecorded(/fb) |
+-------+------+------+------+-------------------+------------------+
| 6     | 8    | 1099 | 1099 | 0.017812572       | 0.017270380      |
+-------+------+------+------+-------------------+------------------+

out of total: 2.258 /fb recorded...

RunB is not in certified lumi, all the rest is in RunD:

#Summary: 
+-------+------+-------+-------+-------------------+------------------+
| nfill | nrun | nls   | ncms  | totdelivered(/fb) | totrecorded(/fb) |
+-------+------+-------+-------+-------------------+------------------+
| 41    | 108  | 32113 | 32113 | 2.318214120       | 2.240795445      |
+-------+------+-------+-------+-------------------+------------------+

@katilp katilp mentioned this issue Jan 18, 2020
Closed
@katilp
Copy link
Member Author

katilp commented Jan 24, 2020 •
edited
Loading

The list agreed with the PC and to be proposed for MB and CB is:

/Tau/Run2015D-16Dec2015-v1/AOD
/SinglePhoton/Run2015D-16Dec2015-v1/AOD
/SingleMuon/Run2015D-16Dec2015-v1/AOD
/SingleElectron/Run2015D-08Jun2016-v1/AOD
/MuonEG/Run2015D-16Dec2015-v1/AOD
/MuOnia/Run2015D-16Dec2015-v1/AOD
/MET/Run2015D-16Dec2015-v1/AOD
/JetHT/Run2015D-16Dec2015-v1/AOD
/HTMHT/Run2015D-16Dec2015-v1/AOD
/DoubleMuonLowMass/Run2015D-16Dec2015-v1/AOD
/DoubleMuon/Run2015D-16Dec2015-v1/AOD
/DisplacedJet/Run2015D-16Dec2015-v1/AOD
/Charmonium/Run2015D-16Dec2015-v1/AOD
/BTagMu/Run2015D-16Dec2015-v1/AOD
/BTagCSV/Run2015D-16Dec2015-v1/AOD
/DoubleEG/Run2015D-08Jun2016-v1/AOD
/ZeroBias/Run2015D-16Dec2015-v1/AOD

117.1 TB in total
and the corresponding MiniAOD (estimated 15 TB)

tiborsimko added a commit to tiborsimko/data-curation that referenced this issue Dec 16, 2021
@tiborsimko
cms-2015-collision-datasets: initial release
240eb1b 
Adds all scripts to gather information from EOS and DAS about datasets
and HLT and RECO configuration files and then to create corresponding
records.  Closes cernopendata#70.

Filters output to yield only pp-related data, not PbPb-related data.
These are getting reserved record IDs and can be rerun later when
PbPb-data is going to be released.
tiborsimko added a commit to tiborsimko/data-curation that referenced this issue Dec 17, 2021
@tiborsimko
cms-2015-collision-datasets: initial release
f9a8fa5 
Adds all scripts to gather information from EOS and DAS about datasets
and HLT and RECO configuration files and then to create corresponding
records.  Closes cernopendata#70.

Filters output to yield only pp-related data, not PbPb-related data.
These are getting reserved record IDs and can be rerun later when
PbPb-data is going to be released.
@tiborsimko tiborsimko mentioned this issue Dec 19, 2021
Merged
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@katilp katilp

Labels
Type: discussion Further information is requested
Projects
CMS-2015-Open-Data-Release
Done
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

cms-2015-collision-datasets: initial release tiborsimko/data-curation
1 participant
@katilp