WMCore 2.3.1 production central services release
This release brings in full functionality for partial pileup data placement, note however that it requires further developments and deployment of a new WMAgent release before it can be adopted in operations.
We have also refactored pileup data location across WM services, now relying solely on MSPileup. In addition, DQMHarvest workflows will not have a full container input data placement, followed by the relevant changes in the WorkQueue Dataset start policy.
On the WMAgent side, the system now support workflows requesting EL9 Operating System (and their variations). Default ScramArch has been removed for Cleanup jobs, which now auto-discover the OS+Arch and bootstrap the code accordingly.
Release date: 21 Feb 2024.
Changes since release: 2.2.6.
Central services
Software stack
Features and/or feature changes
- Implement partialPileupTask task logic (Valentin Kuznetsov) #11807
- Python (standard library) implementation of update pileup object script (Valentin Kuznetsov) #11872
- Created MSPileupUtils module and modified GQ CherryPy thread to use MSPileup instead of Rucio (Dennis Lee) #11870
- New function to get dataset locations from MSPileup and its implementation in StartPolicyInterface #11620 (Andrea Piccinelli) #11879
- Make container level data placement for DQMHarvest; update Start.Policy.Dataset to container too (Alan Malta Rodrigues) #11894
Bug Fixes
- Dont cross check location when data is reported without location (Alan Malta Rodrigues) #11878
- Parse MSPileup filter as string if only listing one (Dennis Lee) #11886
- Correctly pass dbsUrl to the locationsFromMSPileup method (Todor Ivanov) #11906
- Fix variable name in log record; complement to #11879 (Alan Malta Rodrigues) #11908
Enhancements
- providing a checklist for code review (Alan Malta Rodrigues)
WMAgent
Features and/or feature changes
- Created MSPileupUtils module and modified GQ CherryPy thread to use MSPileup instead of Rucio (Dennis Lee) #11870
- New function to get dataset locations from MSPileup and its implementation in StartPolicyInterface #11620 (Andrea Piccinelli) #11879
- add support for rhel9. Fix #11985 (Stefano Belforte) #11897
Bug Fixes
- Discover the singularity container OS at runtime. (Todor Ivanov) #11896
Enhancements
- Increase JobSubmitter queue size from 50k to 100k (Alan Malta Rodrigues) #11889