WMCore 2.0.3 central services production release
This release brings in many awesome features, such as: some initial support to IAM tokens; full support to workflows with growing input dataset; new policy for Release Validation output data placement, with a distinction of pre-releases from the other samples.
It also includes a few bug fixes required for the DBSServer migration to the Go implementation. Finally, it comes with many enhancements to the code and documentation.
Release date: 7 April 2022.
Changes since release: 2.0.2.
Central services
Software stack
- Bring dbs3-client version to 4.0.8 (Alan Malta Rodrigues) #11138
- Removed pep8; added pycodestyle 2.8.0; updated pylint to 2.13.5 (Alan Malta Rodrigues) cms-sw/cmsdist#7846
Features and/or feature changes
- Add bin and dependencies to wmcore PyPI package (Erik Gough) #11103
- Remove block open logic from DBS3Reader and WorkQueue (Alan Malta Rodrigues) #11123
- Properly handle OpenRunningTimeout in WorkQueue (Alan Malta Rodrigues) #11119 #11135
- Initial script to create IAM token (Valentin Kuznetsov) #11093 #11134
- speed up listDatasetFileDetails API (Valentin Kuznetsov) #11099
- [MSTransferor] Lock the whole input container for growing workflows (Alan Malta Rodrigues) #11141
- [MSOutput] Apply different rule lifetime for RelVal pre-release samples (Alan Malta Rodrigues) #11139
- Add support for IAM token in the underlying pycurl_manager module (Valentin Kuznetsov) #10939
- Add support to OpenRunningTimeout for TaskChain/StepChain (Alan Malta Rodrigues) #11135
Bug Fixes
- Update ReqMgr2 CP thread to properly deal with aborted/force-complete workflows (Alan Malta Rodrigues) #11113
Enhancements
- move ckey/cert functions to Utils.CertTools (Valentin Kuznetsov) #11101
- Remove no longer needed code in the StatusChangeTasks ReqMgr2 thread (Alan Malta Rodrigues) #11095
- Create script to cancel GQEs (Alan Malta Rodrigues) #11113
- Switch from pep8 to pycodestyle (Erik Gough) #11128
WMAgent
Features and/or feature changes
- When ScramArch is empty str/list/None, return any as required_os (Alan Malta Rodrigues) #11083
- If job requires rhel8 container, use slc7 python libraries (Alan Malta Rodrigues) #11077
- Support adding diskless resources into the database (Alan Malta Rodrigues) #11097
- Remove PFNs from a final document we send to WMArchive (Valentin Kuznetsov) #10998
- change fallback for missing system xrootd-client (Dirk Hufnagel) #11117
- Remove support for Unpacking user tarballs. No longer used by CRAB. (khurtado) #11114
- Enforce dataset_lifetime column to be integer and not null (Alan Malta Rodrigues) #11115
- speed up listDatasetFileDetails API (Valentin Kuznetsov) #11099
- Add support for IAM token in the underlying pycurl_manager module (Valentin Kuznetsov) #10939
Bug Fixes
- Assign the correct activity for Tape_Test RSEs (Jhonatan Amado) #11067
- [Tier0] Check CMSSW version before getting sim-datatier map (germanfgv) #11110
Enhancements
- Enhance logic to map ScramArch to OS (Alan Malta Rodrigues) #11088
- [PY2] Remove cPickle support (Erik Gough) #11096
- Update wmagent deploy script to add opportunistic resources one by one (Alan Malta Rodrigues) #11097
- Minor test json template updates (Alan Malta Rodrigues) #10864
- Add T3_US_Lancium. (Todor Ivanov) #11126
- Add buildAllDep option && Fix package verstion estimation for ParseSpecCmsswdist. (Todor Ivanov) #11132