Skip to content

WMCore 2.0.3 central services production release

Compare
Choose a tag to compare
@amaltaro amaltaro released this 18 May 15:01
· 893 commits to master since this release

This release brings in many awesome features, such as: some initial support to IAM tokens; full support to workflows with growing input dataset; new policy for Release Validation output data placement, with a distinction of pre-releases from the other samples.
It also includes a few bug fixes required for the DBSServer migration to the Go implementation. Finally, it comes with many enhancements to the code and documentation.

Release date: 7 April 2022.
Changes since release: 2.0.2.

Central services

Software stack

  • Bring dbs3-client version to 4.0.8 (Alan Malta Rodrigues) #11138
  • Removed pep8; added pycodestyle 2.8.0; updated pylint to 2.13.5 (Alan Malta Rodrigues) cms-sw/cmsdist#7846

Features and/or feature changes

  • Add bin and dependencies to wmcore PyPI package (Erik Gough) #11103
  • Remove block open logic from DBS3Reader and WorkQueue (Alan Malta Rodrigues) #11123
  • Properly handle OpenRunningTimeout in WorkQueue (Alan Malta Rodrigues) #11119 #11135
  • Initial script to create IAM token (Valentin Kuznetsov) #11093 #11134
  • speed up listDatasetFileDetails API (Valentin Kuznetsov) #11099
  • [MSTransferor] Lock the whole input container for growing workflows (Alan Malta Rodrigues) #11141
  • [MSOutput] Apply different rule lifetime for RelVal pre-release samples (Alan Malta Rodrigues) #11139
  • Add support for IAM token in the underlying pycurl_manager module (Valentin Kuznetsov) #10939
  • Add support to OpenRunningTimeout for TaskChain/StepChain (Alan Malta Rodrigues) #11135

Bug Fixes

  • Update ReqMgr2 CP thread to properly deal with aborted/force-complete workflows (Alan Malta Rodrigues) #11113

Enhancements

  • move ckey/cert functions to Utils.CertTools (Valentin Kuznetsov) #11101
  • Remove no longer needed code in the StatusChangeTasks ReqMgr2 thread (Alan Malta Rodrigues) #11095
  • Create script to cancel GQEs (Alan Malta Rodrigues) #11113
  • Switch from pep8 to pycodestyle (Erik Gough) #11128

WMAgent

Features and/or feature changes

  • When ScramArch is empty str/list/None, return any as required_os (Alan Malta Rodrigues) #11083
  • If job requires rhel8 container, use slc7 python libraries (Alan Malta Rodrigues) #11077
  • Support adding diskless resources into the database (Alan Malta Rodrigues) #11097
  • Remove PFNs from a final document we send to WMArchive (Valentin Kuznetsov) #10998
  • change fallback for missing system xrootd-client (Dirk Hufnagel) #11117
  • Remove support for Unpacking user tarballs. No longer used by CRAB. (khurtado) #11114
  • Enforce dataset_lifetime column to be integer and not null (Alan Malta Rodrigues) #11115
  • speed up listDatasetFileDetails API (Valentin Kuznetsov) #11099
  • Add support for IAM token in the underlying pycurl_manager module (Valentin Kuznetsov) #10939

Bug Fixes

  • Assign the correct activity for Tape_Test RSEs (Jhonatan Amado) #11067
  • [Tier0] Check CMSSW version before getting sim-datatier map (germanfgv) #11110

Enhancements

  • Enhance logic to map ScramArch to OS (Alan Malta Rodrigues) #11088
  • [PY2] Remove cPickle support (Erik Gough) #11096
  • Update wmagent deploy script to add opportunistic resources one by one (Alan Malta Rodrigues) #11097
  • Minor test json template updates (Alan Malta Rodrigues) #10864
  • Add T3_US_Lancium. (Todor Ivanov) #11126
  • Add buildAllDep option && Fix package verstion estimation for ParseSpecCmsswdist. (Todor Ivanov) #11132