Releases: dmwm/WMCore
Releases · dmwm/WMCore
WMCore 1.5.7 central services and WMAgent production release
This release brings in the latest dbs3-client version, compatible with both the Python and Golang server implementations.
The software stack also had a major MariaDB upgrade (from 10.1.21 to 10.6.5).
It also has a few bug fixes and improvements for central services and WMAgent.
Release date: 18 January 2021.
Changes since release: 1.5.6.
Central services
Software stack
- Upgrade MariaDB spec from 10.1.21 to 10.6.5 (Alan Malta Rodrigues) #7205
- Update pylint version required from 2.6.0 to 2.7.0 (Alan Malta Rodrigues) #10913
- Bump dbs3-client to 4.0.5 (Alan Malta Rodrigues) #10931
- Bump dbs3-pycurl to 3.17.7 (Alan Malta Rodrigues) #10931
Features and/or feature changes
- Remove trailing slash from DBS URL (Alan Malta Rodrigues) #10930
Bug Fixes
- [MSTransferor] Fix logic which drops input blocks to be transferred (Alan Malta Rodrigues) #10928
- [MSUnmerged] REST APIs to fetch RSE data from MongoDB. (Todor Ivanov) #10923
Enhancements
- fix DbsUrl in test modules and templates (Alan Malta Rodrigues) #10930
WMAgent
Features and/or feature changes
- Remove trailing slash from DBS URL (Alan Malta Rodrigues) #10930
- Stop using password for MariaDB localhost users (Alan Malta Rodrigues) #10932
- Create the MariaDB wmcore unittest database with the current unix user (Alan Malta Rodrigues) #10934
Bug Fixes
- Properly update workqueue elements from JobUpdater (Alan Malta Rodrigues) #10944
Enhancements
- Update job priority only for processing and production task types, rather than every single subtask name, to reduce condor_qedit load. (Kenyi Hurtado) #10812
Python3 related changes
WMCore 1.5.6 central services production release
First version of MSUnmerged with a MongoDB database backend.
Release date: 10 November 2021.
Changes since release: 1.5.5.
Central services
Software stack
- Update CMSCouchapp version for python3 stack (Alan Malta Rodrigues) #10910
Features and/or feature changes
- [MSUnmerged] Initial integration of MongoDB. (Todor Ivanov) #10895
- [MSUnmerged] Add replicaset opotion to the MongoDB wrapper. (Todor Ivanov) #10908
- [MSUnmerged] Adapt MSUnmerged to sync RSE data with MongoDB properly (Todor Ivanov) #10906
Bug Fixes
Enhancements
- Update request state diagram with archival done by MS (Alan Malta Rodrigues) #10899
WMAgent
Features and/or feature changes
- Use siteLocalConfig to get LogCollect stage out params (germanfgv) #10905
- Add --deep option to getReplicaInfoForBlocks. Add slicing to deleteBlocks (germanfgv) #10902
Bug Fixes
Enhancements
Python3 related changes
- Fix path for Py2/Py3 WMAgent logs (Alan Malta Rodrigues) #10897
WMCore 1.5.5 central services production release
This release no longer ships any of the PhEDEx libraries. The running-open and running-close statuses have been slightly redesigned.
Last but not least, some important bug fixes and enhancements have been made.
Release date: 10 November 2021.
Changes since release: 1.5.4.
Central services
Software stack
- Update dbs3-client to 3.17.6 and dbs3-pycurl 3.17.4
- Update python3 pip to 20.3.3 and setuptools to 51.3.3
Features and/or feature changes
- add two new CMSSW exit code: 8034 and 8501 (Stefano Belforte) #10850
- Remove PhEDEx library and any other use of PhEDEx (Alan Malta Rodrigues) #10856
- [MSTransferor] Remove unused Unified/MSTransferor code (Alan Malta Rodrigues) #10876
- Add validation to the SubRequestType parameter (Alan Malta Rodrigues) #10890
- Refactored conditions for running-open/running-closed workflow statuses (Alan Malta Rodrigues) #10693
- Temporary fix for the StatusChangeTasks ReqMgr2 thread (Alan Malta Rodrigues) #10693
Bug Fixes
- [MSUnmerged] Remove check of RSE dump root_failed attr in MSUnmerged (Alan Malta Rodrigues) #10894
Enhancements
- Fix python version in subprocess call for inject-test-wfs (Alan Malta Rodrigues) #10847
WMAgent
Features and/or feature changes
- Set request_GPUs classad according to RequiresGPU (Alan Malta Rodrigues) #10849
- Update Rucio Int url (Alan Malta Rodrigues) #10855
- Support different architectures during job submission and runtime (Alan Malta Rodrigues) #10853
Bug Fixes
- Skip ErrorHandler cycle if agent configuration fails to be retrieved - take2 (Alan Malta Rodrigues) #10852
- Remove leading ../../ from logArchive tarballs (Alan Malta Rodrigues) #10868
- Check whether WMStep object has gpu attribute (Alan Malta Rodrigues) #10866
- Use the right COMP scramArch for PowerPC workflows (Alan Malta Rodrigues) #10871
Enhancements
- Updating workflow json templates; adding working PY3 templates (Alan Malta Rodrigues) #10761
- Update wmagent-deploy script to deploy Py3 WMAgent by default; update to cycle 1.5.4 (Alan Malta Rodrigues) #10859
- update campaigns used in our test setup (Alan Malta Rodrigues) #10859
Python3 related changes
WMCore 1.5.4.patch2 WMAgent production release
This is the latest stable WMAgent branch, which already includes to patch releases on top of it.
The highlight of this release is the support to GPU and PowerPC workflows/jobs. In terms of the software stack,
it brings in a new oracle client version 19, and HTCondor python bindings version 9.2.0.
Release date: 12 October 2021.
Changes since release: 1.5.2.
WMAgent
Software stack
- Oracle client version 19.11
- Update Python3 requirements list with Sphinx and Jinja2 #10794
- Update py3-dbs3-client/dbs3-pycurl to 3.16.2001 cms-sw/cmsdist#7384
- New HTCondor specs from PyPi; update version to 9.2.0 cms-sw/cmsdist#7383
Features and/or feature changes
- Support different architectures during job submission and runtime (Alan Malta Rodrigues) #10863
- Update Rucio Int url (Alan Malta Rodrigues) #10855
- Add two new CMSSW exit code: 8034 and 8501 (Stefano Belforte) #10850
- Set request_GPUs classad according to RequiresGPU (Alan Malta Rodrigues) #10849
- Propagate GPU requirements to job creation and submission (Alan Malta Rodrigues) #10811
- Provide request type via job classad (Alan Malta Rodrigues) #10821
- Permanently stop staging out log tarball to CASTOR (Alan Malta Rodrigues) #10712
- CouchDB 3: Add new Error HTTP Status Codes to CMSCouch.py (phenomax) #10785
Bug Fixes
- JobAccountant workaround for StepChain jobs with duplicate files - wmagent branch (Alan Malta Rodrigues) #10863
- [ReqMgr2/Tier0] PhysicsSkim issue (Jhonatan Amado) #10809
- Skip ErrorHandler cycle if agent configuration fails to be retrieved (Alan Malta Rodrigues) #10817 #10852
- Fix missing parenthesis during PSet tweak (Kenyi Hurtado) #10771
Enhancements
- Updating workflow json templates; adding working PY3 templates (Alan Malta Rodrigues) #10761
- Fix python version in subprocess call for inject-test-wfs (Alan Malta Rodrigues) #10847
- Define pylint message template in the pylintrc file (Alan Malta Rodrigues) #10776
Python3 related changes
- [py2py3] modernize WMCore_t/REST_t/Api_t.py (Dario Mapelli) #10757
- #10349 - JobSubmitter_t and JobSubmitterCaching_t - test (Dario Mapelli) #10608
- #10371 check - fix JobCreator_t.py - test (Dario Mapelli) #10724
- Modernization of leftover files - src (Dario Mapelli) #10768
- RESTFormatter.to_string returns 'native str' (Dario Mapelli) #10753
WMCore 1.5.4 central services production release
Thin central production release providing mostly WMAgent-related changes.
This release brings in the ability to create and submit GPU jobs.
Release date: 5 October 2021.
Changes since release: 1.5.3.
Central services
Software stack
- Oracle client version 19.11
Features and/or feature changes
Bug Fixes
- [ReqMgr2/Tier0] PhysicsSkim issue (Jhonatan Amado) #10809
Enhancements
- Add a step to change rucio instance during deployment. (Todor Ivanov) #10803
WMAgent
Features and/or feature changes
- Propagate GPU requirements to job creation and submission (Alan Malta Rodrigues) #10811
- Provide request type via job classad (Alan Malta Rodrigues) #10821
Bug Fixes
- Skip ErrorHandler cycle if agent configuration fails to be retrieved (Alan Malta Rodrigues) #10817
Enhancements
- Fix python version in subprocess call for inject-test-wfs (Alan Malta Rodrigues) #10847
Python3 related changes
- [py2py3] modernize WMCore_t/REST_t/Api_t.py (Dario Mapelli) #10757
WMCore 1.5.3 central services production release
This release contains many feature changes and bug fixes. It's worth highlighting that support
to GPU workflows has been introduced for ReReco and TaskChain request specs. The remaining critical
issues with the unmerged microservice have been fixed and it's now fully functional.
Last but not least, the WMCore codebase is now fully dual stack (python2 and python3).
Release date: 16 September 2021.
Changes since release: 1.5.1.
Central services
Software stack
- Update Python3 requirements list with Sphinx and Jinja2 (Alan Malta Rodrigues) #10794
Features and/or feature changes
- [MSOutput]: only produce documents for workflows not yet in the database (Alan Malta Rodrigues) #10773
- [ReqMgr2] Override factoryWorkloadConstruction in the Resubmission spec (Alan Malta Rodrigues) #10781
- [ReqMgr2] Support GPU parameters at StdBase/ReReco; validation functions implemented (Alan Malta Rodrigues) #10799
- [ReqMgr2] Add support to GPUs in TaskChain spec (Alan Malta Rodrigues) #10805
Bug Fixes
- [MSOutput] Skip inexistent containers in the Tape data placement (Alan Malta Rodrigues) #10717
- [MSUnmerged] Make rucioConMon parameter mandatory (Alan Malta Rodrigues) #10715
- [MSUnmerged] Split initial data fetching steps && Return from handled exceptions. (Todor Ivanov) #10762
- [MSTransferor] Fix undefined variable in MSTransferor (Alan Malta Rodrigues) #10769
- [ReqMgr2] Fix spec validation for Multicore/Memory/Streams/TpE (Alan Malta Rodrigues) #10781
- [ReqMgr2] Keep Resubmission spec and json data consistent (Alan Malta Rodrigues) #10789
- [ReqMgr2] Fix Multicore/EventStreams override in Resubmission of StepChains (Alan Malta Rodrigues) #10795
- [MSUnmerged] Delete file lists in slices. (Todor Ivanov) #10792
Enhancements
- Define pylint message template in the pylintrc file (Alan Malta Rodrigues) #10776
WMAgent
Features and/or feature changes
- Stop staging out log tarball to CASTOR (Alan Malta Rodrigues) #10712
- Created new job wrapper script for Python3 environment (Alan Malta Rodrigues) #10726
- CouchDB 3: Add new Error HTTP Status Codes to CMSCouch.py (phenomax) #10785
Bug Fixes
- Encode a few job classads from unicode to bytes (Alan Malta Rodrigues) #10711
- Revert CouchDB replication port forward (Alan Malta Rodrigues) #10727
- Fix issue with merge process and output labels (Merged and MergedError) (Kenyi Hurtado) #10593
- Define funcName variable in the right place (Alan Malta Rodrigues) #10744
- Decode byte string to unicode for json.dumps (Alan Malta Rodrigues) #10740
- Provide standard/unicode string to the PSet handlePileup method (Alan Malta Rodrigues) #10740
- Cast performance values to float in MathAlgos (Alan Malta Rodrigues) #10750
- Fix job priority at submission time, taking into account maxTaskPriority, as it was originally. (Kenyi Hurtado) #10760
- Fix missing parenthesis (Kenyi Hurtado) #10771
Enhancements
- Add new attribute for T0 Container rules (Jhonatan Amado) #10738
- Define cms_type=int for rucio rules created against Rucio Int (Alan Malta Rodrigues) #10756
- Convert a WorkQueueManagerCleaner log info to debug (Alan Malta Rodrigues) #10755
Python3 related changes
- #10349 - JobSubmitter_t and JobSubmitterCaching_t - test (Dario Mapelli) #10608
- Properly deal with strings location in the File module (Alan Malta Rodrigues) #10723
- #10371 check - fix JobCreator_t.py - test (Dario Mapelli) #10724
- Load workload pickle object during runtime in binary mode (Alan Malta Rodrigues) #10729
- Create job package with pickle protocol=4 for Python3 agents (Alan Malta Rodrigues) #10731
- modernize use of pickle.load/dump - src (Dario Mapelli) #10742
- modernize use of mylist.sort() in REST/Server.py (Dario Mapelli) #10743
- Implement py3 sorting for JobSplitting (Erik Gough) #10720
- Pass byte string to subprocess.stdin in Scram runtime (Alan Malta Rodrigues) #10736
- Fix Services_t/pycurlFileUpload_t and WebTools/REST_t - src (Dario Mapelli) #10650
- Modernize DQMUpload.py (Dario Mapelli) #9934
- Modernize scripts that rely on urllib (Dario Mapelli) #10754
- More job runtime places to encode pickledarguments to bytes (Alan Malta Rodrigues) #10766
- Modernization of leftover files - src (Dario Mapelli) #10768
- RESTFormatter.to_string returns 'native str' (Dario Mapelli) #10753
WMCore 1.5.2 WMAgent production release
This is the first WMAgent release with full support to python3. It also brings in a major refactoring made for the job PSet tweaking, where a new dependency on cmssw-wm-tools has been introduced, fully decoupling WMAgent python from CMSSW.
Release date: 21 August 2021.
Changes since release: 1.5.1.
Central services
Software stack
Features and/or feature changes
- Split initial data fetching steps && Return from handled exceptions. (Todor Ivanov) #10762
Bug Fixes
- MSOutput: skip inexistent containers in the Tape data placement (Alan Malta Rodrigues) #10717
- MSUnmerged: make rucioConMon parameter mandatory (Alan Malta Rodrigues) #10715
Enhancements
WMAgent
Features and/or feature changes
- Add new attribute for T0 Container rules (Jhonatan Amado) #10738
- Permanently stop staging out log tarball to CASTOR (Alan Malta Rodrigues) #10712
Bug Fixes
- Fix issue with merge process and output labels (Merged and MergedError) (Kenyi Hurtado) #10593 #10744
- Revert CouchDB replication port forward (Alan Malta Rodrigues) #10727
- Encode a few job classads from unicode to bytes (Alan Malta Rodrigues) #10711
- Fix job priority at submission time, taking into account maxTaskPriority, as it was originally. (Kenyi Hurtado) #10760
Enhancements
- Define cms_type=int for rucio rules created against Rucio Int (Alan Malta Rodrigues) #10756
- Convert a WorkQueueManagerCleaner log info to debug (Alan Malta Rodrigues) #10755
Python3 related changes
- [py2py3] modernize DQMUpload.py (Dario Mapelli) #9934
- [py2py3] fix Services_t/pycurlFileUpload_t and WebTools/REST_t - src (Dario Mapelli) #10650
- PY3: Cast performance values to float in MathAlgos (Alan Malta Rodrigues) #10750
- PY3: Pass byte string to subprocess.stdin in Scram runtime (Alan Malta Rodrigues) #10736
- PY3: Provide standard/unicode string to the PSet handlePileup method (Alan Malta Rodrigues) #10740
- PY3: Decode byte string to unicode for json.dumps (Alan Malta Rodrigues) #10740
- PY3: Implement py3 sorting for JobSplitting (Erik Gough) #10720
- [py2py3] modernize use of mylist.sort() in REST/Server.py (Dario Mapelli) #10743
- [py2py3] modernize use of pickle.load/dump - src (Dario Mapelli) #10742
- PY3: Created new job wrapper script for Python3 environment (Alan Malta Rodrigues) #10726
- PY3: Create job package with pickle protocol=4 for Python3 agents (Alan Malta Rodrigues) #10731
- PY3: Load workload pickle object during runtime in binary mode (Alan Malta Rodrigues) #10729
- [py2py3] Properly deal with strings location in the File module (Alan Malta Rodrigues) #10723
- [py2py3] modernize scripts that rely on urllib (Dario Mapelli) #10754
- [py2py3] More job runtime places to encode pickledarguments to bytes (Alan Malta Rodrigues) #10766
Important changes from the latest production WMAgent release (1.4.7)
- Many many python3 modernization changes
- DBFormatter formatDict/formatList to native string instead of bytes (Alan Malta Rodrigues) #10639
- Create workload sandbox efficiently (Alan Malta Rodrigues) #10612
- Decouple CMSSW and WMCore python versions from PSet tweak (khurtado) #10179
- Retrieve only a summary of the condor jobs in DrainStatusPoller (Alan Malta Rodrigues) #10458
- Only create Rucio connection in PileupFetcher if there is a pileup dataset (Alan Malta Rodrigues) #10470
WMCore 1.5.1 central services production release
This is the second stable Python3 release of the central services.
It also brings in a new MicroService - called MSUnmerged - to clean up orphan/leftover files from the sites unmerged area.
Last but not least, this release also brings in some relevant feature changes and bug-fixes for other microservices.
Release date: 3 August 2021.
Changes since release: 1.5.0.
Central services
Software stack
- [k8s] Manifests created for MSUnmerged: dmwm/CMSKubernetes#604 dmwm/CMSKubernetes#612 dmwm/CMSKubernetes#665 dmwm/CMSKubernetes#667 dmwm/CMSKubernetes#669 dmwm/CMSKubernetes#671 dmwm/CMSKubernetes#697
- [k8s] New cron proxy Docker container for MSUnmerged: dmwm/CMSKubernetes#672 dmwm/CMSKubernetes#682
- [k8s] New Docker image for MSUnmerged + gfal2: dmwm/CMSKubernetes#615 dmwm/CMSKubernetes#668
Features and/or feature changes
- Add RucioConMon API to WMCore.Services. (Todor Ivanov) #10640 #10689
- [MSUnmerged] Add logic for cutting the path depth as provided by RucioConMon (Todor Ivanov) #10666
- [MSUnmerged] Add lfn2pfn resolve logic. (Todor Ivanov) #10671 #10679
- [MSUnmerged] Limit PFNList entries logged (Todor Ivanov) #10685
- [MSUnmerged] Fix unnecessary traceback dumps. (Todor Ivanov) #10691
- [MSUnmerged] support detail and rse_type in the RESTful APIs (Alan Malta Rodrigues) #10700
- [MSUnmerged] Introduce include and exclude directory filters. (Todor Ivanov) #10706
- [MSOutput] Keep all relval output datatiers on disk by bypassing all MSOutput configurations (haozturk) #10669
- [MSTransferor] Provide a configurable weight value for MSTransferor Rucio rules (Alan Malta Rodrigues) #10696
Bug Fixes
- Fix object type passed to time.mktime (Alan Malta Rodrigues) #10662
- [MS] Import micro services on demand in MSManager. (Todor Ivanov) #10698
- [MSOutput] MSOutput: do not fail workflow if there are containers unknown to Rucio (Alan Malta Rodrigues) #10699
- [MS] Fix error message reported via MSUnmerged/MSRuleCleaner REST API (Alan Malta Rodrigues) #10700
Enhancements
WMAgent
Features and/or feature changes
Bug Fixes
- Fix broken variable reference in TestMonitor (Alan Malta Rodrigues) #10665
Enhancements
- Performance improvements for WorkQueueManagerCleaner thread (Alan Malta Rodrigues) #10695
Python3 related changes
WMCore 1.5.0 central services production release
This is the first Python3 release deployed to CMSWEB Production.
This release also brings the initial skeleton for a new MicroService to perform the cleanup of unneeded unmerged files, called MSUnmerged.
It has also a few important feature changes, required to make the behavior consistent between Python2 and Python3. Last but not least,
many other Python3-related fixes and improvements are part of this release.
Release date: 2 July 2021.
Changes since release: 1.4.9.
Central services
Software stack
Features and/or feature changes
- MSUnmerged basic skeleton. (Todor Ivanov) #10598
- MSUnmerged construction around functional pipelines and configurable RSE lists. (Todor Ivanov) #10621
- Replace built-in hash function by hashlib.sha1 (Alan Malta Rodrigues) #10605
- Make output module ordering consistent between Py2/Py3 (Alan Malta Rodrigues) #10610
- Force pickle protocol=0 for the spec creation to be compatible with Py2/Py3 (Alan Malta Rodrigues) #10628
- Encode CMSSW picklearguments to bytes before loading it (Alan Malta Rodrigues) #10648
Bug Fixes
- Deal with EventStreams=None in StepChain step level (Alan Malta Rodrigues) #10594
Enhancements
- Fix string type for DBS mock calls in python2 (Alan Malta Rodrigues) #10588
- Update code creating DBS mocked data; ditched unicode signatures (Alan Malta Rodrigues) #10585
- Create function to elements being acquired in WorkQueue (Alan Malta Rodrigues) #10605
- Print request name in the InvalidStateTransition exception (Alan Malta Rodrigues) #10649
WMAgent
Features and/or feature changes
- Remove repack slots flag (germanfgv) #10629
- DBFormatter formatDict/formatList to native string instead of bytes (Alan Malta Rodrigues) #10639
Bug Fixes
- Fix problem with T0 processes (Kenyi Hurtado) #10527
- Fix WMAgent component Daemon read/write operations (Alan Malta Rodrigues) #10632 #10645
Enhancements
- Create workload sandbox efficiently (Alan Malta Rodrigues) #10612
Python3 related changes
- Fixes for slice 13: file open mode; pickle operations; stdout/stderr (Alan Malta Rodrigues) #10585
- [py2py3] fix unittests from #10289 - src (Dario Mapelli) #10580
- [py2py3] fix unittest from #10262 - src (Dario Mapelli) #10590
- Ensure input for md5 algorithm is a bytes-object in Python3 (Alan Malta Rodrigues) #10595
- [py2py3] WMCore/Services/Service - suggestion (Dario Mapelli) #10584
- Format REST response to bytes in Python3 (Alan Malta Rodrigues) #10601
- [py2py3] Fixing unittests from #10329 - src (Dario Mapelli) #10606
- [py2py3] fix some unittests from #10307 - src (Dario Mapelli) #10603
- [py2py3] Fix AgentStatusWatcher subprocess.Popen calls (Alan Malta Rodrigues) #10635
- [py2py3] Open file in binary mode for pickle load/dump (Alan Malta Rodrigues) #10637
WMCore 1.4.9 central services production release
This release contains major Python3 code modernization, while keeping compatibility with Python2.
In addition to that, there is the removal of all the old Dashboard/DashboardMonitor libraries. Last but not least, it also contains a few bug-fixes and overall enhancements.
Release date: 15 June 2021.
Changes since release: 1.4.8.
Central services
Software stack
- PY3: Ramp up Rucio Client vesion (Todor Ivanov) #10567 cms-sw/cmsdist#6959
- PY3: added Cheetah3 to requirements_py3.txt (Dario Mapelli) #10491
- Replace mox dependency with mock. Remove deprecated testMkdir test (khurtado) #10484
- Removed pystack from our Python2 COMP stack (Alan Malta Rodrigues) dmwm/deployment#1056
- Create new spec for py2-cmscouchapp; remove old couchapp/restkit specs (Alan Malta Rodrigues) cms-sw/cmsdist#6892 cms-sw/cmsdist#6897
- Created new spec for py3-cmscouchapp, version (Alan Malta Rodrigues) 1.3.4 cms-sw/cmsdist#6984
- Created new spec for CouchDB 1.6 with python3 CMSCouchapp (Alan Malta Rodrigues) cms-sw/cmsdist#6919
- Created new spec for Python3 DBS clients (Todor Ivanov) cms-sw/cmsdist#6837 cms-sw/cmsdist#6946
- Created new spec for py3-mysqclient (Todor Ivanov) cms-sw/cmsdist#6926
- Add condor python3 version and make wmagentpy3 require it (khurtado) cms-sw/cmsdist#6925
Features and/or feature changes
- Remove Services/Dashboard package; WMRuntime DashboardMonitor and DashboardInterface (Alan Malta Rodrigues) #10494
- Adjust couchapp push command to match CMSCouchapp (Alan Malta Rodrigues) #10485
- Remake MSTransferor alert subject; increase alert expiration time to 1h (Alan Malta Rodrigues) #10475
- Add couchdb manage function to update couchapps (Erik Gough) #1045 #1057
Bug Fixes
- Fix DID existence check in global workqueue (Alan Malta Rodrigues) #10557
Enhancements
WMAgent
Features and/or feature changes
- Remove Services/Dashboard package; WMRuntime DashboardMonitor and DashboardInterface (Alan Malta Rodrigues) #10494
- Decouple CMSSW and WMCore python versions from PSet tweak (khurtado) #10179
- Add support to OverrideCatalog, allowing use of different storage (germanfgv) #10344
- Adjust couchapp push command to match CMSCouchapp (Alan Malta Rodrigues) #10485
- Add couchdb manage function to update couchapps (Erik Gough) #1045 #1057
Bug Fixes
- PY3: source init.sh script from the wmagentpy3 directory (Alan Malta Rodrigues) #1055
- PY3: Fix WMCORE_ROOT environment variable for WMAgent PY3 (Alan Malta Rodrigues) #1052
- PY3: Fix python interpreter to be used in wmagentpy3 spec (Alan Malta Rodrigues) #6922
Enhancements
- Fix Rucio-related unit tests (Alan Malta Rodrigues) #10576
- Flowchart with the WMCore Jenkins CI setup (Alan Malta Rodrigues) #10560
- Python3 workflow test templates (Alan Malta Rodrigues) #10480
- PY3: Add devtools variant to wmagentpy3 deploy script, for unittests (Alan Malta Rodrigues) #1053
Python3 related changes
- fix unittests from #10295 - src (Dario Mapelli) #10581
- Sort files by name in EventAwareLumiByWork; fix slice 7 unit tests (Alan Malta Rodrigues) #10583
- fix unittests from Slice 3 in py3 (Dario Mapelli) #10579
- Fix unittests from Slice 1 in py3 (Dario Mapelli) #10575
- Fix Py3 unit tests for slice 6, CouchService_t (Alan Malta Rodrigues) #10578
- Fix unittest from #10529, Proxy_t (Erik Gough) #10577
- Open parsed file in bytes. (Todor Ivanov) #10571
- Fix DBFormatter unit test (Alan Malta Rodrigues) #10574
- Re-execute REST/Main with the correct python version (Alan Malta Rodrigues) #10573
- fix unittests from WMCore/Datastructs in py3 (Dario Mapelli) #10562
- Adapt to renaming of assertItemsEqual to assertCountEqual in py3 (Dario Mapelli) #10563
- List of unstable python3 unit tests (Alan Malta Rodrigues) #10565
- fix unittests from WMCore/Algorithms in py3 (Dario Mapelli) #10561
- fix unittests from WMCoreConfigCache (Dario Mapelli) #10522
- Fix missing exceptions module in python3 (Todor Ivanov) #10524
- Fix some problems with string handling in src/python/WMCore/Services/Requests.py (Dario Mapelli) #10508
- futurize src/python/WMCore/Configuration.py (Dario Mapelli) #9974
- fix unittests in test/python/Utils_t - #10500 - src (Dario Mapelli) #10500
- new variables Utils.PythonVersion.PY2/3 (Dario Mapelli) #10518
- MySQLCore - update use of arguments in list.sort() to reflect py3-compatible interface (Dario Mapelli) #10506
- fix stuck unittest in test/python/Utils_t (Dario Mapelli) #10503
- Do not convert unicode to bytes when parsing data from Databases (Dario Mapelli) #10504
- pycurl_manager: converting response to unicode before parsing - src (Dario Mapelli) #10501
- setup_test.py compatible with both py2 and py3 (Dario Mapelli) #10499
- new unittest deploy scripts for wmagentpy3 (Dario Mapelli) #10496
- Modernized bin/ scripts to support py3 (Dario Mapelli) #10482