All notable changes to the cluser_tools library are documented in this file.
The format is based on Keep a Changelog
and this project adheres to Semantic Versioning MAJOR.MINOR.PATCH.
For upgrade instructions, please check the respective Breaking Changes sections.
0.12.4 - 2023-05-25
- Upgrades
black,mypy,pylint,pytest. #873
0.12.3 - 2023-02-22
0.12.2 - 2023-02-20
0.12.1 - 2023-02-16
0.12.0 - 2023-02-10
0.11.4 - 2023-02-09
- Fixed the execution of non-array jobs using slurm. #864
0.11.3 - 2023-02-06
0.11.2 - 2023-01-18
- Fixed
TypeErrorwhen aborting a run that occurred under certain circumstances. #851
0.11.1 - 2023-01-05
- When using the slurm or pbs distribution strategy, scheduled jobs are automatically canceled when aborting a run, i.e. if the SIGINT signal is received. #838
0.11.0 - 2022-12-09
0.10.27 - 2022-12-07
0.10.26 - 2022-12-05
0.10.25 - 2022-11-29
0.10.24 - 2022-11-09
0.10.23 - 2022-11-01
0.10.22 - 2022-10-27
0.10.21 - 2022-10-26
0.10.20 - 2022-10-20
0.10.19 - 2022-10-18
0.10.18 - 2022-09-29
0.10.17 - 2022-09-26
0.10.16 - 2022-09-13
0.10.14 - 2022-08-30
0.10.13 - 2022-08-22
0.10.12 - 2022-08-15
0.10.11 - 2022-08-03
0.10.10 - 2022-07-26
0.10.9 - 2022-07-22
- Suppress spurious ConnectionResetErrors when using multiprocessing. #770
0.10.8 - 2022-07-15
0.10.7 - 2022-07-14
0.10.6 - 2022-06-27
0.10.5 - 2022-06-15
0.10.4 - 2022-06-15
0.10.3 - 2022-06-03
- Detect when slurm jobs crash due to being out-of-memory. #739
0.10.2 - 2022-05-20
- Fix
_log() got unexpected keyword argument: 'file'error for newer Python versions. #735
0.10.1 - 2022-05-10
0.10.0 - 2022-05-09
0.9.24 - 2022-05-03
0.9.23 - 2022-05-03
0.9.22 - 2022-05-02
0.9.21 - 2022-04-20
0.9.20 - 2022-04-20
0.9.19 - 2022-04-11
- Fixed that the ProcessPoolExecutor by the cluster tools would also create a checkpoint if the job failed. This was a regression introduced by #686. #692
0.9.18 - 2022-04-06
- The cluster-tools serialize the output of a job in the format
(wasSuccessful, result_value)to a pickle file ifoutput_pickle_pathis provided and multiprocessing is used. This is consistent with how it is already done when using a cluster executor (e.g., slurm). #686
0.9.17 - 2022-04-05
0.9.16 - 2022-03-31
0.9.15 - 2022-03-31
- The
multiprocessingexecutor now usesspawnas default start method.forkandforkservercan be used by supplying astart_methodargument (e.g.cluster_tools.get_executor("multiprocessing", start_method="forkserver")) or by setting theMULTIPROCESSING_DEFAULT_START_METHODenvironment variable. #662
0.9.14 - 2022-03-24
0.9.13 - 2022-03-24
0.9.12 - 2022-03-18
0.9.11 - 2022-03-16
0.9.10 - 2022-03-15
0.9.9 - 2022-03-03
0.9.8 - 2022-02-28
0.9.7 - 2022-02-28
- Added
KubernetesExecutorfor parallelizing Python scripts on a Kubernetes cluster. #600
0.9.6 - 2022-02-15
- Automatically detect when a multiprocessing context is set up without using an
if __name__ == "__main__"guard in the main module. #598
0.9.5 - 2022-02-10
0.9.4 - 2022-02-09
0.9.3 - 2022-02-07
0.9.2 - 2022-02-03
0.9.1 - 2022-01-31
0.9.0 - 2022-01-19
- Allow to configure the MaxArraySize and MaxSubmitJobs slurm limits via the
SLURM_MAX_ARRAY_SIZEandSLURM_MAX_SUBMIT_JOBSenvironment variables. If the environment variables are not specified, the limits are determined automatically. #554
0.8.31 - 2022-01-07
0.8.30 - 2021-12-27
0.8.29 - 2021-12-14
0.8.28 - 2021-12-09
This module did not exist in 0.8.28. See the following notes about the mono-repo migration
Before 0.8.29, cluser_tools did not exist in this repository. Instead, v1.1 to v1.61 were maintained in this repository. Note that 0.8.29 is newer than 1.61. The poor naming was a sacrifice during the mono-repo migration which enforced synchronized versioning between all packages (e.g., wkcuber and webknossos). To avoid version conflicts in the future, the first major release for webknossos-libs will be v2.