v4.3.0

webknossos

Fixed

• Fixed rich.errors.LiveError: Only one live display may be active at once when progress-reporting operations (e.g. downsampling) run concurrently in multiple threads. Progress bars are now only rendered from the main thread.
• Fixed Too many open files errors when uploading datasets with many files. Files are now only opened while their chunks are being uploaded. #1579

cluster_tools

Added

• Added the OutputStore interface (with FileOutputStore as the default) that executors use to persist job outputs and, for cluster executors, to poll for job completion and read results back. Passing a custom store via get_executor(..., output_store=...) allows storing results in non-filesystem storage (e.g. a database), in which case no output pickle files are written at all. Output locations are selected with map_to_futures(..., output_key_getter=...) and submit(..., __cfut_options={"output_key": ...}); output_pickle_path_getter/output_pickle_path are kept as deprecated aliases for the file store. #1547

Changed

• Cluster executors delete transient outputs (jobs without a custom output key) right after reading the result or the error, instead of keeping them until executor shutdown. Failed ones were not deleted at all before. #1547

Deprecated

• Deprecated map_to_futures(..., output_pickle_path_getter=...) and __cfut_options={"output_pickle_path": ...} in favor of output_key_getter and output_key. #1547