v0.1.21

Breaking changes

• Add flag to control unique basenames of files fetched via --fetch-output, which now defaults to unique names and moves the flag for external outputs to the 5th position; keep_names in fetch_task_output is replaced by unique_names. (b881450, c909453)
• Refactor notification parameters to define transports via get_transport(). (8582856)
• Remove default SMTP host and port for mail notifications. (004a535)
• Disable law logger propagation. (73ff4fd)

Features & improvements

• Add custom notification parameter. (b908f47)
• Refactor threaded job interactions. (2ea2f00)
• Make all job handling commands configurable. (deb6933)
• Introduce job query timeouts. (92cf9f8)
• Add remote workflow hooks to show summaries, including a job memory summary. (c084cc9, 3103b3f, c0a3fcb)
• Run multiple branches in jobs via loop for resource cleaning. (c6ba850)
• Add python_exe render variable to adjust python in jobs. (bbeaa4a)
• Allow configuring law_exe in job script. (0578967)
• Reduce size of render_variables representation. (55dbc04)
• Use local_scheduler setting from config in remote workflows. (d930140)
• Exclude --no-poll from requirements. (fb21a9c)
• Optimize local workflow proxy under multiprocessing conditions. (a4cc6dd, d5697ea, 66a8f36)
• Pass through workflow branch arguments in as_branch. (b79c999)
• Add --wrap-once feature to WrapperTask. (5c99db6)
• Add optional flag to safe_output decorator. (1f359ca)
• Store unlocalized method in localization decorator. (265903e)
• Add option to remove target collections with multi-threading. (a0ffb4e)
• Atomic local_sync switch per mirrored file target call. (d0c9393)
• Configurable local sync mode in interactive removal. (8ba6a78)
• Refactor recursion control in interactive parameters. (e26f045)
• Add root_task_cls() to parser. (b585120)
• Skip tasks starting with underscore from index. (0dd693f)
• Add modify_task_attributes hook to base register. (b5a8f62, 165d0e0)
• Reduce redundant luigi logs. (e0655e9)
• Improve log handler setup. (9765f7c)
• Refactor interruptable subprocess termination. (e450546, fc94032)
• Preference for tar formatter. (2b24af8)
• Add prepend/append to InsertableDict. (7dd42c8)
• Add negation of patterns starting with "!" to multi_match util. (#213, 92b88e8)
• Add chunk_slice_ranges util. (d65ba03)

Fixes

• Fix split_csv forwarding in config getters. (353ae67)
• Fix config option casting. (068c97d)
• Fix submission of done jobs in remote workflow. (a02aeb3)
• Fix no-poll passing between remote workflows. (cb11d9d)
• Fix local workflow super run. (9f6ccff)
• Fix run cli for nested task namespaces. (49b5217)
• Fix duplicates in print-output. (e0dbb45)
• Fix empty repr check. (361a9b6, 46c49a1)
• Fix local target permission handling. (ff9901d, b1b2665)
• Fix globbing on LocalDirectoryTargets (#205, @cverstege, ba2a162)
• Fix mkdir_rec uri lookup. (1108f05)
• Fix mirrored target copying. (0216445)
• Fix copy validation and permission handling for RemoteFileSystem with a local file:// base (#211, @cverstege, d931be5)
• Fix InsertableDict append/prepend with values and multiple items. (#213, 92b88e8)
• Fix state checks of SiblingFileCollection with a missing directory. (#213, 92b88e8)

contrib packages

• [mattermost] Add mattermost contrib package. (511d6ed, 95eec54, dca956d)
• [htcondor] Optimize job queries. (a314b99)
• [htcondor] Log remote host for job errors. (b5d4379, c1a89e2)
• [slurm] Fix log directory lookup (#202, @EthanMarx, 86ab1ed)
• [slurm] Update default log settings. (64786ab)
• [cms] Update to new crab changes. (0a4901a)
• [cms] Improve crab job status parsing. (a92ddcf)
• [cms] Adapt crab workflow and proxy delegation. (1d82bd4)
• [cms] Add rucio file access reporting util. (3d45ef4, be0443a, 0345f4e, 267a0e2, 2681955)
• [singularity] Robust python lookup in sandbox, add example (#208, @winterchristian, e07537a)
• [docker, singularity] Fix py_executable quotation in container commands. (6cdb48e)
• [pyarrow] Add skip_empty option to parquet merging. (ecc677a)
• [pyarrow] Improve parquet merging, add option to control row group size. (b76c173, 2e61338, 1d667e4)
• [pyarrow] Improve schema detection in parquet merging. (3115cde)
• [root] Create TFile using Open instead of the constructor (#203, @jaimeleonh, 4dedb02)
• [root] Add cascading option to hadd_task util. (768b256)
• [awkward] Update awkward formatter, add from_parquet util. (03c7077)
• [git] Add include_files to repo checksum calculation. (097084a)
• [git] Improve ignore/include pattern usage in repo bundling. (9dc3399)
• [git, mercurial] Refactor repository checksums. (067ea6a, 71c568e)
• [tasks] Make transfer output configurable in TransferLocalFile. (11bac81)