Join GitHub today
GitHub is home to over 36 million developers working together to host and review code, manage projects, and build software together.Sign up
Allow explicit configuration of handlers for workflow scheduling. #3844
Currently every job handler is a workflow scheduler handler and vice versa. This (in particular bb1bb67) allow specifying a separate (or potentially overlapping) pool of workflow schedulers. Includes lots of testing for figuring out if the current process is a workflow handler and for determining what handler should be assigned for queued workflows.
Builds on the testing from #3820 so it includes that PR and a merge forward of everything into dev.
A long discussion of how this may potentially improve performance, robustness, and quality of logs for workflow scheduling can be found as part of #3816 (comment).
I was hoping to follow this up quickly with a switch to YAML - I don't want to write or encourage others to edit more XML.
If you insist on documentation, I'm going to rework the configuration files and add it to this PR - but this PR will be less focused as a result.