Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

DM-41832: Use spawn as start method, deprecate fork option #274

Merged
merged 6 commits into from Nov 22, 2023

Conversation

andy-slac
Copy link
Collaborator

Fork became unusable, switching default start method to spawn. Forkserver
option is still available, fork option is kept in CLI for compatibility
but we issue a warning and switch to spawn if fork is given.

Checklist

  • ran Jenkins
  • added a release note for user-visible changes to doc/changes

Fork became unusable, switching default start method to spawn. Forkserver
option is still available, fork option is kept in CLI for compatibility
but we issue a warning and switch to spawn if fork is given.
Copy link

codecov bot commented Nov 22, 2023

Codecov Report

Attention: 6 lines in your changes are missing coverage. Please review.

Comparison is base (9aa77c5) 87.21% compared to head (bdb04fa) 87.14%.

Files Patch % Lines
python/lsst/ctrl/mpexec/cli/script/run.py 0.00% 3 Missing ⚠️
python/lsst/ctrl/mpexec/cli/script/run_qbb.py 40.00% 3 Missing ⚠️
Additional details and impacted files
@@            Coverage Diff             @@
##             main     #274      +/-   ##
==========================================
- Coverage   87.21%   87.14%   -0.07%     
==========================================
  Files          49       49              
  Lines        4419     4427       +8     
  Branches      762      764       +2     
==========================================
+ Hits         3854     3858       +4     
- Misses        407      413       +6     
+ Partials      158      156       -2     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

Copy link
Member

@timj timj left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good. I'm happy with --start-method fork not breaking for now. I've made suggested changes to some of the text since deprecated implies to me that you can still use it for now but that's not what we mean.

python/lsst/ctrl/mpexec/cli/opt/options.py Outdated Show resolved Hide resolved
python/lsst/ctrl/mpexec/cli/script/run.py Outdated Show resolved Hide resolved
python/lsst/ctrl/mpexec/cli/script/run_qbb.py Outdated Show resolved Hide resolved
@@ -393,11 +395,9 @@ def __init__(
self.executionGraphFixup = executionGraphFixup
self.report: Report | None = None

# We set default start method as spawn for MacOS and fork for Linux;
# None for all other platforms to use multiprocessing default.
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is fork the multiprocessing default then?

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Fork is default for Linux, spawn is default for MacOS and Windows.

Co-authored-by: Tim Jenness <tjenness@lsst.org>
@andy-slac andy-slac merged commit be8138e into main Nov 22, 2023
11 of 13 checks passed
@andy-slac andy-slac deleted the tickets/DM-41832 branch November 22, 2023 23:22
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants