Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Create general use proc pool (SYN-4901) #3033

Merged
merged 32 commits into from Jul 7, 2023
Merged

Create general use proc pool (SYN-4901) #3033

merged 32 commits into from Jul 7, 2023

Conversation

mikemoritz
Copy link
Contributor

No description provided.

synapse/lib/coro.py Outdated Show resolved Hide resolved
@codecov
Copy link

codecov bot commented Feb 28, 2023

Codecov Report

Patch coverage: 83.33% and project coverage change: -0.13 ⚠️

Comparison is base (a8c4f2c) 97.31% compared to head (75503c4) 97.18%.

Additional details and impacted files
@@            Coverage Diff             @@
##           master    #3033      +/-   ##
==========================================
- Coverage   97.31%   97.18%   -0.13%     
==========================================
  Files         225      225              
  Lines       45009    45014       +5     
==========================================
- Hits        43799    43748      -51     
- Misses       1210     1266      +56     
Flag Coverage Δ
linux 97.18% <83.33%> (-0.03%) ⬇️
linux_replay ?

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files Coverage Δ
synapse/tests/utils.py 94.49% <66.66%> (-1.94%) ⬇️
synapse/lib/coro.py 97.50% <77.77%> (-0.49%) ⬇️
synapse/lib/parser.py 98.51% <100.00%> (ø)
synapse/lib/stormlib/json.py 100.00% <100.00%> (ø)
synapse/lib/stormlib/mime.py 86.66% <100.00%> (-13.34%) ⬇️
synapse/lib/stormlib/stix.py 98.27% <100.00%> (-0.87%) ⬇️
synapse/lib/stormlib/xml.py 97.61% <100.00%> (-0.16%) ⬇️

... and 10 files with indirect coverage changes

☔ View full report in Codecov by Sentry.
📢 Do you have feedback about the report comment? Let us know in this issue.

@vEpiphyte vEpiphyte added this to the python 311 milestone May 24, 2023
@vEpiphyte vEpiphyte added the reqChangelog requires changelog label May 26, 2023
forkpool = concurrent.futures.ProcessPoolExecutor(mp_context=mpctx, max_workers=max_workers)
logger.debug(f'Shared forkserver pool max_workers={forkpool._max_workers}')
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is the intent that we log the # of workers upon service startup?

This will be logged during import time; which is prior to any logger configuration occurring.
If we set a default max_workers = None value than the workers is safe to refer to from other modules and log the # of as needed.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We already had the logger.warning there, but yeah, it hasn't been configured yet. I removed this debug logging, and maybe we should consider making the warning a python warning.

synapse/axon.py Outdated Show resolved Hide resolved
@vEpiphyte vEpiphyte modified the milestones: v2.140.0, v2.1xx.x Jun 30, 2023
vEpiphyte
vEpiphyte previously approved these changes Jul 4, 2023
@vEpiphyte vEpiphyte modified the milestones: v2.141.0, v2.14x.x Jul 7, 2023
@mikemoritz mikemoritz merged commit a7fcdc5 into master Jul 7, 2023
4 of 5 checks passed
@mikemoritz mikemoritz deleted the forkpool-general branch July 7, 2023 21:42
@vEpiphyte vEpiphyte removed the reqChangelog requires changelog label Jul 14, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants