Skip to content

fix rayon pool memory blow up#13

Merged
ajz34 merged 3 commits intoRESTGroup:masterfrom
ajz34:fix-rayon-pool
Mar 24, 2025
Merged

fix rayon pool memory blow up#13
ajz34 merged 3 commits intoRESTGroup:masterfrom
ajz34:fix-rayon-pool

Conversation

@ajz34
Copy link
Member

@ajz34 ajz34 commented Mar 24, 2025

c.f. #12

This fixes memory blowup when using reduce functions.
However more check need to be performed, since other pool.install code may cause memory blow up.

As a programming practice, it is better not using pool.install inside rayon spawned parallel task. Parallel and serial tasks must use different codes. When rayon parallel not detected, use pool.install, while when rayon parallel detected, use serial code.

@ajz34 ajz34 marked this pull request as ready for review March 24, 2025 03:51
@ajz34 ajz34 linked an issue Mar 24, 2025 that may be closed by this pull request
@ajz34 ajz34 merged commit b6a2b60 into RESTGroup:master Mar 24, 2025
4 checks passed
@ajz34 ajz34 deleted the fix-rayon-pool branch March 24, 2025 03:52
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Possible memory blow up in reduction functions

1 participant