Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Thread pool reached error #59

Closed
kristyhoran opened this issue Oct 20, 2021 · 1 comment
Closed

Thread pool reached error #59

kristyhoran opened this issue Oct 20, 2021 · 1 comment

Comments

@kristyhoran
Copy link
Collaborator

This is an error reported by @abcdtree bohra Nextflow errored out with a warning the the thread pool had been reached... this has happened before (in QC2) when running the local executor. It is mentioned here nextflow-io/nextflow#1871 Although honestly I am not 100% sure I understand exactly what is happening. BUT the effect is that when there are alot of samples in the analysis, the Nextflow tries to check the cache... and does this across all processes and samples.. which may be more than the 1000 set....
There is no clear advice from developers on this.. but it seems that adding in -Dnxf.pool.type=sync addresses the issue..
kristyhoran added a commit that referenced this issue Oct 20, 2021
@kristyhoran
fixed duplicate mlst alleles issue #58 and thread pool error issue #59
db956a4
@karl-az
Copy link

karl-az commented Feb 23, 2022

I would also appreciate more information here.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@kristyhoran @karl-az