Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

TerminatedWorkerError: (Due to memmory?) - in Grdisearch(n_jobs=-1) #62

Closed
mcreixell opened this issue Dec 9, 2019 · 3 comments
Closed
Assignees
Labels
question Further information is requested

Comments

@mcreixell
Copy link
Collaborator

mcreixell commented Dec 9, 2019

Only one of the checks failed with the following error below. It's coming from plotMixedClusteringPLSR_GridSearch in figure2.py:

�[0;31mTerminatedWorkerError�[0m: A worker process managed by the executor was unexpectedly terminated. This could be caused by a segmentation fault while calling the function or by an excessive memory usage causing the Operating System to kill the worker. The exit codes of the workers are {SIGSEGV(-11)}
TerminatedWorkerError: A worker process managed by the executor was unexpectedly terminated. This could be caused by a segmentation fault while calling the function or by an excessive memory usage causing the Operating System to kill the worker. The exit codes of the workers are {SIGSEGV(-11)}

From what I've found online, it seems that this is a quite recent error from 'Gridsearch'? scikit-learn-contrib/skope-rules#18

It's a bit confusing to me tho the fact that all the figures are correctly displayed on Jenkins when I click on the checks that did pass. Also I don't get any errors when I run this locally on my notebook.
`
Any suggestions? @aarmey

@mcreixell mcreixell added the question Further information is requested label Dec 9, 2019
@mcreixell mcreixell changed the title TerminatedWorkerError: Due to memmory?) TerminatedWorkerError: (Due to memmory?) - in Grdisearch(n_jobs=-1) Dec 9, 2019
@aarmey
Copy link
Member

aarmey commented Dec 9, 2019

If you're getting that I'd just remove the n_jobs=-1 argument. It'll take longer but work.

@mcreixell
Copy link
Collaborator Author

I found it very helpful to gridsearch in parallel so I'll just comment this line of the notebook out every time I push.

@MosesBomera
Copy link

I experienced this exact error after updating Windows 10 (KB 5001330), uninstalling this update resolved the error, for windows users maybe you could look into this especially if it was working before the update.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
question Further information is requested
Projects
None yet
Development

No branches or pull requests

3 participants