Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

IPython crashes with optunity.parallel.pmap #8

Closed
claesenm opened this issue Jul 22, 2014 · 4 comments

Comments

@claesenm
Copy link
Owner

commented Jul 22, 2014

IPython crashes if the parallelized function outputs anything to stdout or stderr. This is an IPython issue that we can't fix ourselves.

More info at: ipython/ipython#2438

A workaround is to use IPython's own parallel features:
http://nbviewer.ipython.org/github/vals/scilife-python-course/blob/master/parallel%20python.ipynb

@claesenm claesenm added bug labels Jul 22, 2014

@updiversity

This comment has been minimized.

Copy link

commented Apr 22, 2015

Is the workaround is to NOT use optunity in ipython ? Can you be more specific ? Thks

@claesenm

This comment has been minimized.

Copy link
Owner Author

commented Apr 22, 2015

You can use optunity with ipython, but optunity's built-in parallellization will not work due to this issue. As such, the simplest way to deal with it is to not use parallel features in IPython (that is don't use optunity.parallel.pmap.

If you really want parallel functionality in ipython, you would need to (i) setup an IPython cluster with a set of workers (can be on a single machine) and (ii) implement an alternative to optunity.parallel.pmap that uses IPython's parallel features.

@updiversity

This comment has been minimized.

Copy link

commented Apr 22, 2015

Thks for the reply

@claesenm

This comment has been minimized.

Copy link
Owner Author

commented Jul 10, 2015

Closing this issue as we cannot fix it ourselves.

@claesenm claesenm closed this Jul 10, 2015

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
2 participants
You can’t perform that action at this time.