IPython crashes with optunity.parallel.pmap

[claesenm]

IPython crashes if the parallelized function outputs anything to stdout or stderr. This is an IPython issue that we can't fix ourselves.

More info at: ipython/ipython#2438

A workaround is to use IPython's own parallel features:
http://nbviewer.ipython.org/github/vals/scilife-python-course/blob/master/parallel%20python.ipynb

[updiversity]

Is the workaround is to NOT use optunity in ipython ? Can you be more specific ? Thks

[claesenm]

You can use optunity with ipython, but optunity's built-in parallellization will not work due to this issue. As such, the simplest way to deal with it is to not use parallel features in IPython (that is don't use optunity.parallel.pmap.

If you really want parallel functionality in ipython, you would need to (i) setup an IPython cluster with a set of workers (can be on a single machine) and (ii) implement an alternative to optunity.parallel.pmap that uses IPython's parallel features.

[updiversity]

Thks for the reply

[claesenm]

Closing this issue as we cannot fix it ourselves.