Interactive Parallel Computing in Python
Python JavaScript
Clone or download
Latest commit 2d77c7f Jun 29, 2018

README.md

Interactive Parallel Computing with IPython

ipyparallel is the new home of IPython.parallel. ipyparallel is a Python package and collection of CLI scripts for controlling clusters for Jupyter.

ipyparallel contains the following CLI scripts:

  • ipcluster - start/stop a cluster
  • ipcontroller - start a scheduler
  • ipengine - start an engine

Install

Install ipyparallel:

pip install ipyparallel

To enable the IPython Clusters tab in Jupyter Notebook:

ipcluster nbextension enable

To disable it again:

ipcluster nbextension disable

See the documentation on configuring the notebook server to find your config or setup your initial jupyter_notebook_config.py.

JupyterHub Install

To install for all users on JupyterHub, as root:

jupyter nbextension install --sys-prefix --py ipyparallel
jupyter nbextension enable --sys-prefix --py ipyparallel
jupyter serverextension enable --sys-prefix --py ipyparallel

Run

Start a cluster:

ipcluster start

Use it from Python:

import os
import ipyparallel as ipp

rc = ipp.Client()
ar = rc[:].apply_async(os.getpid)
pid_map = ar.get_dict()

See the docs for more info.