Skip to content

Commit

Permalink
merge distributed setup into distributed
Browse files Browse the repository at this point in the history
  • Loading branch information
mrocklin committed May 22, 2015
1 parent 212544c commit 2cd3f44
Show file tree
Hide file tree
Showing 2 changed files with 27 additions and 40 deletions.
40 changes: 0 additions & 40 deletions docs/source/distributed-setup.rst

This file was deleted.

27 changes: 27 additions & 0 deletions docs/source/distributed.rst
Original file line number Diff line number Diff line change
Expand Up @@ -148,6 +148,33 @@ Other clients on different machines can retrieve this collection:
This only stores the dask graph and not any underlying data that this graph
might open. Usually these graphs are small and easy to pass around.


IPython.parallel
----------------

Users familiar with ``IPython.parallel`` can use an ``IPython.parallel.Client``
object, connected to a running ``ipcluster`` to bootstrap a dask distributed
cluster.

.. code-block:: python
# Setup your IPython cluster...
# Create a client.
from IPython.parallel import Client
ipclient = Client()
# Now use IPython parallel to set up dask.distributed
from dask.distributed import dask_client_from_ipclient
dclient = dask_client_from_ipclient(ipclient)
# Dask Client.get method computes dask graphs on the cluster.
dclient.get({'a': 41, 'b': (lambda x: x + 1, 'a')}, 'b')
More info about setting up an IPython cluster can be found here_.

.. _here: http://ipython.org/ipython-doc/dev/parallel/parallel_process.html


Known Limitations
-----------------

Expand Down

0 comments on commit 2cd3f44

Please sign in to comment.