Permalink
139 lines (105 sloc) 4.06 KB

Ray

Fork me on GitHub

Ray is a flexible, high-performance distributed execution framework.

Ray is easy to install: pip install ray

Example Use

Basic Python Distributed with Ray
# Execute f serially.


def f():
    time.sleep(1)
    return 1



results = [f() for i in range(4)]
# Execute f in parallel.

@ray.remote
def f():
    time.sleep(1)
    return 1


ray.init()
results = ray.get([f.remote() for i in range(4)])

View the codebase on GitHub.

Ray comes with libraries that accelerate deep learning and reinforcement learning development:

  • Ray Tune: Hyperparameter Optimization Framework
  • Ray RLlib: Scalable Reinforcement Learning
.. toctree::
   :maxdepth: 1
   :caption: Installation

   installation.rst
   install-on-docker.rst
   installation-troubleshooting.rst

.. toctree::
   :maxdepth: 1
   :caption: Getting Started

   tutorial.rst
   api.rst
   actors.rst
   using-ray-with-gpus.rst
   webui.rst

.. toctree::
   :maxdepth: 1
   :caption: Ray Tune

   tune.rst
   tune-config.rst
   hyperband.rst
   pbt.rst

.. toctree::
   :maxdepth: 1
   :caption: Ray RLlib

   rllib.rst
   rllib-training.rst
   rllib-env.rst
   rllib-algorithms.rst
   rllib-models.rst
   rllib-concepts.rst
   rllib-package-ref.rst

.. toctree::
   :maxdepth: 1
   :caption: Pandas on Ray

   pandas_on_ray.rst

.. toctree::
   :maxdepth: 1
   :caption: Examples

   example-rl-pong.rst
   example-policy-gradient.rst
   example-parameter-server.rst
   example-resnet.rst
   example-a3c.rst
   example-lbfgs.rst
   example-evolution-strategies.rst
   example-cython.rst
   example-streaming.rst
   using-ray-with-tensorflow.rst

.. toctree::
   :maxdepth: 1
   :caption: Design

   internals-overview.rst
   serialization.rst
   fault-tolerance.rst
   plasma-object-store.rst
   resources.rst
   redis-memory-management.rst

.. toctree::
   :maxdepth: 1
   :caption: Cluster Usage

   autoscaling.rst
   using-ray-on-a-cluster.rst
   using-ray-on-a-large-cluster.rst
   using-ray-and-docker-on-a-cluster.md

.. toctree::
   :maxdepth: 1
   :caption: Help

   troubleshooting.rst
   user-profiling.rst
   development.rst
   profiling.rst
   contact.rst