Brief Description of MaTEx TensorFlow (Old)

Charles Siegel edited this page Mar 28, 2017 · 2 revisions

MaTEx-TensorFlow provides a set of scripts to provide a distributed memory implementation of TensorFlow using MPI.

The script is available in src/deeplearning/tensorflow_old/mpi-tensorflow.py

MaTEx TensorFlow supports data parallelism (input dataset is split in compute nodes and the model/gradients are averaged at each step using MPI All-to-all reduction). Please read the arxiv paper (Distributed TensorFlow with MPI - https://arxiv.org/abs/1603.02339) for more details.

You can’t perform that action at this time.
You signed in with another tab or window. Reload to refresh your session. You signed out in another tab or window. Reload to refresh your session.
Press h to open a hovercard with more details.