Skip to content

Commit

Permalink
Allow other ranks to profile as well. Doesn't seem to conflict
Browse files Browse the repository at this point in the history
Signed-off-by: Rich Porter <rich.porter@uber.com>
  • Loading branch information
porterrf committed Sep 7, 2021
1 parent 38ff578 commit e8ddea8
Showing 1 changed file with 0 additions and 4 deletions.
4 changes: 0 additions & 4 deletions horovod/spark/keras/remote.py
Expand Up @@ -152,10 +152,6 @@ def train(serialized_model, train_rows, val_rows, avg_row_size):
hvd.callbacks.MetricAverageCallback(),
]

if hvd.local_rank() != 0:
# The TB callback appears to conflict across processes on the same machine
user_callbacks[:] = [c for c in user_callbacks if not isinstance(c, k.callbacks.TensorBoard)]

callbacks += user_callbacks

# Horovod: save checkpoints only on the first worker to prevent other workers from
Expand Down

0 comments on commit e8ddea8

Please sign in to comment.