Fix tensorboard-graph creation for multi gpu mode

[kamo-naoyuki]

No description provided.

[codecov]

Codecov Report

Merging #4431 (59e4b4f) into master (0b5b796) will decrease coverage by 0.00%.
The diff coverage is 78.57%.

@@            Coverage Diff             @@
##           master    #4431      +/-   ##
==========================================
- Coverage   82.44%   82.43%   -0.01%     
==========================================
  Files         470      470              
  Lines       40383    40389       +6     
==========================================
+ Hits        33292    33296       +4     
- Misses       7091     7093       +2     

Flag	Coverage Δ
test_integration_espnet1	66.58% <ø> (ø)
test_integration_espnet2	49.57% <78.57%> (+<0.01%)	⬆️
test_python	69.20% <78.57%> (-0.01%)	⬇️
test_utils	23.45% <ø> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files	Coverage Δ
espnet2/train/trainer.py	79.09% <78.57%> (-0.18%)	⬇️

📣 Codecov can now indicate which changes are the most critical in Pull Requests. Learn more