Replies: 2 comments 3 replies
-
|
Beta Was this translation helpful? Give feedback.
1 reply
-
in a multi-GPU setting with DDP all the ranks processes same number of batches. |
Beta Was this translation helpful? Give feedback.
2 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Hi everyone,
Is there an existing mechanism to print the number of batches i.e. len(dataloader) being processed by each rank in a multi-gpu setting?
Thanks :)
Beta Was this translation helpful? Give feedback.
All reactions