Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update train.py #25

Open
wants to merge 2 commits into
base: master
Choose a base branch
from
Open

Update train.py #25

wants to merge 2 commits into from

Conversation

Miralan
Copy link

@Miralan Miralan commented Dec 7, 2020

Solve imbalanced gpu memory at multi-gpu distributed training.

Solve imbalanced gpu memory at multi-gpu distributed training.
@v-nhandt21
Copy link

@Miralan Did you remember running time you use for distributed, second/iteration, Can you share the script for run distibuted

shivahr added a commit to bhashini-ai/hifi-gan that referenced this pull request Jan 14, 2022
@Aloento
Copy link

Aloento commented Mar 14, 2023

Why and how did you make this change?

@PussyCat0700
Copy link

Amazing! The line torch.cuda.set_device(rank) gives significant boost especially when training just started. Anyone knows why?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants