Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

I only have one GPU #21

Closed
sabhiram6 opened this issue Dec 29, 2023 · 4 comments
Closed

I only have one GPU #21

sabhiram6 opened this issue Dec 29, 2023 · 4 comments

Comments

@sabhiram6
Copy link

Hey @tobran I have read your
error
paper and its excellent . I am currently implementing the code . I only have one GPU so in train.sh i changed the nodes to 1 and set CUDA_VISIBLE_DEVICES=0 .

But i am getting " train.py: error: unrecognized arguments: --local-rank=0" .

Could you please tell me what changes i need to make in the code if I have access to only 1 GPU .

Thank You

@tobran
Copy link
Owner

tobran commented Jan 3, 2024

Thank you for your interest in our work. You can check the pytorch version, if it is more than 2.0, you will encounter this error

@sabhiram6
Copy link
Author

Okay thank you. I used torchrun and now it is working .

@VinayHajare
Copy link

Okay thank you. I used torchrun and now it is working .

Can you please help me with training on single GPU, I have tried many times also with torchrun. Please tell what changes did you do with the local_rank

@sabhiram6
Copy link
Author

sabhiram6 commented Feb 15, 2024 via email

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants