Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Runtime Error - "Distributed package doesn't have NCCL" when running runexp #3

Closed
eaberman opened this issue May 23, 2021 · 2 comments
Closed

Runtime Error - "Distributed package doesn't have NCCL" when running runexp #3

eaberman opened this issue May 23, 2021 · 2 comments

Comments

@eaberman
Copy link

When I run source setup.sh && runexp anli-full infobert roberta-large 2e-5 32 128 -1 1000 42 1e-5 5e-3 6 0.1 0 4e-2 8e-2 0 3 5e-3 0.5 0.9 as specified in the README in the ANLI directory, I encounter a RuntimeError: Distributed package doesn't have NCCL built in message.

Do you have any advice on how to fix this?

Thank you! I really admire your work.
@boxin-wbx
Copy link
Member

NCCL is usually installed together with PyTorch. You may try to reinstall PyTorch with conda.

@eaberman
Copy link
Author

Thank you! I was able to fix this and get it running.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@boxin-wbx @eaberman