Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

NCCL integration #146

Closed

Conversation

chaserileyroberts
Copy link
Contributor

Opening as a draft PR to get early feedback that I am doing the bindgen correctly. I am currently still working on the result and safe wrappings.

Fixes #129

@coreylowman
Copy link
Owner

Cool let me know when you're ready for a review or help!

@chaserileyroberts
Copy link
Contributor Author

chaserileyroberts commented May 13, 2023

@coreylowman I added the result and safe implementations now. I'm still working on testing and documentation, but the meat of the work is there if you want to add any early comments. I'll mark this "ready for review" once I'm happy with the documentation and testing time this weekend.

Copy link
Owner

@coreylowman coreylowman left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good to me so far, nice structure 👍

@Narsil
Copy link
Contributor

Narsil commented Jul 2, 2023

Any work still happening here ? I'm really interested in using this.

I can try and continue the PR if needed.

We're working on this: https://github.com/LaurentMazare/candle and this might become interesting for unlocking LLM work.

@Narsil Narsil mentioned this pull request Jul 4, 2023
@coreylowman
Copy link
Owner

Thanks for the initial work on this @Thenerdstation. Merged in #164 which extended all the commits in this pr!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

NCCL support
3 participants