New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Save bandwidth by using a torrent to distribute more efficiently #73
base: main
Are you sure you want to change the base?
Save bandwidth by using a torrent to distribute more efficiently #73
Conversation
Thank you for your pull request and welcome to our community. Action RequiredIn order to merge any pull request (code, docs, etc.), we require contributors to sign our Contributor License Agreement, and we don't seem to have one on file for you. ProcessIn order for us to review and merge your suggested changes, please sign at https://code.facebook.com/cla. If you are contributing on behalf of someone else (eg your employer), the individual CLA may not be sufficient and your employer may need to sign the corporate CLA. Once the CLA is signed, our tooling will perform checks and validations. Afterwards, the pull request will be tagged with If you have received this in error or have any questions, please contact us at cla@meta.com. Thanks! |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
lgtm
Thank you for signing our Contributor License Agreement. We can now accept your code for this (and any) Meta Open Source project. Thanks! |
1 similar comment
Thank you for signing our Contributor License Agreement. We can now accept your code for this (and any) Meta Open Source project. Thanks! |
Good catch! This will save millions in bandwidth costs. |
my fucking sides |
i love the internet |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM, you're hired.
Big if true. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM!
At this point Meta should publish the original checksums so that we know if it's the real model. It appears that PyTorch models can execute arbitrary code, so this might as well be a clever attack.. |
Could've helped with.. uh.. reducing bandwidth, but don't have enough space for the entire model, anyone else distributing the load? |
Just convert them to safetensors on a VM or cloud computer. |
I kneel |
the magnet link is broken. update your pull request pls |
I can't sneed |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM with a tiny markdown change
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
lgtm
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM
Ship it |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Can anyone give away the 7b? I have a Mac m1 with 256gb and I can't download via the main link because the file size exceeds the size of my storage |
Honestly, the models alone are not really useful. This project (
https://github.com/cocktailpeanut/dalai), a fork of a fork, should let you
run it on a Mac M1 pretty decently. It's also 4.21GB for the 7B model.
…On Thu, Mar 23, 2023 at 10:26 PM Heliumra ***@***.***> wrote:
Can anyone give away the 7b? I have a Mac m1 with 256gb and I can't
download via the main link because the file size exceeds the size of my
storage
—
Reply to this email directly, view it on GitHub
<#73 (comment)>,
or unsubscribe
<https://github.com/notifications/unsubscribe-auth/AWY7AS4SQK3WZB5JBLYEKHDW5UWBXANCNFSM6AAAAAAVN7HCPU>
.
You are receiving this because you commented.Message ID:
***@***.***>
|
Thank you! I would probably like to rent a server for 65b but not sure I can afford it |
no seeders on the torrent file |
LGTM |
Did you try the alt torrent, magnet:?xt=urn:btih:b8287ebfa04f879b048d4d4404108cf3e8014352&dn=LLaMA |
you deserve a bonus ser! |
LGTM |
LGTM |
|
LGTM |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Even with smaller models (StableDiffusion) I had many issues downloading form HuggingFace via Git LFS or the client.
Torrent seems to be much more reliable. And bandwidth-saving as well.
You get my stamp of approval.
@Arlodotexe hey those are your files? On ipfs will those file be there or will you delet it please let me know |
You can think of ipfs like BitTorrent + Git + Http. Files are retrievable as long as any one person has them on a local node. This post and this video are good introductions to ipfs. To learn more, ask your favorite search engine. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM
I have no idea what I'm doing, but I am good at following tutorials, and I will try to seed the smaller models. Unless I am missing something and I shouldn't do that? |
Lgtm |
1 similar comment
Lgtm |
hope I get it |
No description provided.