Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

hfdownloader integration (?) #429

Open
BlairSadewitz opened this issue Jul 27, 2023 · 0 comments
Open

hfdownloader integration (?) #429

BlairSadewitz opened this issue Jul 27, 2023 · 0 comments

Comments

@BlairSadewitz
Copy link

BlairSadewitz commented Jul 27, 2023

Hello,

I stumbled upon a huggingface downloader written in Go which uses git LFS. It's fast. I get considerably faster transfer speeds than with aria2 or git-lfs, and it doesn't take 1,000 hours to reassemble the file like git-lfs does. The author distributes binaries for a number of platforms, as well (though IIRC they're not statically linked, not sure about that though). You may wish to switch to this from aria2 or add support for it.

https://github.com/bodaay/HuggingFaceModelDownloader

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant