Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add support for download-model.py to retrieve PyTorch files (when there are both those and safetensors) #62

Open
chimezie opened this issue Dec 15, 2023 · 0 comments

Comments

@chimezie
Copy link
Contributor

Some systems (such as mlx) don't yet work with HF's safetensors ( see LLama example doesn't work with HF format models? #65 ) and require access to the PyTorch files to work with and convert from them. Currently, I have to download these manually, and it would be beneficial to enhance this script to support getting just the PyTorch files, even if there are both (with an appropriate warning about the dangers of doing so, of course).

Given the dichotomy between mlx and HF models and the scarcity of current support on Apple Metal, there is general value in utilities that help bridge the gap, and this is just one example.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant