Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

skip downloading model weights #1

Closed
sieste opened this issue Mar 12, 2023 · 3 comments
Closed

skip downloading model weights #1

sieste opened this issue Mar 12, 2023 · 3 comments

Comments

@sieste
Copy link

sieste commented Mar 12, 2023

I have already downloaded the 7B model weights. How can I avoid redownloading them with npx dalai llama?

@marcuswestin
Copy link
Contributor

Fixed in #16

@ekp1k80
Copy link

ekp1k80 commented Mar 13, 2023

You have these 2 options
#16
#5

I recomment the 16. I download the repo and run yarn just:run You have to move the models folder (the model you already download) to llama.cpp

I did'nt be able to run it so. The file convert-pth-to-ggml.py is crashing in the line
model = torch.load(fname_model, map_location="cpu")
I think is because i don't have enought ram but i saw (in others repositories on twitter) a dude runned it in an raspberry pi
So... something is not working correctly

@marcuswestin
Copy link
Contributor

Hey @cocktailpeanut if you'd like help managing issues etc I'm happy to help out.

(E.g this one has been fixed and I can mark it if I have permission)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants