Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Move model to external harddrive and symlink it #18

Closed
rowild opened this issue Jan 2, 2024 · 2 comments
Closed

Move model to external harddrive and symlink it #18

rowild opened this issue Jan 2, 2024 · 2 comments

Comments

@rowild
Copy link

rowild commented Jan 2, 2024

This is actually a question not an issue:

Where does the VS Code extension download the model to?
Is there a way to choose the location where the model can be saved to?

I am testing lots of UIs for LLMs and therefore come into the situation that a model is downloaded rather often. This reduces disk space very quickly. For things likes Stable Diffusion with Automatic1111, ComfyUI, Fooocus, StabelSwarm etc it is easy to either set a custom source folder via the software's settings or to manually create a symlinked folder. Then I only need the models once.

Here it is no really clear where the model is saved to, which is something that tends to create distrust. I would very much like to be able to see where things are downloaded to, and even better: I would like to set options for things like that.

Would that be possible to implement here, too?

Also – since this is not an issue: Can I motivate you to open the "Discussions" panel here in your github repo? That would provide a "Questions" section, where this topic would fit better. Thank you! :-)

@ex3ndr
Copy link
Owner

ex3ndr commented Jan 2, 2024

That's fine to ask questions here.

I don't know how to configure target folder for ollama, but i am sure you would find something in their repo.

@rowild
Copy link
Author

rowild commented Jan 3, 2024

@ex3ndr Thank you for your feedback! I indeed found the local folder '.ollama', which was the location where the model was saved to. I could symlink the specific folder to my external drive and so far everything seems to work fine.

@rowild rowild closed this as completed Jan 3, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants