Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Loading a model saved locally #314

Closed
ccdv-ai opened this issue Aug 28, 2023 · 2 comments
Closed

Loading a model saved locally #314

ccdv-ai opened this issue Aug 28, 2023 · 2 comments
Labels
feat/misc Feature: Miscellaneous type/feature Type: Feature

Comments

@ccdv-ai
Copy link

ccdv-ai commented Aug 28, 2023

Hi
I probably missed something but how do you load a model saved locally (e.g a fine tuned Llama model)?
I'm trying to use AutoGenerator but I cannot load a local model (hf format).

In the documentation it is stated that a model architecture is infered by the repo name, I guess there may be a conflict with a custom local name.

Thank you.

@shadeMe shadeMe added type/feature Type: Feature feat/misc Feature: Miscellaneous labels Aug 29, 2023
@shadeMe
Copy link
Collaborator

shadeMe commented Aug 29, 2023

Currently, we only support loading models directly from the Hugging Face Hub. That being said, support for loading locally stored models is on our roadmap.

@shadeMe
Copy link
Collaborator

shadeMe commented Oct 19, 2023

This is now implemented. See #315.

@shadeMe shadeMe closed this as completed Oct 19, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
feat/misc Feature: Miscellaneous type/feature Type: Feature
Projects
None yet
Development

No branches or pull requests

2 participants