You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Hi
I probably missed something but how do you load a model saved locally (e.g a fine tuned Llama model)?
I'm trying to use AutoGenerator but I cannot load a local model (hf format).
In the documentation it is stated that a model architecture is infered by the repo name, I guess there may be a conflict with a custom local name.
Thank you.
The text was updated successfully, but these errors were encountered:
Currently, we only support loading models directly from the Hugging Face Hub. That being said, support for loading locally stored models is on our roadmap.
Hi
I probably missed something but how do you load a model saved locally (e.g a fine tuned Llama model)?
I'm trying to use
AutoGenerator
but I cannot load a local model (hf format).In the documentation it is stated that a model architecture is infered by the repo name, I guess there may be a conflict with a custom local name.
Thank you.
The text was updated successfully, but these errors were encountered: