FEAT: add HF tagging in unsloth

[younesbelkada]

Hi @danielhanchen 👋 !

This PR adds the model tagging feature so that you can easily filter all models that use unsloth that have been pushed on the Hub through a simple filter search on the Hub, e.g.: https://huggingface.co/models?other=unsloth

We do add the tag "unsloth" on SFTTrainer but this PR makes it possible to add the tags for all Trainer / non-Trainer usage for the FastLanguageModel from unsloth.

As this feature is only available from transformers >= 4.37.0 I guarded the call with a

if hasattr(model, "add_model_tags"):

Let me know what do you think !

[younesbelkada]

I quickly tested the implementation with this snippet:

from unsloth import FastLanguageModel
# Load Llama model
model, tokenizer = FastLanguageModel.from_pretrained(
    model_name = "HuggingFaceM4/tiny-random-LlamaForCausalLM", # Supports Llama, Mistral - replace this!
    max_seq_length = 512,
    dtype = None,
    load_in_4bit=False
)

print(model.model_tags)

and it seems to work fine: https://huggingface.co/ybelkada/test-tiny-llama-unsloth

[danielhanchen]

@younesbelkada Oh thanks!! Oh yes definitely adding tags directly makes sense! Definitely can add this in - thanks so much again! :)

[julien-c]

this is really cool! 🦥+🤗

[danielhanchen]

@julien-c :)) Love the model tags feature! :)