Gemma3 not supported in main branch

[xihuai18]

System Info

latest main branch of 0325

Who can help?

@amyeroberts, @qubvel

Gemma3Config is not supported in the lastest main branch.

ValueError: Unrecognized configuration class <class 'transformers.models.gemma3.configuration_gemma3.Gemma3Config'> for this kind of AutoModel: AutoModel.

Information

• The official example scripts
• My own modified scripts

Tasks

• An officially supported task in the examples folder (such as GLUE/SQuAD, ...)
• My own task or dataset (give details below)

Reproduction

run gemma3 using AutoModel.from_config

Expected behavior

No.

[zucchini-nlp]

@xihuai18 hey! We don't have a base Gemma3Model class yet, I am adding base classes for all vision LLMs currently in #36367. If you want to get last hidden state from the model, you can do as follows:

model = Gemma3ForConditionalGeneration.from_pretrained(model_id)
last_hidden_states = model(input_ids, pixel_values=pixel_values).hidden_states[-1]