Maybe the vocab_size can be duplicated to the mainconfig for PEFT to pick up

[lancercat]

transformers/src/transformers/models/gemma3/configuration_gemma3.py

Line 322 in 06c16de

self.vision_config = vision_config

        self.vocab_size=self.text_config.vocab_size;

Due to the following check in peft

https://github.com/huggingface/peft/blob/6c489499300c652a4990cfbcc18539417e73c262/src/peft/utils/save_and_load.py#L249

[zucchini-nlp]

cc @BenjaminBossan , i think we should check for config.get_text_config()