What modules of the model are fine-tuned by the “Chart Specific Annealing Tuning” mentioned in the paper?

[Chinouth2144]

[Coobiw]

Hi, thanks for you attention. In chart-specific annealing tuning, the moe connector(including learnable router and the experts) and LLM LoRA are trainable.

[Coobiw]

Detailed settings are the same as sft.sh.