What's the default padding_side for fine-tuning vicuna?

[CSerxy]

Hi FastChat authors,

If we are going to fine-tune the vicuna via the default instruction, what's the default padding_side it is using? Is it 'left' or 'right'? Since when we do the inference, we are supposed to set padding_side as same as the fine-tuning process, right?

I saw a related issue in #1156 @merrymercy

Many thanks in advance!

[merrymercy]

It does not matter, as long as you set the attention mask correctly.

[CSerxy]

If I load a pre-trained vicuna for inference purpose (no attention mask involved), can you tell the default padding_side vicuna were using? Many thanks!

[merrymercy]

It works with either as long as you set attention mask (padding mask) correctly