Getting error on lm-evaluation for merged models deployed on HF

[tolgakurtuluss]

Hi there,

Getting below error message while trying to evaluate fine-tuned and merged model. Any thoughts or solutions?

ValueError( ValueError: Trying to set a tensor of shape torch.Size([44312, 4096]) in "weight" (which has shape torch.Size([48353, 4096])), this look incorrect.

[haileyschoelkopf]

Hi,

could you share more details about what you're trying to run? It looks like an embedding layer shape mismatch --potentially see #1707 for more info

[haileyschoelkopf]

Should be fixed by #1828

[tolgakurtuluss]

Removing unnecessary padded tokens fixed the issue. Thanks!