You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
You can set the padding side when loading the processor as AutoProcessor.from_pretrained(model_id, padding_side="left"). We usually recommend to make sure padding side is on the correct side, before generating :)
We might need to update the model docs, if example code for batch generation failed with the same error. Feel free to open a PR if so
This issue has been automatically marked as stale because it has not had recent activity. If you think this still needs to be addressed please comment on this thread.
Please note that issues that do not follow the contributing guidelines are likely to be ignored.
System Info
the padding side should be left as qwen2 vl do .
Information
Tasks
examples
folder (such as GLUE/SQuAD, ...)Reproduction
run conditional generation using qwen2_5_vl using flash attention 2 .
Expected behavior
The text was updated successfully, but these errors were encountered: