Skip to content

[WIP] Fix for acc issue in Qwen3 VL moe#1010

Merged
quic-rishinr merged 3 commits into
quic:mainfrom
tv-karthikeya:bug_fix/acc_issue_qwen3_vl_moe
Jun 2, 2026
Merged

[WIP] Fix for acc issue in Qwen3 VL moe#1010
quic-rishinr merged 3 commits into
quic:mainfrom
tv-karthikeya:bug_fix/acc_issue_qwen3_vl_moe

Conversation

@tv-karthikeya
Copy link
Copy Markdown
Contributor

Issue: Generated text is not accurate (unable to identify object in given image)
5/25: Found a workaround, seems like compiler issue - debugging further

Signed-off-by: vtirumal <vtirumal@qti.qualcomm.com>

return local_this
visual_mask = visual_pos_masks.to(hidden_states.dtype)
return hidden_states + (visual_embeds * visual_mask)
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It looks to be compiler ambiguity during interpretation.

@tv-karthikeya
Copy link
Copy Markdown
Contributor Author

Logs : Pr_1010_validation_logs.txt

@vbaddi
Copy link
Copy Markdown
Contributor

vbaddi commented May 30, 2026

Let's rebase and close this @tv-karthikeya @quic-rishinr

@quic-rishinr quic-rishinr added the 1.22 Release 1.22 candidate label Jun 1, 2026
Signed-off-by: vtirumal <vtirumal@qti.qualcomm.com>
@quic-rishinr quic-rishinr merged commit 63e2c29 into quic:main Jun 2, 2026
5 of 7 checks passed
quic-rishinr added a commit that referenced this pull request Jun 2, 2026
This reverts commit 63e2c29.

Signed-off-by: Rishin Raj <rishinr@qti.qualcomm.com>
quic-rishinr added a commit that referenced this pull request Jun 2, 2026
Reverts #1010

Signed-off-by: Rishin Raj <rishinr@qti.qualcomm.com>
tchawada pushed a commit to tchawada/QEff_tanisha that referenced this pull request Jun 2, 2026
Issue: Generated text is not accurate (unable to identify object in
given image)
5/25: Found a workaround, seems like compiler issue - debugging further

---------

Signed-off-by: vtirumal <vtirumal@qti.qualcomm.com>
tchawada pushed a commit to tchawada/QEff_tanisha that referenced this pull request Jun 2, 2026
Reverts quic#1010

Signed-off-by: Rishin Raj <rishinr@qti.qualcomm.com>
tchawada pushed a commit to tchawada/QEff_tanisha that referenced this pull request Jun 2, 2026
Issue: Generated text is not accurate (unable to identify object in
given image)
5/25: Found a workaround, seems like compiler issue - debugging further

---------

Signed-off-by: vtirumal <vtirumal@qti.qualcomm.com>
Signed-off-by: Tanisha Chawada <tchawada@qti.qualcomm.com>
tchawada pushed a commit to tchawada/QEff_tanisha that referenced this pull request Jun 2, 2026
Reverts quic#1010

Signed-off-by: Rishin Raj <rishinr@qti.qualcomm.com>
Signed-off-by: Tanisha Chawada <tchawada@qti.qualcomm.com>
quic-rishinr pushed a commit to tchawada/QEff_tanisha that referenced this pull request Jun 3, 2026
Issue: Generated text is not accurate (unable to identify object in
given image)
5/25: Found a workaround, seems like compiler issue - debugging further

---------

Signed-off-by: vtirumal <vtirumal@qti.qualcomm.com>
Signed-off-by: Tanisha Chawada <tchawada@qti.qualcomm.com>
quic-rishinr added a commit to tchawada/QEff_tanisha that referenced this pull request Jun 3, 2026
Reverts quic#1010

Signed-off-by: Rishin Raj <rishinr@qti.qualcomm.com>
Signed-off-by: Tanisha Chawada <tchawada@qti.qualcomm.com>
vaibverm pushed a commit to vaibverm/efficient-transformers-blocking-techniques that referenced this pull request Jun 6, 2026
Issue: Generated text is not accurate (unable to identify object in
given image)
5/25: Found a workaround, seems like compiler issue - debugging further

---------

Signed-off-by: vtirumal <vtirumal@qti.qualcomm.com>
vaibverm pushed a commit to vaibverm/efficient-transformers-blocking-techniques that referenced this pull request Jun 6, 2026
Reverts quic#1010

Signed-off-by: Rishin Raj <rishinr@qti.qualcomm.com>
vaibverm pushed a commit to vaibverm/efficient-transformers-blocking-techniques that referenced this pull request Jun 6, 2026
Issue: Generated text is not accurate (unable to identify object in
given image)
5/25: Found a workaround, seems like compiler issue - debugging further

---------

Signed-off-by: vtirumal <vtirumal@qti.qualcomm.com>
Signed-off-by: Vaibhav Verma <vaibverm@qti.qualcomm.com>
vaibverm pushed a commit to vaibverm/efficient-transformers-blocking-techniques that referenced this pull request Jun 6, 2026
Reverts quic#1010

Signed-off-by: Rishin Raj <rishinr@qti.qualcomm.com>
Signed-off-by: Vaibhav Verma <vaibverm@qti.qualcomm.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

1.22 Release 1.22 candidate

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants