-
Notifications
You must be signed in to change notification settings - Fork 3k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[Inference] support deepseek_vl2 #10182
base: develop
Are you sure you want to change the base?
Conversation
Thanks for your contribution! |
Codecov ReportAttention: Patch coverage is
❌ Your patch check has failed because the patch coverage (0.00%) is below the target coverage (80.00%). You can increase the patch coverage or adjust the target coverage. Additional details and impacted files@@ Coverage Diff @@
## develop #10182 +/- ##
===========================================
- Coverage 49.86% 49.69% -0.17%
===========================================
Files 757 761 +4
Lines 122792 124232 +1440
===========================================
+ Hits 61233 61742 +509
- Misses 61559 62490 +931 ☔ View full report in Codecov by Sentry. 🚀 New features to boost your workflow:
|
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM,辛苦推理同学确认
inputs_embeds = self.embed_tokens(ids_remove_padding) | ||
else: | ||
assert len(inputs_embeds.shape) == 3 | ||
# This is the case in the image-to-text model such as qwen2-vl, |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
这里注释改一下,代码里qwen2-vl全部去掉
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
done了
Before submitting
tests
folder. If there are codecov issues, please add tests cases first.PR types
PR changes
Description