-
Notifications
You must be signed in to change notification settings - Fork 111
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add .to()
to OVBaseModel
#284
Conversation
The documentation is not available anymore as the PR was closed or merged. |
7a652ad
to
39dad06
Compare
The simple implementation of moving to OVBaseModel silently failed. After |
@Vipitis Thanks! We wrote at the same time. I noticed it too and it should be fixed now. |
@echarlaix the test fails with PyTorch 4.28 (unrelated to this PR). I restricted PyTorch to <4.28 on my fork and the tests pass there: https://github.com/helena-intel/optimum-intel/actions/runs/4699850769/jobs/8333817513 |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thanks a lot for fixing it @helena-intel
model.to("TEST") | ||
self.assertEqual(model._device, model.decoder._device) | ||
self.assertEqual(model.decoder._device, "TEST") | ||
|
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
self.assertEqual(model.decoder.request, None) |
Yes you're correct it's unrelated to this PR, I fixed it in #285 |
Fixes `.to()` not working for OVModelForCausalLM
Co-authored-by: Ella Charlaix <80481427+echarlaix@users.noreply.github.com>
0cdb9cb
to
7987ff6
Compare
Fixes
.to()
not working for OVModelForCausalLM