Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[FER] Intel NPU support #1686

Open
yw662 opened this issue Jun 21, 2024 · 2 comments
Open

[FER] Intel NPU support #1686

yw662 opened this issue Jun 21, 2024 · 2 comments
Milestone

Comments

@yw662
Copy link

yw662 commented Jun 21, 2024

Is your feature request related to a problem? Please describe

It can be slow on CPU mode but recently Intel introduced its NPU

Describe the solution you'd like

I suggest xinference support running on intel NPU

Describe alternatives you've considered

or it will have to run on CPU mode

@XprobeBot XprobeBot added this to the v0.12.2 milestone Jun 21, 2024
@qinxuye
Copy link
Contributor

qinxuye commented Jun 24, 2024

I don't know if OpenVINO can work on intel NPU, we are introducing OpenVINO in #1677 .

@yw662
Copy link
Author

yw662 commented Jun 24, 2024

Yeah Intel officially uses openVINO in the demo. It may not work very well with too large models though.

@XprobeBot XprobeBot modified the milestones: v0.12.2, v0.12.4 Jun 28, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants