Intel® Core™ Ultra processors NPU Support

[mofanke]

Prerequisites

Please answer the following questions for yourself before submitting an issue.

• I am running the latest code. Development is very rapid so there are no tagged versions as of now.
• I carefully followed the README.md.
• I searched using keywords relevant to my issue to make sure that I am creating a new issue that is not already open (or closed).
• I reviewed the Discussions, and have a new bug or useful enhancement to share.

Feature Description

Intel® Core™ Ultra processors now has released , how can llama.cpp use that npu to fast up

Motivation

Intel® Core™ Ultra processors deliver three dedicated engines (CPU, GPU, and NPU) to help unlock the power of AI
https://www.intel.com/content/www/us/en/products/docs/processors/core-ultra/core-ultra-series-1-product-brief.html

Possible Implementation

OpenVINO™, WindowsML, DirectML, ONNX RT

[LazyGeniusMan]

Intel open source its NPU implementation library. Looks like it's using OpenVINO

https://github.com/intel/intel-npu-acceleration-library
https://intel.github.io/intel-npu-acceleration-library/cpp_reference.html

[github-actions]

This issue was closed because it has been inactive for 14 days since being marked as stale.

[paaspaas00]

Hi, any plans for this?