Repository navigation
Linux desktop apps on the Intel NPU: voice typing, semantic search, face login (Wildcat Lake numbers) #39791
karanshukla
started this conversation in
Show and tell
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
I've been building a set of open source Linux apps that run on the Intel NPU through OpenVINO. Everything below was measured on a Dell XPS 13 with a Core 5 320 (Wildcat Lake). Details also available here: https://vinopilot.ca/
Apps
Latency
-hint latencyEnergy (embeddings, whole laptop on battery, BEIR SciFact, batch 1, OpenVINO 2026.4.1, NPU driver 1.35.0)
That is roughly a tenth of the energy per document on the NPU.
Caveats: power is whole laptop draw read from the battery while unplugged, not package power. There's no iGPU power number because the GPU plugin segfaulted in compile_model on some loads, so it was left out of that benchmark.
cc @ravi9 @openvino-dev-samples @adrianboguszewski in case any of this is useful for NPU samples or demos. Feedback is welcome, especially from anyone running these on Lunar Lake or Panther Lake.
All reactions