[Question] Whisper GPU mobile NNAPI

[yurii-k-ring]

Hello, I'm trying to run Whisper model using ONNX runtime with Olive-generated model on Android.
It works fine on CPU and I tried to use GPU, but it looks like under GPU it means CUDA execution provider only.

Is there a way to generate a model, optimized to run on Android mobile GPU (NNAPI Execution provider)? Thanks in advance!

[guotuofeng]

From the time being, Olive doesn't support on mobile hardware except CPU. We will prioritize the requirement for optimization on mobile hardware.