How to generate whisper tflite model

[timlliu]

I want to generate my own model.
I try :
https://colab.research.google.com/github/usefulsensors/openai-whisper/blob/main/notebooks/whisper_base_tflite_model.ipynb#scrollTo=TzCrY9Q5jVsg
But, it's not work for me.

[vilassn]

https://github.com/nyadla-sys/whisper.tflite/tree/main/models

Use script from this link to generate model.

[timlliu]

I use multilingual model.

Change forced_decoder_ids to [[1, 50260], [2, 50359], [3, 50363]].

Output is correct.

tflite model's output is not correct

Am I missing something?

[scute0001]

i have the same problem.

https://github.com/nyadla-sys/whisper.tflite/tree/main/models
i follow readme colab to generate multilingual model and replace in android sample
but model is not work.
and has below error msg.

how can i get the multilingual model?

[yong10202]

@timlliu If you proceed with 'monkey patch' referring to this comment, you can solve the problem that forced_decoder_ids does not apply to tflite.

nyadla-sys/whisper.tflite#15 (comment)

When converting to tflite, it seems that the specific code of the hugging face caused the problem.