Repetition of words or chunks with high confidence

[benjaminramirezg]

Hi!
Sometimes FasterWhisper hallucinates: it repeats ever and ever the same word or chunk of words. There is no easy way to find and react to this kind of error because the confidence of the model in those situations is high. What would you suggest to mitigate this problem?
Thanks in advance

[beatrizdemiguelperez]

Same problem here! How can we detect that? confidence should be lower... Is there any workaround at least?

[jfernandezrico]

Same issue came to me. Difficult to be ready to prevent this kind of issue

[phineas-pta]

vad_filter=True

[beatrizdemiguelperez]

Hey @phineas-pta thanks for the reply! could you elaborate a bit? what do we achieve with that param? is the confidence score going to be lower?

[phineas-pta]

nothing to do with confidence

it's a solution to hallucination

read README

[benjaminramirezg]

Hi @phineas-pta, thank you for your suggestion!!
But I already use vad_filter=True and I still get that kind of hallucination...

[phineas-pta]

see #465 for more advanced solutions