endless loop repetition

[eagleftw023]

hi
i got repetition/hallucination lines when trying to transcribe
repeated lines have the same words (it stop transcriping and just list the same words repeated)
how can i solve this please?

[KjeldsenDK]

-mc 0 helps but it's a larger issue..

[eagleftw023]

where i can do this?
and how ?

-mc 0 helps but it's a larger issue..

[emcodem]

You can specify it using the commandline version.
Also, the issue was reported very often, first occurence in this repository is from myself:
#26

[eagleftw023]

i use the desktop version
do you mean that i should downloa the source and open it in visual studio ?

You can specify it using the commandline version. Also, the issue was reported very often, first occurence in this repository is from myself: #26

[emcodem]

Sorry for the short explaination, no i did not want you to compile the source code or such.
Just download and use the commandline version. Download is called clip.zip, it contains main.exe, then call on commandline like this (of course you need to modify all the paths in this example by the paths where your stuff is, or create the same paths that i specify here and place the same needed filenames there)

C:\whisper\main.exe -mc 0 -f C:\temp\test.wav -l de -m C:\whisper\models\ggml-large.bin

We can also simply use this in a batch file and drag/drop files to translate on the bat file.
Create a new empty text file on your desktop (or anywhere else) with the following content:

"C:\whisper\main.exe" -m "C:\whisper\models\ggml-large.bin" -l de -mc 0 -osrt %1

pause

Change the path to main.exe and model to your desire (but leave the ""), also change -l de to your language code and -mc 0 to -mc 224 if you want to raise transcribe quality but (currently) add a risk of falling into repetition loop.
You can change -osrt to ovtt or -otxt, this is the option that enables writing a text file.
Save the file and drag/drop some audio file on the .bat file. A cmd window should open while transcribe is running and you can close it to cancel or when finished.

A further improvement could be to add a simple registry key that adds a rightclick menu on .mp3 .wav files to start the batch and transcribe. If anyone is interested, please ask.

[KjeldsenDK]

Fashionable late to repeat the above :-)
Yes, -mc 0 is a command line option, the gui has limited options, and to be honest, i spend hours searching for a detailed explanation on all the command line options, and didn't succeed. The -mc 0 was from another thread on the subject

[eagleftw023]

thanks alot
this helped and its now work with no loops but i get a message sometimes
runFullImpl: failed to generate timestamp token - skipping one second
is there any solution to this ?

[albino1]

@Const-me any chance we can get --max-context exposed in the GUI without having to use the command line? At least until the repetitions issue gets fixed by OpenAI and it trickles down.

[aszk1415]

Sorry for the short explaination, no i did not want you to compile the source code or such. Just download and use the commandline version. Download is called clip.zip, it contains main.exe, then call on commandline like this (of course you need to modify all the paths in this example by the paths where your stuff is, or create the same paths that i specify here and place the same needed filenames there)

C:\whisper\main.exe -mc 0 -f C:\temp\test.wav -l de -m C:\whisper\models\ggml-large.bin

I downloaded this repository as a ZIP file, but I couldn't find the main.exe in it.Where can I find this one.

[emcodem]

The compiled binaries and source code are 2 different things :)
The cli program main.exe is in clip.zip, you can download it where you download all other compiled stuff:
https://github.com/Const-me/Whisper/releases/

[eagleftw023]

@emcodem hi do you know how to solve this?
runFullImpl: failed to generate timestamp token - skipping one second

[emcodem]

@eagleftw023 no, i mention the same in #26
As this message comes at the same spot where it started repeating before for me, i believed that this might be the actual root cause of all the troubles. However, the general line in this repository seems to be that we wait for the guys from whisper original project (or the guys from the whisper cpp project) to come up with a solution so we can copy what they do in this repository

[albino1]

whisper.cpp pushed an update today in v1.30 that supposedly might help with the repetitions:

https://github.com/ggerganov/whisper.cpp/releases/tag/v1.3.0

The key commit is this one:

ggml-org/whisper.cpp@f19e23f

Hopefully we'll see this quickly ported over to this project.

[eagleftw023]

whisper.cpp pushed an update today in v1.30 that supposedly might help with the repetitions:

https://github.com/ggerganov/whisper.cpp/releases/tag/v1.3.0

The key commit is this one:

ggerganov/whisper.cpp@f19e23f

Hopefully we'll see this quickly ported over to this project.

@Const-me

[emcodem]

Just tested it with latest ggerganov master, the problem is not solved. I don't understand why he thinks the problem can just be solved by reducing the parallel decoders but he for sure has his reasons