-
Notifications
You must be signed in to change notification settings - Fork 231
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[Bug] Duplicate text while using chrome extension #117
Comments
@lightwastak3n Hello, can you check which model are you using? We have seen this behaviour if we use WhisperLive/whisper_live/server.py Line 556 in 8c36768
|
@makaveli10 WhisperLive/whisper_live/server.py Lines 596 to 597 in 2c8a25d
Also if we have Use Multilingual Model checked off in the extension. Shouldn't that automatically switch to .en model?As far as I can see this function just changes self.multilingual. |
You're right there are a few things that changed, we will have to change the extension interface and remove the multilingual option instead give options to use Although about the repition, could you log the segments WhisperLive/whisper_live/server.py Line 772 in 2c8a25d
here and see the |
I've added saving to a file to a chrome extension but there seems to be a bug in the whisper server. Every now and then it returns repeated text.
I'm running this on cpu (Ryzen 2400g) using tiny or base models. Small isn't quite real time for me so I haven't done any testing there.
I've noticed that sometimes the transcription skips a few seconds right before this happens. Not sure if it's my cpu but using faster whisper directly I get about 0.1 RTF (30 seconds for 5 min of audio) using tiny int8.
Could it just be hallucinations? I haven't encountered any like these while transcribing hours of audio using faster whisper.
This is the unmodified chrome extension from this repo
![whisper_chrome_duplicate2](https://private-user-images.githubusercontent.com/54376354/300614204-80d2df95-c309-4c33-a1fb-fcb0f0390332.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MjM5MjQwNjksIm5iZiI6MTcyMzkyMzc2OSwicGF0aCI6Ii81NDM3NjM1NC8zMDA2MTQyMDQtODBkMmRmOTUtYzMwOS00YzMzLWExZmItZmNiMGYwMzkwMzMyLnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDA4MTclMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwODE3VDE5NDI0OVomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPWNmNzRkMTI4YTA0OTY4OTM4N2FhZTU4YzEzYTYwYjZhOGQzZmMzN2I5MGIzNDFjYzhjYzdmOWIwMDgxOTM1YjAmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.fZXh_EwIy-dbSCM3EOLO2HNn-0_t9FkjHvn5cRYHyoA)
This is the modified extension. I've also added the whole output to the transcription div so it's easier to see
![whisper_chrome_duplicate](https://private-user-images.githubusercontent.com/54376354/300617168-cdf8c98c-37fc-4e8e-8cf8-33c2321655a7.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MjM5MjQwNjksIm5iZiI6MTcyMzkyMzc2OSwicGF0aCI6Ii81NDM3NjM1NC8zMDA2MTcxNjgtY2RmOGM5OGMtMzdmYy00ZThlLThjZjgtMzNjMjMyMTY1NWE3LnBuZz9YLUFtei1BbGdvcml0aG09QVdTNC1ITUFDLVNIQTI1NiZYLUFtei1DcmVkZW50aWFsPUFLSUFWQ09EWUxTQTUzUFFLNFpBJTJGMjAyNDA4MTclMkZ1cy1lYXN0LTElMkZzMyUyRmF3czRfcmVxdWVzdCZYLUFtei1EYXRlPTIwMjQwODE3VDE5NDI0OVomWC1BbXotRXhwaXJlcz0zMDAmWC1BbXotU2lnbmF0dXJlPTMyYTBjNWY5ZTM3NWI4N2RhMDBhYTg0NzM0ZjBhYzlmNjVhN2Q4OTRmYWU4Nzg3YWIyZWJiMGI4ODNlYzQ0MzEmWC1BbXotU2lnbmVkSGVhZGVycz1ob3N0JmFjdG9yX2lkPTAma2V5X2lkPTAmcmVwb19pZD0wIn0.zAlTrWf4IFBRs8m35W6Vw8m3n2RoWQl5tl-L5rXOiIg)
The text was updated successfully, but these errors were encountered: