Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Bugfix: Illogical "Avoid computing higher temperatures on no_speech" #652

Merged
merged 1 commit into from
Jan 24, 2024

Conversation

Purfview
Copy link
Contributor

Fixing: #621
Regression since PR: #225

The bug: It's "silence" when decoding has failed due to compression_ratio_threshold [+no_speech_threshold] in #225, when further down the code it's not "silence" anymore.

"Silence" should be only when decoding has failed due to log_prob_threshold [+no_speech_threshold].
As described there:

no_speech_threshold: If the no_speech probability is higher than this value AND
the average log probability over sampled tokens is below `log_prob_threshold`,
consider the segment as silent.

The bug opens the gates for the hallucination loops.

@nguyendc-systran nguyendc-systran merged commit 00efce1 into SYSTRAN:master Jan 24, 2024
3 checks passed
@Purfview Purfview deleted the patch-1 branch February 21, 2024 12:54
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants