Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

add whisper normalization on training #1768

Closed
wants to merge 2 commits into from
Closed

add whisper normalization on training #1768

Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
a43b78d
add whisper normalization on training
Dec 16, 2022
b9cd001
use the normalized_transcripts param
Dec 16, 2022
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Jump to
Jump to file
Failed to load files.
Diff view
Diff view
3 changes: 3 additions & 0 deletions recipes/LibriSpeech/ASR/transformer/train_with_whisper.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -213,6 +213,9 @@ def audio_pipeline(wav):
"wrd", "tokens_list", "tokens_bos", "tokens_eos", "tokens"
)
def text_pipeline(wrd):
#carry on the whisper normalization for fintunning
if hasattr(hparams, "normalized_transcripts"):
wrd =tokenizer._normalize(wrd)
yield wrd
tokens_list = tokenizer.encode(wrd)
# avoid bos and eos tokens.
Expand Down