You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Thank you so much for your amazingly efficient toolkit in streaming focused ASR.
I have trained an EN-DE bilingual streaming ASR model using this receipe.
However, I am not really satisfied with the performance on the English side, and I want to use an externally trained RNN LM (trained using this receipe) to strengthen the WER only on the English side.
I tried using --decoding-method modified_beam_search_lm_shallow_fusion and using English RNN-LM, however, ran into errors due to different vocab size used.
vocab size for bilingual ASR training = 1000 (500 for EN and 500 for DE) and vocab size used for English RNN-LM = 500.
I wonder if its possible to use a monolingual RNN LM with a bilingual ASR model.
Alternatively, is it possible to combine two RNN-LMs? or somehow interpolate them?
I saw some related discussions here: kaldi-asr/kaldi#2069.
Thank You
The text was updated successfully, but these errors were encountered:
params.vocab_size is the size of the sentence piece tokenizer from ASR (1000 in my case), which is different from the actual RNN LM vocab size (500 in my case). How can I overcome this?
Hi K2 team,
Thank you so much for your amazingly efficient toolkit in streaming focused ASR.
I have trained an EN-DE bilingual streaming ASR model using this receipe.
However, I am not really satisfied with the performance on the English side, and I want to use an externally trained RNN LM (trained using this receipe) to strengthen the WER only on the English side.
I tried using
--decoding-method modified_beam_search_lm_shallow_fusion
and using English RNN-LM, however, ran into errors due to different vocab size used.vocab size for bilingual ASR training = 1000 (500 for EN and 500 for DE) and vocab size used for English RNN-LM = 500.
I wonder if its possible to use a monolingual RNN LM with a bilingual ASR model.
Alternatively, is it possible to combine two RNN-LMs? or somehow interpolate them?
I saw some related discussions here: kaldi-asr/kaldi#2069.
Thank You
The text was updated successfully, but these errors were encountered: