-
Notifications
You must be signed in to change notification settings - Fork 2.5k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
EncDecCTCModel.transcribe(audio=...)
changed to EncDecCTCModel.transcribe(paths2audio_files=...)
#9230
Comments
"audio" is an argument only of NeMo 2.0, which is the current main branch, and only it supports tensors. The old 1.23 Nemo version only supports path2audio_files and does not accept tensors. |
Okay, even after install from source, its not able to transcribe the whole tensor as it used to earlier. Still its only transcribing first 100000 samples of the waveform |
What's the error trace ? Or just finished after 100K. Btw if you transcribe that much data you run the risk of OOM CPU ram. You might want to try the new transcribe_generator() instead if it's OOM you're facing |
This is my code:
@titu1994 as we can clearly see, in both the outputs its not transcribing whole audio |
I see now. In both case, a dummy data loader is used which has duration set to 100000 - this doesn't matter, the model computes the actual duration on the fly. Ignore the 100000. Have you listened to the audio file yourself ? 35 second audio file and that much expected text - it is possibly spoken far too fast, or the resample is causing a bug causing the model to be unable to predict properly. Write the file to disk after resampling and hear the audio fully to see if there's issues in it. |
Yes, the audio has continuous speech, at normal rate. I have resampled the audio using ffmpeg to 16000 with mono |
@titu1994 can you tell me how I can use the model to transcribe at least a 48 seconds audio? If its 16k Hz, and a mono sample |
This issue is stale because it has been open for 30 days with no activity. Remove stale label or comment or this will be closed in 7 days. |
This issue was closed because it has been inactive for 7 days since being marked as stale. |
Description:
I updated NeMO to 1.23.0, and trying to use pretrained
EncDecCTCModel.transcribe
.In previous version I used to input audio tensors loaded using torchaudio. But now it asks for
paths2audios_label
, when I input filepath, it doesn't transcribe the whole file but first 100000 datapoints. When I looked into Nvidia latest documents. There was no reference topaths2audio_files
but instead the argument wasaudio
which took tensor. How to get that functionality back to transcribe whole file.Steps/Code to reproduce bug
Expected behavior
We get the transcription when we give path in a list, since giving tensor, we are getting tensor can't we converted to JSON.
Environment overview (please complete the following information)
pip install "nemo-toolkit[all]"
Environment details
If NVIDIA docker image is used you don't need to specify these.
Otherwise, please provide:
Additional context
GPU Model: Tesla V100
The text was updated successfully, but these errors were encountered: