NeMo seems to freeze when I try to decode with a LM using the script eval_beamsearch_ngram_ctc.py #8313
Replies: 2 comments 4 replies
-
I discovered your post yesterday and I think that I have the same issue as you have. Since there have been 2 months since your post, have you found a solution to your issue? In my case, the issue showed up after updating from a very old NeMo version to 1.22 and Nvidia Pytorch 23.05 or 23.12 Docker containers. I was able to confirm that changing the import of NeMo/nemo/collections/asr/modules/beam_search_decoder.py Lines 63 to 69 in 1b0c6c9 Digging deeper into the problem, I figured that it might be a deadlock caused when importlib tries to import the contents of |
Beta Was this translation helpful? Give feedback.
-
We're moving to Flashlight as the defacto engine for CTC Beam Search and will be deprecating OS2S beam decoder in the coming release due to its unmaintained status Fyi @karpnv |
Beta Was this translation helpful? Give feedback.
-
I trained a model using this tutorial. I'm trying to decode using that model with an LM. I installed the decoders, but the applications seem to hang during the decoding. I'm using the eval_beamsearch_ngram_ctc.py script.
I am seeing an interesting warning...
I followed the instructions on the github page, and it installs Python-Cuda 11.8 in the Conda environment. The Cuda version on the server is CUDA 12.0. So I'm not sure where the 10.2 came from. It does say that it may take some time, but I've let it run for a couple days and the script still hasn't finished. Below is the output set to the screen.
20240130_run_ctc.txt
Beta Was this translation helpful? Give feedback.
All reactions