New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Connection refused when testing set is large #20
Comments
I met the same problem , I am wondering is there a way to run in local without servers or Web |
@George0828Zhang Thanks for reporting the issue! I haven't tried a test set of this size. And the error you posted looks like the server side is down (Maybe because of the the memory issue). I will found a work around recently and let you know if there is any update. |
Hi @1190301804 currently there is only server-client setup. Local setup is not every easy to generalize. |
So is there any solution except make the test size smaller ? |
We met the same problem, and have found the solution. Line 187 in 2db1a59
The reason is that when waiting 3 seconds to start the client, the server is not initailized immediately. So the simplest way is to increase the waiting time. As for why starting the server needs more time for SpeechAgent, the Scorer when reseting the AudioInstance would cost longer time than TextInstance. SimulEval/simuleval/scorer/scorer.py Line 59 in 2db1a59
|
Hi,
I noticed that when using dev/test set with large number of sentences (e.g. CoVoST2's dev/test generally have 15k sentences), the evaluation will hang due to the following error:
After some printing here and there, I suspect this error comes from here . however I'm not familiar with web app so I have no idea how to correct/avoid this error.
Is there any easy solution to this? Much appreciated. @xutaima
EDIT:
Forgot to mention that this does not happen if I use a subset of sentences e.g. 1500 sentences.
The text was updated successfully, but these errors were encountered: