Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ambiguous training validation loss #47

Closed
TieLeeyoung opened this issue May 31, 2018 · 2 comments
Closed

ambiguous training validation loss #47

TieLeeyoung opened this issue May 31, 2018 · 2 comments

Comments

@TieLeeyoung
Copy link

hello, i'm running the model, but i'm getting a bad loss, in the sixth epoch i got these scores:
[Epoch 6] Out of 256 samples: [CER: 25.898 - 0.910] [WER: 7.492 - 1.457] [BLEU: 0.314 - 0.314]
Are these scors meaningful? or the model overfit, and what's is the bleu score? is it the accuracy in speech recognition

@qslvhw
Copy link

qslvhw commented Jun 3, 2018

I have the same question. I only got loss and validation loss after every epoch. How to see the accuracy?

@rizkiarm
Copy link
Owner

The performance of the model is indicated by Word Error Rate (WER), Character Error Rate (CER), and BLEU score. You can find out more about that by reading the paper. Based on the scores that you have got, it seems that your model was not learning. Please check whether you made some mistake in your setup and make sure that you provide enough (and correct) examples for the model.

I will close this issue for now. Please re-open it if you think that you can provide more detail about your problem and have tried your best to fix it, as I think it is not the issue with the program.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants